Multimodal Analytics for Real-Time Feedback in Co-located Collaboration

Conference Paper (2018)
Author(s)

Sambit Praharaj (Open University of the Netherlands)

Maren Scheffel (Open University of the Netherlands)

Hendrik Drachsler (Open University of the Netherlands, DIPF, Goethe University)

M.M. Specht (Open University of the Netherlands)

Affiliation
External organisation
DOI related publication
https://doi.org/10.1007/978-3-319-98572-5_15
More Info
expand_more
Publication Year
2018
Language
English
Affiliation
External organisation
Pages (from-to)
187-201
ISBN (print)
9783319985718

Abstract

Collaboration is an important 21st century skill; it can take place in a remote or co-located setting. Co-located collaboration (CC) is a very complex process which involves subtle human interactions that can be described with multimodal indicators (MI) like gaze, speech and social skills. In this paper, we first give an overview of related work that has identified indicators during CC. Then, we look into the state-of-the-art studies on feedback during CC which also make use of MI. Finally, we describe a Wizard of Oz (WOz) study where we design a privacy-preserving research prototype with the aim to facilitate real-time collaboration in-the-wild during three co-located group PhD meetings (of 3–7 members). Here, human observers stationed in another room act as a substitute for sensors to track different speech-based cues (like speaking time and turn taking); this drives a real-time visualization dashboard on a public shared display. With this research prototype, we want to pave way for design-based research to track other multimodal indicators of CC by extending this prototype design using both humans and sensors.

No files available

Metadata only record. There are no files for this record.