Knowing Me, Knowing AU
How Should We Design Agent-Mediated Mimicry?
Agnes Johanna Axelsson (TU Delft - Interactive Intelligence)
Weilun Chen (TU Delft - Intelligent Systems)
Deborah Van Sinttruije (TU Delft - Interactive Intelligence)
Iulia Lefter (TU Delft - System Engineering)
Laurens Rook (TU Delft - Economics of Technology and Innovation)
Catholijn M. Jonker (TU Delft - Interactive Intelligence)
Catharine Oertel (TU Delft - Interactive Intelligence)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
A lack of self-awareness of communicative behaviours can lead to disadvantages in important interactions. Video recordings as a tool for self-observation have been widely adopted to initiate behaviour change and reflection. Seeing oneself in a recording can lead to negative affect. Forcing an external perspective can lead to cognitive dissonance. Avatars and virtual agents have the advantage that they can copy a human's behaviour while potentially avoiding this dissonance. To explore the design space of mimicking agents, we set up a user study where a video baseline is compared to agent-mediated conditions ranging from idle non-verbal behaviour to complete mimicry of the voice and face. We show that participants gain increased self-awareness from seeing themselves mediated through the virtual agent. We further discuss qualitative observations for the future design of systems that aid in self-reflection, and particularly note that partial mimicry seems to be less appreciated than full mimicry.
help_outline