Affective Driver-Pedestrian Interaction

Exploring Driver Affective Responses toward Pedestrian Crossing Actions using Camera and Physiological Sensors

Conference Paper (2023)
Author(s)

Shruti Rao (Universiteit van Amsterdam)

Sabrina Wirjopawiro (Centrum Wiskunde & Informatica (CWI))

Gerard Pons Rodriguez (Centrum Wiskunde & Informatica (CWI))

Thomas Röggla (Centrum Wiskunde & Informatica (CWI))

P.S. Cesar Garcia (TU Delft - Multimedia Computing)

Abdallah El Ali (Centrum Wiskunde & Informatica (CWI))

Multimedia Computing
Copyright
© 2023 Shruti Rao, Sabrina Wirjopawiro, Gerard Pons Rodriguez, Thomas Röggla, Pablo Cesar, Abdallah El Ali
DOI related publication
https://doi.org/10.1145/3580585.3607168
More Info
expand_more
Publication Year
2023
Language
English
Copyright
© 2023 Shruti Rao, Sabrina Wirjopawiro, Gerard Pons Rodriguez, Thomas Röggla, Pablo Cesar, Abdallah El Ali
Multimedia Computing
Pages (from-to)
300-310
ISBN (electronic)
9798400701054
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Eliciting and capturing drivers' affective responses in a realistic outdoor setting with pedestrians poses a challenge when designing in-vehicle, empathic interfaces. To address this, we designed a controlled, outdoor car driving circuit where drivers (N=27) drove and encountered pedestrian confederates who performed non-verbal positive or non-positive road crossing actions towards them. Our findings reveal that drivers reported higher valence upon observing positive, non-verbal crossing actions, and higher arousal upon observing non-positive crossing actions. Drivers' heart signals (BVP, IBI and BPM), skin conductance and facial expressions (brow lowering, eyelid tightening, nose wrinkling, and lip stretching) all varied significantly when observing positive and non-positive actions. Our car driving study, by drawing on realistic driving conditions, further contributes to the development of in-vehicle empathic interfaces that leverage behavioural and physiological sensing. Through automatic inference of driver affect resulting from pedestrian actions, our work can enable novel empathic interfaces for supporting driver emotion self-regulation.