Exploring Emotion Responses toward Pedestrian Crossing Actions for Designing In-vehicle Empathic Interfaces

Conference Paper (2022)
Author(s)

Surjya Ghosh (Birla Institute of Technology and Science, Pilani)

Gerard Pons Rodriguez (Centrum Wiskunde & Informatica (CWI))

Shruti Rao (Centrum Wiskunde & Informatica (CWI))

Abdallah Ali (Centrum Wiskunde & Informatica (CWI))

P.S. Cesar (Centrum Wiskunde & Informatica (CWI), TU Delft - Multimedia Computing)

Multimedia Computing
Copyright
© 2022 Surjya Ghosh, Gerard Pons Rodriguez, Shruti Rao, Abdallah El Ali, Pablo Cesar
DOI related publication
https://doi.org/10.1145/3491101.3519764
More Info
expand_more
Publication Year
2022
Language
English
Copyright
© 2022 Surjya Ghosh, Gerard Pons Rodriguez, Shruti Rao, Abdallah El Ali, Pablo Cesar
Multimedia Computing
ISBN (electronic)
978-1-4503-9156-6
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

While affective non-verbal communication between pedestrians and drivers has been shown to improve on-road safety and driving experiences, it remains a challenge to design driver assistance systems that can automatically capture these affective cues. In this early work, we identify users' emotional self-report responses towards commonly occurring pedestrian actions while crossing a road. We conducted a crowd-sourced web-based survey (N=91), where respondents with prior driving experience viewed videos of 25 pedestrian interaction scenarios selected from the JAAD (Joint Attention for Autonomous Driving) dataset, and thereafter provided valence and arousal self-reports. We found participants' emotion self-reports (especially valence) are strongly influenced by actions including hand waving, nodding, impolite hand gestures, and inattentive pedestrian(s) crossing while engaged with a phone. Our findings provide a first step towards designing in-vehicle empathic interfaces that can assist in driver emotion regulation during on-road interactions, where the identified pedestrian actions serve as future driver emotion induction stimuli.