Exploring Emotion Responses toward Pedestrian Crossing Actions for Designing In-vehicle Empathic Interfaces

Conference Paper (2022)
Author(s)

Surjya Ghosh (Birla Institute of Technology and Science, Pilani)

Gerard Pons Rodriguez (Centrum Wiskunde & Informatica (CWI))

Shruti Rao (Centrum Wiskunde & Informatica (CWI))

Abdallah El Ali (Centrum Wiskunde & Informatica (CWI))

Pablo Cesar (Centrum Wiskunde & Informatica (CWI), TU Delft - Multimedia Computing)

Research Group
Multimedia Computing
DOI related publication
https://doi.org/10.1145/3491101.3519764
More Info
expand_more
Publication Year
2022
Language
English
Research Group
Multimedia Computing
Article number
256
ISBN (electronic)
978-1-4503-9156-6
Event
2022 CHI Conference on Human Factors in Computing Systems, CHI EA 2022 (2022-04-30 - 2022-05-05), New Orleans, United States
Downloads counter
296
Collections
Institutional Repository
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

While affective non-verbal communication between pedestrians and drivers has been shown to improve on-road safety and driving experiences, it remains a challenge to design driver assistance systems that can automatically capture these affective cues. In this early work, we identify users' emotional self-report responses towards commonly occurring pedestrian actions while crossing a road. We conducted a crowd-sourced web-based survey (N=91), where respondents with prior driving experience viewed videos of 25 pedestrian interaction scenarios selected from the JAAD (Joint Attention for Autonomous Driving) dataset, and thereafter provided valence and arousal self-reports. We found participants' emotion self-reports (especially valence) are strongly influenced by actions including hand waving, nodding, impolite hand gestures, and inattentive pedestrian(s) crossing while engaged with a phone. Our findings provide a first step towards designing in-vehicle empathic interfaces that can assist in driver emotion regulation during on-road interactions, where the identified pedestrian actions serve as future driver emotion induction stimuli.