ThermalWear

Exploring Wearable On-chest Thermal Displays to Augment Voice Messages with Affect

Conference Paper (2020)
Author(s)

Abdallah El Ali (Centrum Wiskunde & Informatica (CWI))

Xingyu Yang (Student TU Delft)

Swamy Ananthanarayan (University of Oldenburg)

Thomas Röggla (Centrum Wiskunde & Informatica (CWI))

Jack Jansen (Centrum Wiskunde & Informatica (CWI))

Jess Hartcher-O'brien (TU Delft - Human Factors)

Kaspar Jansen (TU Delft - Materializing Futures, Centrum Wiskunde & Informatica (CWI))

Pablo Cesar (Centrum Wiskunde & Informatica (CWI), Multimedia Computing)

Research Group
Human Factors
DOI related publication
https://doi.org/10.1145/3313831.3376682 Final published version
More Info
expand_more
Publication Year
2020
Language
English
Research Group
Human Factors
Article number
3376682
ISBN (electronic)
9781450367080
Event
2020 ACM CHI Conference on Human Factors in Computing Systems, CHI 2020 (2020-04-25 - 2020-04-30), Honolulu, United States
Downloads counter
258

Abstract

Voice is a rich modality for conveying emotions, however emotional prosody production can be situationally or medically impaired. Since thermal displays have been shown to evoke emotions, we explore how thermal stimulation can augment perception of neutrally-spoken voice messages with affect. We designed ThermalWear, a wearable on-chest thermal display, then tested in a controlled study (N=12) the effects of fabric, thermal intensity, and direction of change. Thereafter, we synthesized 12 neutrally-spoken voice messages, validated (N=7) them, then tested (N=12) if thermal stimuli can augment their perception with affect. We found warm and cool stimuli (a) can be perceived on the chest, and quickly without fabric (4.7-5s) (b) do not incur discomfort (c) generally increase arousal of voice messages and (d) increase / decrease message valence, respectively. We discuss how thermal displays can augment voice perception, which can enhance voice assistants and support individuals with emotional prosody impairments.