Shopping in immersive virtual reality

Effects of visual, auditory, and cognitive demands on mental workload

Journal Article (2026)
Author(s)

Salvatore Luca Cucinella (TU Delft - Human-Robot Interaction, Erasmus MC)

Joost de Winter (TU Delft - Human-Robot Interaction)

Alex van den Berg (TU Delft - Human-Robot Interaction)

Bibi van den Berg (Student TU Delft)

Douwe Hoogsteen (Student TU Delft)

Daan Poutsma (Student TU Delft)

Floris van Wingerden (Student TU Delft)

Laura Marchal-Crespo (Erasmus MC, TU Delft - Human-Robot Interaction)

Research Group
Human-Robot Interaction
DOI related publication
https://doi.org/10.1016/j.apergo.2026.104781 Final published version
More Info
expand_more
Publication Year
2026
Language
English
Research Group
Human-Robot Interaction
Journal title
Applied Ergonomics
Volume number
137
Article number
104781
Downloads counter
8
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Introduction Immersive virtual reality applications are increasingly popular in entertainment, education, and professional training. While many aim for maximal realism, simplifying the virtual environment may offer benefits such as reducing mental workload and improving focus on core tasks. However, the impact of different types of demand on users’ mental workload remains unclear. Objective This study explored the impact of visual, auditory, and cognitive demands on users’ mental workload during a daily living activity in immersive virtual reality. Methods Twenty-four participants used a head-mounted display for a virtual shopping task, i.e., picking ten listed products from a shelf, under different conditions: visual demands (moving characters), auditory demands (background noise), cognitive demands (simultaneous arithmetic task), and a combination of all three. Mental workload measures included heart rate, pupil diameter, and self-reported mental demand & effort. Results The cognitively demanding secondary task induced the largest mental workload, significantly exceeding that of auditory and visual demands. For example, on a scale of 1 (low) to 10 (high), self-reported mental demand & effort was 4.40 for the moving characters, 5.00 for the background noise, 6.67 for the arithmetic task, and 7.17 for the combined condition. Biosignal differences were consistent within participants but were masked by high inter-individual variability. Conclusions In virtual shopping tasks, reducing enforced cognitive demands may be more effective for decreasing mental workload than reducing non-task-relevant visual or auditory demands.