Towards Attention-aware Foveated Rendering

Journal Article (2023)
Author(s)

Brooke Krajancich (Stanford University)

Petr Kellnhofer (TU Delft - Computer Graphics and Visualisation)

Gordon Wetzstein (Stanford University)

Research Group
Computer Graphics and Visualisation
Copyright
© 2023 Brooke Krajancich, P. Kellnhofer, Gordon Wetzstein
DOI related publication
https://doi.org/10.1145/3592406
More Info
expand_more
Publication Year
2023
Language
English
Copyright
© 2023 Brooke Krajancich, P. Kellnhofer, Gordon Wetzstein
Research Group
Computer Graphics and Visualisation
Issue number
4
Volume number
42
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Foveated graphics is a promising approach to solving the bandwidth challenges of immersive virtual and augmented reality displays by exploiting the falloff in spatial acuity in the periphery of the visual field. However, the perceptual models used in these applications neglect the effects of higherlevel cognitive processing, namely the allocation of visual attention, and are thus overestimating sensitivity in the periphery in many scenarios. Here, we introduce the first attention-aware model of contrast sensitivity. We conduct user studies to measure contrast sensitivity under different attention distributions and show that sensitivity in the periphery drops significantly when the user is required to allocate attention to the fovea. We motivate the development of future foveation models with another user study and demonstrate that tolerance for foveation in the periphery is significantly higher when the user is concentrating on a task in the fovea. Analysis of our model predicts significant bandwidth savings over those afforded by current models. As such, our work forms the foundation for attention-aware foveated graphics techniques.

Files

3592406.pdf
(pdf | 6.07 Mb)
- Embargo expired in 08-01-2024
License info not available