Title
Demo Abstract: Catch My Eye: Gaze-Based Activity Recognition in an Augmented Reality Art Gallery
Author
Scargill, Tim (Duke University)
Lan, G. (TU Delft Embedded Systems)
Gorlatova, Maria (Duke University)
Contributor
O'Conner, L. (editor)
Date
2022
Abstract
The personalization of augmented reality (AR) experiences based on environmental and user context is key to unlocking their full potential. The recent addition of eye tracking to AR headsets provides a convenient method for detecting user context, but complex analysis of raw gaze data is required to detect where a user's attention and thoughts truly lie. In this demo we present Catch My Eye, the first system to incorporate deep neural network (DNN)-based activity recognition from user gaze into a realistic mobile AR app. We develop an edge computing-based architecture to offload context computation from resource-constrained AR devices, and present a working example of content adaptation based on user context, for the scenario of a virtual art gallery. It shows that user activities can be accurately recognized and employed with sufficiently low latency for practical AR applications.
Subject
Augmented reality
eye tracking
activity recognition
edge computing
augmented reality art gallery
To reference this document use:
http://resolver.tudelft.nl/uuid:18ab04c6-7d0f-49ca-9c01-cbc02e9f7f93
DOI
https://doi.org/10.1109/IPSN54338.2022.00052
Publisher
IEEE, Piscataway
Embargo date
2023-07-01
ISBN
978-1-6654-9625-4
Source
Proceedings of the 2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN)
Event
2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), 2022-05-04 → 2022-05-06, Milano, Italy
Bibliographical note
Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
Part of collection
Institutional Repository
Document type
conference paper
Rights
© 2022 Tim Scargill, G. Lan, Maria Gorlatova