Print Email Facebook Twitter Demo Abstract: Catch My Eye Title Demo Abstract: Catch My Eye: Gaze-Based Activity Recognition in an Augmented Reality Art Gallery Author Scargill, Tim (Duke University) Lan, G. (TU Delft Embedded Systems) Gorlatova, Maria (Duke University) Contributor O'Conner, L. (editor) Date 2022 Abstract The personalization of augmented reality (AR) experiences based on environmental and user context is key to unlocking their full potential. The recent addition of eye tracking to AR headsets provides a convenient method for detecting user context, but complex analysis of raw gaze data is required to detect where a user's attention and thoughts truly lie. In this demo we present Catch My Eye, the first system to incorporate deep neural network (DNN)-based activity recognition from user gaze into a realistic mobile AR app. We develop an edge computing-based architecture to offload context computation from resource-constrained AR devices, and present a working example of content adaptation based on user context, for the scenario of a virtual art gallery. It shows that user activities can be accurately recognized and employed with sufficiently low latency for practical AR applications. Subject Augmented realityeye trackingactivity recognitionedge computingaugmented reality art gallery To reference this document use: http://resolver.tudelft.nl/uuid:18ab04c6-7d0f-49ca-9c01-cbc02e9f7f93 DOI https://doi.org/10.1109/IPSN54338.2022.00052 Publisher IEEE, Piscataway Embargo date 2023-07-01 ISBN 978-1-6654-9625-4 Source Proceedings of the 2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) Event 2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), 2022-05-04 → 2022-05-06, Milano, Italy Bibliographical note Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public. Part of collection Institutional Repository Document type conference paper Rights © 2022 Tim Scargill, G. Lan, Maria Gorlatova Files PDF Demo_Abstract_Catch_My_Ey ... allery.pdf 426.27 KB Close viewer /islandora/object/uuid:18ab04c6-7d0f-49ca-9c01-cbc02e9f7f93/datastream/OBJ/view