A VR and AI-Powered Game-Based Approach to Minimally-Invasive Social Cognitive Assessment
Caspar Krijgsman (TU Delft - Codesigning Social Change)
Jackie Poos (Erasmus MC)
Rafael Bidarra (TU Delft - Computer Graphics and Visualisation)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Frontotemporal dementia (FTD) is the second most common cause of young-onset dementia and is typically caused by frontal and/or temporal lobe degeneration [1]. This degeneration impacts personality, judgment, and the ability to recognize emotion. Early diagnosis of FTD is critical for effective treatment, but current diagnostic tools often lack the realism necessary to assess social cognitive abilities like emotion recognition and theory of mind. We propose the customization of an immersive virtual reality (VR) experience to improve early FTD diagnosis by creating realistic social interactions in immersive environments. Our approach is two-fold: (i) an authoring tool that gives neuropsychologists generative AI support for writing a suitable dialog involving faux pas, picking characters and voicing them; (ii) a VR game in which patients observe the enactment of those scripted social scenarios, guided by a virtual companion. We discuss the main features of our current prototype, and identify some development and evaluation challenges ahead.
Files
File under embargo until 23-02-2026