Supporting Children’s Metacognition with a Facial Emotion Recognition based Intelligent Tutor System

Conference Paper (2023)
Author(s)

Xingran Ruan (The University of Edinburgh)

Charaka Palansuriya (The University of Edinburgh)

Aurora Constantin (The University of Edinburgh)

K. Tsiakas (TU Delft - Human Technology Relations)

Research Group
Human Technology Relations
Copyright
© 2023 Xingran Ruan, Charaka Palansuriya, Aurora Constantin, K. Tsiakas
DOI related publication
https://doi.org/10.1145/3585088.3593882
More Info
expand_more
Publication Year
2023
Language
English
Copyright
© 2023 Xingran Ruan, Charaka Palansuriya, Aurora Constantin, K. Tsiakas
Research Group
Human Technology Relations
Pages (from-to)
502-506
ISBN (print)
979-8-4007-0131-3
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

The present study aims to investigate the relationship between emotions experienced during learning and metacognition in typically developing (TD) children and those with autism spectrum disorder (ASD). This will assist us in using machine learning (ML) to develop a facial emotion recognition (FER) based intelligent tutor system (ITS) to support children’s metacognitive monitoring process in order to enhance their learning outcomes. In this paper, we first report the results of our preliminary research, which utilized an ML-based FER algorithm to detect four spontaneous epistemic emotions (i.e., neutral, confused, frustrated, and boredom) and six spontaneous basic emotions (i.e., anger, disgust, fear, happiness, sadness, and surprise). Subsequently, we adapted an application (‘BrainHood’) to create the ‘Meta-BrainHood’, that embedded our proposed ML-based FER algorithm to examine the relationship between facial emotion expressions and metacognitive monitoring performance in TD children and those with ASD. Finally, we outline the future steps in our research, which adopts the outcomes of the first two steps to construct an ITS to improve children’s metacognitive monitoring performance and learning outcomes.

Files

3585088.3593882.pdf
(pdf | 1.25 Mb)
- Embargo expired in 19-12-2023
License info not available