Supporting Children’s Metacognition with a Facial Emotion Recognition based Intelligent Tutor System

Conference paper (2023)

Authors

Xingran Ruan The University of Edinburgh
Charaka Palansuriya The University of Edinburgh
Aurora Constantin The University of Edinburgh
K. Tsiakas Human Information Communication Design - IDE
Research Group
Human Information Communication Design (IDE) (TU Delft)
Copyright: © 2023 Xingran Ruan, Charaka Palansuriya, Aurora Constantin, K. Tsiakas
DOI
help_outline
https://doi.org/10.1145/3585088.3593882
Facial emotion recognition Learning outcomes Intelligent tutor system Metacognitive monitoring process
More Info
expand_more

Published Date

2023

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Industrial Design Engineering

Department

Human-Centered Design

Research Group

Human Information Communication Design

Abstract

The present study aims to investigate the relationship between emotions experienced during learning and metacognition in typically developing (TD) children and those with autism spectrum disorder (ASD). This will assist us in using machine learning (ML) to develop a facial emotion recognition (FER) based intelligent tutor system (ITS) to support children’s metacognitive monitoring process in order to enhance their learning outcomes. In this paper, we first report the results of our preliminary research, which utilized an ML-based FER algorithm to detect four spontaneous epistemic emotions (i.e., neutral, confused, frustrated, and boredom) and six spontaneous basic emotions (i.e., anger, disgust, fear, happiness, sadness, and surprise). Subsequently, we adapted an application (‘BrainHood’) to create the ‘Meta-BrainHood’, that embedded our proposed ML-based FER algorithm to examine the relationship between facial emotion expressions and metacognitive monitoring performance in TD children and those with ASD. Finally, we outline the future steps in our research, which adopts the outcomes of the first two steps to construct an ITS to improve children’s metacognitive monitoring performance and learning outcomes.