Face the Truth

Interpretable Emotion Genuineness Detection

Conference paper (2022)

Authors

Matteo Cardaioli Università degli Studi di Padova, GFT Italy
Alessio Miolla Università degli Studi di Padova
M. Conti Università degli Studi di Padova
Giuseppe Sartori Università degli Studi di Padova
Merylin Monaro Università degli Studi di Padova
Cristina Scarpazza Università degli Studi di Padova
Nicolo Navarin Università degli Studi di Padova
Affiliation
External organisation
Affective Computing Supervised Learning Emotional Computation Explainable ML Applications
More Info
expand_more

Published Date

2022

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Affiliation

External organisation

Abstract

The identification of emotions conveyed by faces as genuine or not is a topic under-explored. While some controversial insights are available for happiness (where genuine happiness is supposed to create crow's feet around the eyes), nothing is known regarding other emotions. This topic is important as human beings are known to perform around the chance level to identify genuine emotions. It is thus pivotal to identify the relevant features for the correct identification of a facial emotion as genuine. To this aim, we capitalized on explainable artificial intelligence (XAI), characterized by a superior ability to detect subtle patterns in the data. Two different XAI models were created and applied to a dataset including 50 participants displaying both genuine and not genuine emotions. Results revealed that ML models achieved high accuracies in genuineness discrimination (78 % of average) while being robust and interpretable. The robustness of the results, ensured by their stability across different models and experimental conditions, is critical to improving the generalizability of the results. Our XAI algorithms provided interpretable results as they correctly identified facial muscle movements that are critical for the classification of emotions as genuine or fake.