Modeling, Recognizing, and Explaining Apparent Personality from Videos

Journal Article (2020)
Author(s)

Hugo Jair Escalante (INAOE, Cinvestav)

Heysem Kaya (Universiteit Utrecht)

Albert Ali Salah (Universiteit Utrecht)

Sergio Escalera (Universitat Politecnica de Catalunya)

Yağmur Güç;lütürk (Radboud Universiteit Nijmegen)

Umut Güçlü (Radboud Universiteit Nijmegen)

Xavier Baro (Universitat Politecnica de Catalunya)

Achmadnoer Sukma Wicaksana (Student TU Delft)

Cynthia C.S. Liem (TU Delft - Multimedia Computing)

undefined More Authors (External organisation)

Research Group
Multimedia Computing
DOI related publication
https://doi.org/10.1109/TAFFC.2020.2973984
More Info
expand_more
Publication Year
2020
Language
English
Research Group
Multimedia Computing
Bibliographical Note
Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
Journal title
IEEE Transactions on Affective Computing
Issue number
2
Volume number
13
Pages (from-to)
894-911
Downloads counter
370
Collections
Institutional Repository
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Explainability and interpretability are two critical aspects of decision support systems. Despite their importance, it is only recently that researchers are starting to explore these aspects. This paper provides an introduction to explainability and interpretability in the context of apparent personality recognition. To the best of our knowledge, this is the first effort in this direction. We describe a challenge we organized on explainability in first impressions analysis from video. We analyze in detail the newly introduced data set, evaluation protocol, proposed solutions and summarize the results of the challenge. We investigate the issue of bias in detail. Finally, derived from our study, we outline research opportunities that we foresee will be relevant in this area in the near future.

Files

Modeling_Recognizing_and_Expla... (pdf)
(pdf | 5.49 Mb)
- Embargo expired in 06-12-2021
License info not available