Modeling, Recognizing, and Explaining Apparent Personality from Videos

Modeling, Recognizing, and Explaining Apparent Personality from Videos

Escalante, Hugo Jair (INAOE; Cinvestav)
Kaya, Heysem (Universiteit Utrecht)
Ali Salah, Albert (Universiteit Utrecht)
Escalera, Sergio (Universitat Politecnica de Catalunya)
Güç;lütürk, Yağmur (Radboud Universiteit Nijmegen)
Güçlü, Umut (Radboud Universiteit Nijmegen)
Baro, Xavier (Universitat Politecnica de Catalunya)
Sukma Wicaksana, Achmadnoer (Student TU Delft)
Liem, C.C.S. (TU Delft Multimedia Computing)

2020

Explainability and interpretability are two critical aspects of decision support systems. Despite their importance, it is only recently that researchers are starting to explore these aspects. This paper provides an introduction to explainability and interpretability in the context of apparent personality recognition. To the best of our knowledge, this is the first effort in this direction. We describe a challenge we organized on explainability in first impressions analysis from video. We analyze in detail the newly introduced data set, evaluation protocol, proposed solutions and summarize the results of the challenge. We investigate the issue of bias in detail. Finally, derived from our study, we outline research opportunities that we foresee will be relevant in this area in the near future.

Explainable computer vision
First impressions
Personality analysis
Multimodal information
Algorithmic accountability

http://resolver.tudelft.nl/uuid:a6d297a8-efb3-40fe-a4f5-29e405800cb0

https://doi.org/10.1109/TAFFC.2020.2973984

2021-12-06

1949-3045

IEEE Transactions on Affective Computing, 13 (2), 894-911

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Institutional Repository

journal article

© 2020 Hugo Jair Escalante, Heysem Kaya, Albert Ali Salah, Sergio Escalera, Yağmur Güç;lütürk, Umut Güçlü, Xavier Baro, Achmadnoer Sukma Wicaksana, C.C.S. Liem, More Authors