Print Email Facebook Twitter Exploring Personal Memories and Video Content as Context for Facial Behavior in Predictions of Video-Induced Emotions Title Exploring Personal Memories and Video Content as Context for Facial Behavior in Predictions of Video-Induced Emotions Author Dudzik, B.J.W. (TU Delft Interactive Intelligence) Broekens, D.J. (Universiteit Leiden) Neerincx, M.A. (TU Delft Interactive Intelligence) Hung, H.S. (TU Delft Pattern Recognition and Bioinformatics) Date 2020 Abstract Empirical evidence suggests that the emotional meaning of facial behavior in isolation is often ambiguous in real-world conditions. While humans complement interpretations of others' faces with additional reasoning about context, automated approaches rarely display such context-sensitivity. Empirical findings indicate that the personal memories triggered by videos are crucial for predicting viewers' emotional response to such videos ?- in some cases, even more so than the video's audiovisual content. In this article, we explore the benefits of personal memories as context for facial behavior analysis. We conduct a series of multimodal machine learning experiments combining the automatic analysis of video-viewers' faces with that of two types of context information for affective predictions: \beginenumerate∗[label=(\arabic∗)] \item self-reported free-text descriptions of triggered memories and \item a video's audiovisual content \endenumerate∗. Our results demonstrate that both sources of context provide models with information about variation in viewers' affective responses that complement facial analysis and each other. Subject affect detectioncontext-awarenessemotion recognition To reference this document use: http://resolver.tudelft.nl/uuid:f3958d8a-d70b-4d57-a1fc-7f84434a11ad DOI https://doi.org/10.1145/3382507.3418814 Publisher Association for Computing Machinery (ACM), New York Embargo date 2022-04-08 ISBN 978-1-4503-7581-8 Source ICMI 2020 - Proceedings of the 2020 International Conference on Multimodal Interaction Event 22nd ACM International Conference on Multimodal Interaction, ICMI 2020, 2020-10-25 → 2020-10-29, Virtual, Online, , Netherlands Bibliographical note Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public. Part of collection Institutional Repository Document type conference paper Rights © 2020 B.J.W. Dudzik, D.J. Broekens, M.A. Neerincx, H.S. Hung Files PDF 3382507.3418814.pdf 1.11 MB Close viewer /islandora/object/uuid:f3958d8a-d70b-4d57-a1fc-7f84434a11ad/datastream/OBJ/view