Title
Social Signals and Multimedia: Past, Present, Future
Author
Hung, H.S. (TU Delft Pattern Recognition and Bioinformatics) 
Gurrin, Cathal (Dublin City University)
Larson, M.A. (Radboud Universiteit Nijmegen)
Gunes, Hatice (University of Cambridge)
Ringeval, Fabien (Université Grenoble Alpes)
Andre, Elisabeth (Universität Augsburg)
Morency, Louis-Philippe (Carnegie Mellon University)
Date
2021
Abstract
The rising popularity of Artificial Intelligence (AI) has brought considerable public interest as well faster and more direct transfer of research ideas into practice. One of the aspects of AI that still trails behind considerably is the role of machines in interpreting, enhancing, modeling, generating, and influencing social behavior. Such behavior is captured as social signals, usually by sensors recording multiple modalities, making it classic multimedia data. Such behavior can also be generated by an AI system when interacting with humans. Using AI techniques in combination with multimedia data can be used to pursue multiple goals, two of which are high-lighted here. First, supporting people during social interactions and helping them to fulfil their social needs either actively or passively.Second, improving our understanding of how people collaborate, build relationships, and process self identity. Despite the rise of fields such as Social Signal Processing, a similar panel organised at ACM Multimedia 2014, and an area on social and emotional signal sat the ACM MM since 2014, we argue that we have yet to truly fulfil the potential of the combining social signals and multimedia. This panel asks where we have come far enough and what remaining challenges there are in light of recent global events.
Subject
artificial intelligence
human social behavior
multi-modal machine learning
multimedia
social signal processing
To reference this document use:
http://resolver.tudelft.nl/uuid:b56b5cda-5539-4b86-9392-7018e9419424
DOI
https://doi.org/10.1145/3474085.3480024
Publisher
Association for Computing Machinery (ACM), New York
Embargo date
2022-04-08
ISBN
978-1-4503-8651-7
Source
MM 2021: Proceedings of the 29th ACM International Conference on Multimedia
Event
29th ACM International Conference on Multimedia, MM 2021, 2021-10-20 → 2021-10-24, Virtual, Online, China
Bibliographical note
Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.
Part of collection
Institutional Repository
Document type
conference paper
Rights
© 2021 H.S. Hung, Cathal Gurrin, M.A. Larson, Hatice Gunes, Fabien Ringeval, Elisabeth Andre, Louis-Philippe Morency