Complex conversational scene analysis using wearable sensors

Book Chapter (2019)
Author(s)

H.S. Hung (Centrum Wiskunde & Informatica (CWI), TU Delft - Pattern Recognition and Bioinformatics)

E. Gedik (TU Delft - Pattern Recognition and Bioinformatics)

Laura Cabrera-Quiros (TU Delft - Pattern Recognition and Bioinformatics, Instituto Tecnologico de Costa Rica)

Research Group
Pattern Recognition and Bioinformatics
Copyright
© 2019 H.S. Hung, E. Gedik, L.C. Cabrera Quiros
DOI related publication
https://doi.org/10.1016/B978-0-12-814601-9.00019-5
More Info
expand_more
Publication Year
2019
Language
English
Copyright
© 2019 H.S. Hung, E. Gedik, L.C. Cabrera Quiros
Research Group
Pattern Recognition and Bioinformatics
Pages (from-to)
225-245
ISBN (print)
978-0-12-814601-9
ISBN (electronic)
9780128146026
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

When aspiring to achieve 'in the wild' behavior analysis, we come across a number of conceptual and practical issues. In this chapter, we focus primarily on describing the data collection process for the automated analysis of human social behavior. Specifically, we address the task of analyzing social interaction during conversations. Most research in this area has focused largely on seated scenarios such as a small group having a meeting. In this chapter, we address the challenges that are faced when analyzing complex conversational scenes; crowded social settings where mingling occurs such as networking events, cocktail parties or conferences.We discuss and provide definitions of what 'in the wild' means for the context of wearable sensors. We provide a case study detailing different concerns that can emerge as a result of 'in the wild' social behavior analysis. More concretely, we address this in terms of how the concept of ecological validity coming from experimental psychology links with the concept of 'in the wild', practical and conceptual issues related to data collection, and finally how this influences social behavior analysis.Importantly in the presentation of the behavior analysis, we address key questions when an entire dataset is recorded from continuous natural behavior 'in the wild': When do we have enough data? Do we need a different machine learning approach for different amounts of data? Are social behaviors (e.g. speaking) more difficult to characterize than activities (e.g. walking/stepping) when the setting is so uncontrolled? We try to answer this question by considering the extent to which the nature of this problem becomes more personalized or person-independent as the size of the dataset increases.

Files

3_s2.0_B9780128146019000195_ma... (pdf)
(pdf | 0.881 Mb)
- Embargo expired in 08-04-2022
License info not available