Personalized Gesture Range Detection Using Transductive Parameter Transfer
Rethinking Ubiquitous Smart Sensing of Social Behaviour In The Wild
K. Nam (TU Delft - Electrical Engineering, Mathematics and Computer Science)
HS Hung – Mentor (TU Delft - Pattern Recognition and Bioinformatics)
S. Tan – Mentor (TU Delft - Interactive Intelligence)
V.K.P. Dsouza – Mentor (TU Delft - Embedded Systems)
K.G. Langendoen – Mentor (TU Delft - Embedded Systems)
Q. Song – Graduation committee member (TU Delft - Embedded Systems)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
This research investigates the detection of gestures using a torso-worn accelerometer sensor. Using the Conflab dataset, we focus on gestures during conversations in mingling scenarios. Due to significant variability in gesture styles among individuals, traditional methods face challenges in building personalized models. Our experiments demonstrate that Transductive Parameter Transfer (TPT), an adaptive transfer learning method, can more effectively model these individual differences in gesturing. To gain insights into individual expressiveness, we classify gestures into three classes: 'no gesture,' 'normal,' and 'large' gestures. TPT performed an average AUC score of 0.84 in binary classification and 0.77 in multiclass classification. These findings highlight the potential of using a single torso-worn accelerometer to understand social behavior in naturalistic settings.