Individual and joint body movement assessed by wearable sensing as a predictor of attraction in speed dates

Interpersonal attraction is known to motivate behavioral responses in the person experiencing this subjective phenomenon. Such responses may involve the imitation of behavior, as in mirroring or mimicry of postures or gestures, which have been found to be associated with the desire to be liked by an interlocutor. Speed dating provides a...

Impact of Annotation Modality on Label Quality and Model Performance in the Automatic Assessment of Laughter In-the-Wild

Although laughter is known to be a multimodal signal, it is primarily annotated from audio. It is unclear how laughter labels may differ when annotated from modalities like video, which capture body movements and are relevant in in-the-wild studies. In this work we ask whether annotations of laughter are congruent across modalities, and...

Multimodal data collection for social interaction analysis in-the-wild

The benefits of exploiting multi-modality in the analysis of human-human social behaviour has been demonstrated widely in the community. An important aspect of this problem is the collection of data-sets that provide a rich and realistic representation of how people actually socialize with each other in real life. These subtle coordination...

Estimating Romantic, Social, and Sexual Attraction by Quantifying Bodily Coordination using Wearable Sensors

In this paper we introduce a novel method of estimating romantic, social and sexual attraction between two people by quantifying their bodily coordination using wearable sensors in a speed-date setting. We developed simple synchrony and convergence features, inspired from the literature and specifically adapted to be extracted from...