Multi-modal human aggression detection

Journal Article (2016)
Author(s)

Julian Kooij (Universiteit van Amsterdam)

M. C. Liem (Universiteit van Amsterdam)

J. D. Krijnders (Rijksuniversiteit Groningen)

T.C. Andringa (Rijksuniversiteit Groningen)

D.M. Gavrila (Universiteit van Amsterdam)

Affiliation
External organisation
DOI related publication
https://doi.org/10.1016/j.cviu.2015.06.009
More Info
expand_more
Publication Year
2016
Language
English
Affiliation
External organisation
Volume number
144
Pages (from-to)
106-120

Abstract

This paper presents a smart surveillance system named CASSANDRA, aimed at detecting instances of aggressive human behavior in public environments. A distinguishing aspect of CASSANDRA is the exploitation of complementary audio and video cues to disambiguate scene activity in real-life environments. From the video side, the system uses overlapping cameras to track persons in 3D and to extract features regarding the limb motion relative to the torso. From the audio side, it classifies instances of speech, screaming, singing, and kicking-object. The audio and video cues are fused with contextual cues (interaction, auxiliary objects); a Dynamic Bayesian Network (DBN) produces an estimate of the ambient aggression level. Our prototype system is validated on a realistic set of scenarios performed by professional actors at an actual train station to ensure a realistic audio and video noise setting.

No files available

Metadata only record. There are no files for this record.