Anomaly Detection in Human Motion: Learning a Shared Direction of Abnormality
M. Girish Nair (TU Delft - Electrical Engineering, Mathematics and Computer Science)
X. Zhang – Mentor (TU Delft - Electrical Engineering, Mathematics and Computer Science)
T.C. Markhorst – Mentor (TU Delft - Electrical Engineering, Mathematics and Computer Science)
O.S. Kayhan – Mentor (TU Delft - Electrical Engineering, Mathematics and Computer Science)
M. Weinmann – Graduation committee member (TU Delft - Electrical Engineering, Mathematics and Computer Science)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Style-based anomaly detection occurs when an action is performed in an abnormal manner. In this paper, we investigate how anomaly detection models generalize when actors, actions or anomaly styles are unseen during training, a setting that is not directly covered by existing benchmarks. To address this, we propose a shared anomaly direction model based on MotionCLIP. The model learns a direction in the motion embedding space that separates normal and anomalous executions and can transfer across different anomaly styles. The model is evaluated on the PersonaMotion dataset using splits with unseen actors, actions and styles. It achieves the highest mean AUROC across the evaluated settings, with particularly strong performance on unseen actors and actions. However, the performance decreases when more anomaly styles are withheld during training. This suggests that a transferable shared anomaly component can be learned, although style-specific variation still remains.