Point Transformer-Based Human Activity Recognition Using High-Dimensional Radar Point Clouds
Zhongyuan Guo (Student TU Delft)
Ronny Gerhard Guendel (TU Delft - Microwave Sensing, Signals & Systems)
A. G. Yarovyi (TU Delft - Microwave Sensing, Signals & Systems)
Francesco Fioranelli (TU Delft - Microwave Sensing, Signals & Systems)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Radar-based Human Activity Recognition(HAR) is considered by using snapshots of point clouds. Such point cloudsinterpret 2D images generated by an mm-wave FMCW MIMO radar enriched byincluding Doppler and temporal information. We use the similarity between suchradar data representation and the core of the self-attention concept inartificial intelligence. Three self-attention models (Point Transformer) areinvestigated to classify Activities of Daily Living (ADL). An experimentaldataset collected at TU Delft is used to explore the best combination ofdifferent input features, the effect of a proposed Adaptive ClutterCancellation (ACC) method, and the robustness in a leave-one-subject-outscenario. Results with a macro F1 score in the order of 90% are demonstratedwith the proposed method, including activities that are static postures withlittle associated Doppler.