Point Transformer-Based Human Activity Recognition Using High-Dimensional Radar Point Clouds

Conference paper (2023)

Authors

Zhongyuan Guo Student
Ronny Guendel Microwave Sensing, Signals & Systems - EEMCS
Alexander Yarovoy Microwave Sensing, Signals & Systems - EEMCS
F. Fioranelli Microwave Sensing, Signals & Systems - EEMCS
Research Group
Microwave Sensing, Signals & Systems (EEMCS) (TU Delft)
Copyright: © 2023 Zhongyuan Guo, Ronny Guendel, Alexander Yarovoy, F. Fioranelli
DOI: https://doi.org/10.1109/RadarConf2351548.2023.10149679
Deep Learning Human Activity Recognition Point Transformer Imaging Radar Activities of Daily Living
More Info
expand_more

Published Date

2023

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Department

Microelectronics

Research Group

Microwave Sensing, Signals & Systems

Abstract

Radar-based Human Activity Recognition(HAR) is considered by using snapshots of point clouds. Such point cloudsinterpret 2D images generated by an mm-wave FMCW MIMO radar enriched byincluding Doppler and temporal information. We use the similarity between suchradar data representation and the core of the self-attention concept inartificial intelligence. Three self-attention models (Point Transformer) areinvestigated to classify Activities of Daily Living (ADL). An experimentaldataset collected at TU Delft is used to explore the best combination ofdifferent input features, the effect of a proposed Adaptive ClutterCancellation (ACC) method, and the robustness in a leave-one-subject-outscenario. Results with a macro F1 score in the order of 90% are demonstratedwith the proposed method, including activities that are static postures withlittle associated Doppler.