Print Email Facebook Twitter Distributed Radar-based Human Activity Recognition using Vision Transformer and CNNs Title Distributed Radar-based Human Activity Recognition using Vision Transformer and CNNs Author Zhao, Yubin (Student TU Delft) Guendel, Ronny (TU Delft Microwave Sensing, Signals & Systems) Yarovoy, Alexander (TU Delft Microwave Sensing, Signals & Systems) Fioranelli, F. (TU Delft Microwave Sensing, Signals & Systems) Date 2022 Abstract The feasibility of classifying human activities measured by a distributed ultra-wideband (UWB) radar system using Range-Doppler (RD) images as the input to classifiers is investigated. Kinematic characteristics of different human activities are expected to be captured in high-resolution range-Doppler images measured by UWB radars. To construct the dataset, 5 distributed monostatic Humatics P410 radars are used to record 15 participants performing 9 activities in arbitrary directions along a designated trajectory. For the first time a convolution-free neural network based on the novel multi-head attention mechanism (the Vision Transformer architecture) is adopted as the classifier, attaining an accuracy of 76.5 %. A comparison between Vision Transformer and more conventional CNN-based architectures, such as ResNet and AlexNet, is also conducted. The robustness of Vision Transformer and the other networks against unseen participants is also validated by testing via Leave One Participant Out validation. To reference this document use: http://resolver.tudelft.nl/uuid:952d4345-19c2-499f-b919-9000116a0db7 DOI https://doi.org/10.23919/EuRAD50154.2022.9784575 Publisher IEEE Embargo date 2022-12-02 ISBN 978-1-6654-4723-2 Source Proceedings of the 18th European Radar Conference Event The 18th European Radar Conference, 2022-04-05 → 2022-04-07, London, United Kingdom Bibliographical note Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public. Part of collection Institutional Repository Document type conference paper Rights © 2022 Yubin Zhao, Ronny Guendel, Alexander Yarovoy, F. Fioranelli Files PDF Distributed_Radar_based_H ... d_CNNs.pdf 1.32 MB Close viewer /islandora/object/uuid:952d4345-19c2-499f-b919-9000116a0db7/datastream/OBJ/view