Continuous Human Activity Classification from FMCW Radar with Bi-LSTM Networks

Continuous Human Activity Classification from FMCW Radar with Bi-LSTM Networks

Shrestha, Aman (University of Glasgow)
Li, Haobo (University of Glasgow)
Kernec, Julien le (University of Glasgow)
Fioranelli, F. (TU Delft Microwave Sensing, Signals & Systems)

2020

Recognition of human movements with radar for ambient activity monitoring is a developed area of research that yet presents outstanding challenges to address. In real environments, activities and movements are performed with seamless motion, with continuous transitions between activities of different duration and a large range of dynamic motions, compared with discrete activities of fixed-time lengths which are typically analysed in the literature. This paper proposes a novel approach based on recurrent LSTM and Bi-LSTM network architectures for continuous activity monitoring and classification. This approach uses radar data in the form of a continuous temporal sequence of micro-Doppler or range-time information, differently from from other conventional approaches based on convolutional networks that interpret the radar data as images. Experimental radar data involving 15 participants and different sequences of 6 actions are used to validate the proposed approach. It is demonstrated that using the Doppler-domain data together with the Bi-LSTM network and an optimal learning rate can achieve over 90% mean accuracy, whereas range-domain data only achieved approximately 76%. The details of the network architectures, insights in their behaviour as a function of key hyper-parameters such as the learning rate, and a discussion on their performance across are provided in the paper.

FMCW radar
LSTM and Bi-LSTM networks
classification
micro-Doppler
remote activity monitoring

http://resolver.tudelft.nl/uuid:8815c632-0233-43dd-bd40-0f17e2a6f905

https://doi.org/10.1109/JSEN.2020.3006386

1530-437X

IEEE Sensors Journal, 20 (22), 13607-13619

Institutional Repository

journal article

© 2020 Aman Shrestha, Haobo Li, Julien le Kernec, F. Fioranelli