Time-Frequency Resolution Analysis for Continuous Human Activity Recognition using Radar Networks

Abstract

The effect of different time-frequency (TF) resolution values is analyzed in the context of Human Activity Recognition (HAR) using multiple radars distributed in a network. Specifically, different spectrograms computed with various Short-Time Fourier Transform (STFT) window lengths and Morse wavelet transform are compared as input representation to a Convolutional Neural Network (CNN), together with a coherent combination of multiple spectrograms. The study emphasizes the importance of selecting appropriate window sizes for TF analysis and for classification, balancing the observation time with the physical duration of the diverse activities, and also avoiding correlation between different data samples that may compromise the generalization ability of the method. The results employing this coherent sensor fusion demonstrate the efficacy of the investigated method, achieving an F1 score of 0.943 on a challenging public dataset containing 9 activities performed by 15 participants.