Julien Le Kernec
Please Note
27 records found
1
Guest Editorial
Advances in AI-assisted radar sensing applications
The Human Activity Radar Challenge
Benchmarking based on the ‘Radar signatures of human activities’ dataset from Glasgow University
Radar systems are increasingly being employed in healthcare applications for human activity recognition due to their advantages in terms of privacy, contactless sensing, and insensitivity to lighting conditions. The proposed classification algorithms are however often complex, focusing on a single domain of radar, and requiring significant computational resources that prevent their deployment in embedded platforms which often have limited memory and computational resources. To address this issue, we present an adaptive magnitude thresholding approach for highlighting the region of interest in the multi-domain micro-Doppler signatures. The region of interest is beneficial to extract salient features, meanwhile it ensures the simplicity of calculations with less computational cost. The results for the proposed approach show an accuracy of up to 93.1% for six activities, outperforming state-of-the-art deep learning methods on the same dataset with an over tenfold reduction in both training time and memory footprint, and a twofold reduction in inference time compared to a series of deep learning implementations. These results can help bridge the gap toward embedded platform deployment.
Radar is now widely used in human activity classification because of its contactless sensing capabilities, robustness to light conditions and privacy preservation compared to plain optical images. It has great value in elderly care, monitoring accidental falls and abnormal behaviours. Monostatic radar suffers from degradation in performance with varying aspect angles with respect to the target. Bistatic radar may offer a solution to this problem but finding the right geometry can be quite resource-intensive. We propose a bespoke simulation framework to test the radar geometry for human activity recognition. First, the analysis focuses on the monostatic radar model based on the Doppler effect in radar. We analyse the spectrogram of different motions by Short-time Fourier analysis (STFT), and then the classification data set was built for feature extraction and classification. The results show that the monostatic radar system has the highest accuracy, up to 98.17%. So, a bistatic radar model with separate transmitter and receiver was established in the experiment, and results show that bistatic radar with specific geometry configuration (CB2.5) not only has higher classification accuracy than monostatic radar in each aspect angle but also can recognise the object in a wider angle range. After training and fusing the data of all angles, it is found that the accuracy, sensitivity, and specificities of CB2.5 have 2.2%, 7.7% and 1.5% improvement compared with monostatic radar.
Radar has long been considered an important technology for indoor monitoring and assisted living. As ageing has become a worldwide problem, it causes a huge burden on the government’s healthcare expenses and infrastructure. Radar-based human activity recognition (HAR) is foreseen to become a widespread sensing modality for health monitoring at home. Conventional radar-based HAR task usually adopts the amplitude of spectrograms as input to a convolutional neural network (CNN), which can limit the achieved performances. A hybrid fusion model is here proposed, which can integrate multiple radar data domains. The result shows that the proposed framework can achieve superior classification accuracy of 92.1% (+2.5% higher than conventional CNN) and a lighter computational load than the state-of-the-art techniques with 3D-CNN.
Population ageing has become a severe problem worldwide. Human activity recognition (HAR) can play an important role to provide the elders with in-time healthcare. With the advantages of environmental insensitivity, contactless sensing and privacy protection, radar has been widely used for human activity detection. The micro-Doppler signatures (spectrograms) contain much information about human motion and are often applied in HAR. However, spectrograms only interpret magnitude information, resulting in suboptimal performances. We propose a radar-based HAR system using deep learning techniques. The data applied came from the open dataset “Radar signatures of human activities” created by the University of Glasgow. A new type of hybrid map was proposed, which concatenated the spectrograms amplitude and phase. After cropping the hybrid maps to focus on useful information, a convolutional neural network (CNN) based on LeNet-5 was designed for feature extraction and classification. In addition, the idea of transfer learning was applied for radar-based HAR to evaluate the classification performance of a pre-trained network. For this, GoogLeNet was taken and trained on the newly-produced hybrid maps. These initial results showed that the LeNet-5 CNN using only the spectrograms obtained an accuracy of 80.5%, while using the hybrid maps reached an accuracy of 84.3%, increasing by 3.8%. The classification result of transfer learning using GoogLeNet was 86.0%.
Human Activity Classification with radar has made significant progress in the past few years. In this article, we propose a cyclostationarity-based approach in this field of application. Feature extraction, selection, and activity classification as it detects micro-Doppler is made starting from complex-valued cyclostationary statistical functions of the reflected radar signal. The human activity can be recognized with up to 92.6% with the real part, 95.4% with the imaginary part and 95.4% by the combination of real and imaginary part.
The latest progress of the multiple-input multiple-output (MIMO) radar system developed for small drones detection at Beijing Institute of Technology is presented herein. A low-cost S-band MIMO scanning radar system is designed for the detection of small drones. A practical design optimisation and implementation of a sparse array covering the whole airspace, and a target-based MIMO radar array calibration method to improve the signal-to-noise ratio of the target are proposed. An experiment in the microwave chamber was conducted to verify the designed sparse-array beam-pattern, and measurement campaigns for small drones were performed to test the system performance where the radar achieved detection and tracking of a small DJI-Phantom 4 drone at a range of up to 5 km. Target features, including micro-Doppler and radar cross-section signatures were extracted to assist target classification. The experimental results indicate that the system has promising capability in small drones detection and tracking, despite the challenges of low dwell time on targets due to the scanning nature of the system.
Radar systems are increasingly being used for healthcare applications for human activity recognition due to their advantages for privacy compliance, contactless sensing, and insensitivity to lighting conditions. The proposed classification algorithms are often very complex, hence requiring significant computational resources. We propose an adaptive thresholding algorithm used as a 'mask' to highlight the region of interest from the micro-Doppler signature. The mask is then applied to spectrogram information. These masked signatures are used for handcrafted feature extraction and classification. A quadratic-SVM classifier is employed based on the features from the information acquired. The preliminary results show that an accuracy of 91.3% is achieved using sequential forward feature selection with feature fusion. Based on our initial result, a Naïve Bayes combiner is used to improve the overall performance further. With this strategy, the accuracy of classification reaches 92.5% for six activities. Additionally, we compare our findings to those of other models utilizing the same database. The results demonstrate that high accuracy can be achieved when adaptive thresholding is used with the SVM method, and computational resources may significantly decrease.
Radar sensing for human healthcare
Challenges and results
Radar micro-Doppler signatures have been proposed for human monitoring and activity classification for surveillance and outdoor security, as well as for ambient assisted living in healthcare-related applications. A known issue is the performance reduction when the target is moving tangentially to the line of sight of the radar. Multiple techniques have been proposed to address this, such as multistatic radar and to some extent, interferometric (IF) radar. A simulator is presented to generate synthetic data representative of eight radar systems (monostatic, circular multistatic and in-line multistatic [IM] and IF) to quantify classification performances as a function of aspect angles and deployment geometries. This simulator allows an unbiased performance evaluation of different radar systems. Six human activities are considered with signatures originating from motion-captured data of 14 different subjects. The classification performances are analysed as a function of aspect angles ranging from 0° to 90° per activity and overall. It demonstrates that IF configurations are more robust than IM configurations. However, IM performs better at angles below 55° before IF configurations take over.
Radar micro-Doppler signatures have been proposed for human activity classification for surveillance and ambient assisted living in healthcare-related applications. A known issue is the performance reduction when the target is moving tangentially to the line-of-sight of the radar. Multiple techniques have been proposed to address this, such as multistatic radar and to some extent, interferometric radar. A simulator is presented to generate synthetic data representative of 8 different radar systems (including configurations as monostatic, multistatic, and interferometric) to quantify classification performances as a function of aspect angles and deployment geometries. This simulator allows an unbiased performance evaluation of the different radar systems. 6 human activities are considered with signatures originating from motion-captured data of 14 different subjects. The results show that interferometric radar data with fusion outperforms the other methods with over 97.6% accuracy consistently across all aspect angles, as well as the potential for simplified indoor deployment.
In human activity recognition (HAR) based on radar, significant research exists on statistical features extracted from the spectrogram (μD), whereas the research which considers other domains is less developed. This paper is aimed to investigate three domains of radar data: μD, Cadence Velocity Diagram (CVD), and range-time (RT) information, evaluating which ones are best suited to classify specific activities. In addition, information fusion is applied to enhance classification accuracy and compare it with the results of single domain approach. Based on the previous results, a hierarchical structure is proposed to improve the performance of classification further. The preliminary results show that different domains have distinctive sensitivity to specific activities. RT information is sensitive to the moving target crossing range bins, while CVD is more sensitive to body movement. The μD is more balanced, which means it can observe both moving targets and body movements. Furthermore, improvement in accuracy is approximately 6-23 % using feature-level fusion. A hierarchical classification approach is also investigated, which has accuracy in the order of approximately 92 %.
Elderly Care
Using Deep Learning for Multi-Domain Activity Classification