JL

Julien Le Kernec

info

Please Note

27 records found

Advances in AI-assisted radar sensing applications

Journal article (2024) - Shelly Vishwakarma, Kevin Chetty, Julien Le Kernec, Qingchao Chen, Raviraj Adve, Sevgi Zubeyde Gurbuz, Wenda Li, Shobha Sundar Ram, Francesco Fioranelli

Benchmarking based on the ‘Radar signatures of human activities’ dataset from Glasgow University

Journal article (2023) - Shufan Yang, Julien Le Kernec, Olivier Romain, Francesco Fioranelli, Pierre Cadart, Jeremy Fix, Chengfang Ren, Giovanni Manfredi, Thierry Letertre, More Authors...
Journal article (2023) - Zhenghui Li, Julien Le Kernec, Qammer Abbasi, Francesco Fioranelli, Shufan Yang, Olivier Romain
Radar systems are increasingly being employed in healthcare applications for human activity recognition due to their advantages in terms of privacy, contactless sensing, and insensitivity to lighting conditions. The proposed classification algorithms are however often complex, focusing on a single domain of radar, and requiring significant computational resources that prevent their deployment in embedded platforms which often have limited memory and computational resources. To address this issue, we present an adaptive magnitude thresholding approach for highlighting the region of interest in the multi-domain micro-Doppler signatures. The region of interest is beneficial to extract salient features, meanwhile it ensures the simplicity of calculations with less computational cost. The results for the proposed approach show an accuracy of up to 93.1% for six activities, outperforming state-of-the-art deep learning methods on the same dataset with an over tenfold reduction in both training time and memory footprint, and a twofold reduction in inference time compared to a series of deep learning implementations. These results can help bridge the gap toward embedded platform deployment. ...
Conference paper (2022) - Kai Yang, Qammer H. Abbasi, Francesco Fioranelli, Olivier Romain, Julien Le Kernec
Radar is now widely used in human activity classification because of its contactless sensing capabilities, robustness to light conditions and privacy preservation compared to plain optical images. It has great value in elderly care, monitoring accidental falls and abnormal behaviours. Monostatic radar suffers from degradation in performance with varying aspect angles with respect to the target. Bistatic radar may offer a solution to this problem but finding the right geometry can be quite resource-intensive. We propose a bespoke simulation framework to test the radar geometry for human activity recognition. First, the analysis focuses on the monostatic radar model based on the Doppler effect in radar. We analyse the spectrogram of different motions by Short-time Fourier analysis (STFT), and then the classification data set was built for feature extraction and classification. The results show that the monostatic radar system has the highest accuracy, up to 98.17%. So, a bistatic radar model with separate transmitter and receiver was established in the experiment, and results show that bistatic radar with specific geometry configuration (CB2.5) not only has higher classification accuracy than monostatic radar in each aspect angle but also can recognise the object in a wider angle range. After training and fusing the data of all angles, it is found that the accuracy, sensitivity, and specificities of CB2.5 have 2.2%, 7.7% and 1.5% improvement compared with monostatic radar. ...
Conference paper (2022) - Julien Le Kernec, Francesco Fioranelli, Olivier Romain, Alexandre Bordat
Radar has long been considered an important technology for indoor monitoring and assisted living. As ageing has become a worldwide problem, it causes a huge burden on the government’s healthcare expenses and infrastructure. Radar-based human activity recognition (HAR) is foreseen to become a widespread sensing modality for health monitoring at home. Conventional radar-based HAR task usually adopts the amplitude of spectrograms as input to a convolutional neural network (CNN), which can limit the achieved performances. A hybrid fusion model is here proposed, which can integrate multiple radar data domains. The result shows that the proposed framework can achieve superior classification accuracy of 92.1% (+2.5% higher than conventional CNN) and a lighter computational load than the state-of-the-art techniques with 3D-CNN. ...
Conference paper (2022) - Xinyu Zhang, Qammer H. Abbasi, Francesco Fioranelli, Olivier Romain, Julien Le Kernec
Population ageing has become a severe problem worldwide. Human activity recognition (HAR) can play an important role to provide the elders with in-time healthcare. With the advantages of environmental insensitivity, contactless sensing and privacy protection, radar has been widely used for human activity detection. The micro-Doppler signatures (spectrograms) contain much information about human motion and are often applied in HAR. However, spectrograms only interpret magnitude information, resulting in suboptimal performances. We propose a radar-based HAR system using deep learning techniques. The data applied came from the open dataset “Radar signatures of human activities” created by the University of Glasgow. A new type of hybrid map was proposed, which concatenated the spectrograms amplitude and phase. After cropping the hybrid maps to focus on useful information, a convolutional neural network (CNN) based on LeNet-5 was designed for feature extraction and classification. In addition, the idea of transfer learning was applied for radar-based HAR to evaluate the classification performance of a pre-trained network. For this, GoogLeNet was taken and trained on the newly-produced hybrid maps. These initial results showed that the LeNet-5 CNN using only the spectrograms obtained an accuracy of 80.5%, while using the hybrid maps reached an accuracy of 84.3%, increasing by 3.8%. The classification result of transfer learning using GoogLeNet was 86.0%. ...
Book chapter (2021) - Francesco Fioranelli, Julien Le Kernec
This chapter presents a summary of radar-based classification approaches developed for small drones carrying payloads. Specific focus is given to three types oftechniques that were validated on the same multistatic radar data set collected usingthe University College London (UCL)-netted radar NetRAD. These techniquesused, respectively, features extracted from the centre of mass and bandwidth of themicro-Doppler signatures; different radar data domains generated from the micro-Doppler data to be processed by pretrained Convolutional Neural Networks(CNNs) and spectral kurtosis analysis on the micro-Doppler. ...
Conference paper (2021) - Yaxin Du, Jipeng Li, Zhouyixian Li, Ran Yu, Antonio Napolitano, Francesco Fioranelli, Julien Le Kernec
Human Activity Classification with radar has made significant progress in the past few years. In this article, we propose a cyclostationarity-based approach in this field of application. Feature extraction, selection, and activity classification as it detects micro-Doppler is made starting from complex-valued cyclostationary statistical functions of the reflected radar signal. The human activity can be recognized with up to 92.6% with the real part, 95.4% with the imaginary part and 95.4% by the combination of real and imaginary part. ...
Journal article (2021) - Fawei Yang, Feng Xu, Francesco Fioranelli, Julien Le Kernec, Shaoqiang Chang, Teng Long
The latest progress of the multiple-input multiple-output (MIMO) radar system developed for small drones detection at Beijing Institute of Technology is presented herein. A low-cost S-band MIMO scanning radar system is designed for the detection of small drones. A practical design optimisation and implementation of a sparse array covering the whole airspace, and a target-based MIMO radar array calibration method to improve the signal-to-noise ratio of the target are proposed. An experiment in the microwave chamber was conducted to verify the designed sparse-array beam-pattern, and measurement campaigns for small drones were performed to test the system performance where the radar achieved detection and tracking of a small DJI-Phantom 4 drone at a range of up to 5 km. Target features, including micro-Doppler and radar cross-section signatures were extracted to assist target classification. The experimental results indicate that the system has promising capability in small drones detection and tracking, despite the challenges of low dwell time on targets due to the scanning nature of the system. ...
Conference paper (2021) - Zhenghui Li, Julien Le Kernec, Francesco Fioranelli, Olivier Romain, Lei Zhang, Shufan Yang
In personnel recognition based on radar, significant research exists on statistical features extracted from the micro-Doppler signatures, whereas research considering other domains and information such as phase is less developed. This paper presents the use of deep learning methods to integrate both phase and magnitude features from range profiles and spectrogram. The temporal features of both domains are separately extracted using a stack of Long Short Term Memory (LSTM) layers. Then, the extracted features are aggregated in the corresponding domains and pass through a series of dense layers with SoftMax classifier. Finally, the information from the two domains is fused with a soft fusion approach to improve the performance further. Preliminary results show that the proposed network with soft fusion can achieve 85.5% accuracy in personnel recognition with six subjects ...
Conference paper (2021) - Zhenghui Li, Francesco Fioranelli, Shufan Yang, Julien Le Kernec, Qammer Abbasi, Olivier Romain
Radar systems are increasingly being used for healthcare applications for human activity recognition due to their advantages for privacy compliance, contactless sensing, and insensitivity to lighting conditions. The proposed classification algorithms are often very complex, hence requiring significant computational resources. We propose an adaptive thresholding algorithm used as a 'mask' to highlight the region of interest from the micro-Doppler signature. The mask is then applied to spectrogram information. These masked signatures are used for handcrafted feature extraction and classification. A quadratic-SVM classifier is employed based on the features from the information acquired. The preliminary results show that an accuracy of 91.3% is achieved using sequential forward feature selection with feature fusion. Based on our initial result, a Naïve Bayes combiner is used to improve the overall performance further. With this strategy, the accuracy of classification reaches 92.5% for six activities. Additionally, we compare our findings to those of other models utilizing the same database. The results demonstrate that high accuracy can be achieved when adaptive thresholding is used with the SVM method, and computational resources may significantly decrease. ...
Conference paper (2021) - Francesco Fioranelli, Julien Le Kernec
In this paper, radar sensing in the domain of human healthcare is discussed, specifically looking at the typical applications of human activity classification (including fall detection), gait analysis and gait parameters extraction, and vital signs monitoring such as respiration and heartbeat. A brief overview of open research challenges and trends in this domain are provided, showing that radar sensors and sensing can play a significant role in the domain of human healthcare. ...
Journal article (2021) - Boyu Zhou, Yier Lin, Julien Le Kernec, Shufan Yang, Francesco Fioranelli, Olivier Romain, Zhiqin Zhao
Radar micro-Doppler signatures have been proposed for human monitoring and activity classification for surveillance and outdoor security, as well as for ambient assisted living in healthcare-related applications. A known issue is the performance reduction when the target is moving tangentially to the line of sight of the radar. Multiple techniques have been proposed to address this, such as multistatic radar and to some extent, interferometric (IF) radar. A simulator is presented to generate synthetic data representative of eight radar systems (monostatic, circular multistatic and in-line multistatic [IM] and IF) to quantify classification performances as a function of aspect angles and deployment geometries. This simulator allows an unbiased performance evaluation of different radar systems. Six human activities are considered with signatures originating from motion-captured data of 14 different subjects. The classification performances are analysed as a function of aspect angles ranging from 0° to 90° per activity and overall. It demonstrates that IF configurations are more robust than IM configurations. However, IM performs better at angles below 55° before IF configurations take over. ...
Book chapter (2020) - Aman Shrestha, Haobo Li, Francesco Fioranelli, Julien Le Kernec
This chapter will explore the different sensor and fusion topologies, using active radar sensing in conjunction with other sensing technologies as support for assisted living and healthcare applications. Initially, the sensors and their outputs will be described, with specifics of signal processing of the different sensors and the machine learning for classification detailed. The results of applying these methods to the assisted living scenario will then be presented. This chapter will give insight into activity classification with radar and additional sensing technologies, in particular, wearable inertial and magnetic sensors, focusing on the key information fusion approaches and main improvements using experimental data as validation. ...
Conference paper (2020) - Haobo Li, Julien Le Kernec, Ajay Mehul, Francesco Fioranelli
This paper discusses a fusion framework with data from multiple, distributed radar sensors based on conventional classifiers, and transfer learning with pre-trained deep networks. The application considered is the classification of gait styles and the detection of critical accidents such as falls. The data were collected from a network comprised of one Ancortek frequency modulated continuous wave radar and three ultra wide-band Xethru radars. The radar systems within the network were placed in three different locations, notably, in front of participants, on the ceiling, and on the right-hand side of the monitored area. The proposed information fusion framework compares feature level fusion, soft fusion with the classifier confidence level, and hard fusion with Naïve Bayes combiner (NBC). Regarding the classifier, linear SVM, Random-Forest Bagging Trees, and five pre-trained neural networks are introduced to the fusion algorithm, where the VGG-16 network yields the best performance (about 84%) with the help of NBC. Compared to the best cases with conventional classifiers, it is reported that 20% and 16% subsequent improvement are achieved for individual usage of single radar and fusion ...
Conference paper (2020) - Cameron Bennet, Mohammad Jahangir, Francesco Fioranelli, Bashar I Ahmad, Julien Le Kernec
The commercialization of drones has granted the public with unprecedented access to unmanned aviation. As such, the detection, tracking, and classification of drones in radars have become an area in high demand to mitigate accidental or voluntary misuse of these platforms. This paper focuses on the classification of drone targets in a safety context where the concept of Explainable AI is of particular interest. Here, we propose a simple, yet effective, means to extract a salient symmetry feature from the micro-Doppler signatures of drone targets, arising from onboard rotary components. Most importantly, this approach maintains the explainable nature of the employed recognition algorithm as the symmetry feature is directly related to the kinematics of the drones as the targets of interest. A large dataset collected from multiple locations with over 280 minutes of rotary and fixed wing drone flights has been collected and used to demonstrate the generalization capability of this approach. ...
Conference paper (2020) - Boyu Zhou, Julien Le Kernec, Shufan Yang, Francesco Fioranelli, Olivier Romain, Zhiqin Zhao
Radar micro-Doppler signatures have been proposed for human activity classification for surveillance and ambient assisted living in healthcare-related applications. A known issue is the performance reduction when the target is moving tangentially to the line-of-sight of the radar. Multiple techniques have been proposed to address this, such as multistatic radar and to some extent, interferometric radar. A simulator is presented to generate synthetic data representative of 8 different radar systems (including configurations as monostatic, multistatic, and interferometric) to quantify classification performances as a function of aspect angles and deployment geometries. This simulator allows an unbiased performance evaluation of the different radar systems. 6 human activities are considered with signatures originating from motion-captured data of 14 different subjects. The results show that interferometric radar data with fusion outperforms the other methods with over 97.6% accuracy consistently across all aspect angles, as well as the potential for simplified indoor deployment. ...
Conference paper (2020) - Zhenghui Li, Francesco Fioranelli, Shufan Yang, Lei Zhang, Olivier Romain, Qian He, Guolong Cui, Julien Le Kernec
In human activity recognition (HAR) based on radar, significant research exists on statistical features extracted from the spectrogram (μD), whereas the research which considers other domains is less developed. This paper is aimed to investigate three domains of radar data: μD, Cadence Velocity Diagram (CVD), and range-time (RT) information, evaluating which ones are best suited to classify specific activities. In addition, information fusion is applied to enhance classification accuracy and compare it with the results of single domain approach. Based on the previous results, a hierarchical structure is proposed to improve the performance of classification further. The preliminary results show that different domains have distinctive sensitivity to specific activities. RT information is sensitive to the moving target crossing range bins, while CVD is more sensitive to body movement. The μD is more balanced, which means it can observe both moving targets and body movements. Furthermore, improvement in accuracy is approximately 6-23 % using feature-level fusion. A hierarchical classification approach is also investigated, which has accuracy in the order of approximately 92 %. ...
Book chapter (2020) - Francesco Fioranelli, Julien Le Kernec
Contactless radar and radio frequency (RF) sensing has recently gained much interest in the domain of health care and assisted living, due to its capability to monitor relevant parameters for the health and well‐being of people. Applications range from the monitoring of respiration and heartbeat to mobility levels, gait and locomotion parameters, and behavioral patterns. What makes radar sensing attractive compared to alternative and complementary technologies such as video‐cameras, wearables, or ambient sensors, is their contactless capabilities, whereby no sensors need to be worn by the people monitored, and no plain images or videos need to be collected in private spaces and homes. ...

Using Deep Learning for Multi-Domain Activity Classification

Conference paper (2020) - Shaoxuan Li , Mu Jia, Julien Le Kernec, Shufan Yang, Francesco Fioranelli, Olivier Romain
Nowadays, health monitoring issues are increasing as the worldwide population is aging. In this paper, the radar modality is used to classify with radar signature automatically. The classic approach is to extract features from micro-Doppler signatures for classification. This data representation domain has its limitations for activities presenting similar accelerations like a frontal fall and picking up an object from the floor that lead to wrongly labeled activities. In this work, we propose to combine multiple radar data domains with deep learning. Features are extracted from four domains, namely, Range-Time, Range-Doppler, Doppler-Time, and Cadence Velocity Diagram. The extracted features are set as the input of a Convolutional Neural Network, yielding 91% accuracy with 10-fold cross-validation based on the University of Glasgow “Radar signatures of human activities” open dataset. ...