The problem of estimating the mounting angle of millimeter-wave (mmWave) automotive radars installed on moving vehicles is investigated. We address this angle estimation problem during normal driving, without relying on controlled environments, dedicated radar targets, or specially designed driving routes. To achieve this, we propose a signal processing pipeline that combines radar and inertial measurement unit (IMU) data to enable accurate and reliable estimation under realistic driving conditions. Unlike previous studies, the method employs neural networks (NNs) to process sparse and noisy radar measurements, reject detections from moving objects, and estimate radar motion. In addition, a measurement model is introduced to correct IMU bias and scale factor errors. Using vehicle kinematics, the radar mounting angle is then computed from the estimated radar motion and the vehicle's yaw rate. To benchmark performance, the proposed approach is comprehensively compared with two alternative problem formulations and four estimation techniques reported in the literature. Validation is carried out on the challenging RadarScenes dataset, covering over 79 km of real-world driving with different velocities and trajectories. The results show that stable and accurate mounting angle estimates are obtained within approximately 25 s of driving. To the best of the authors' knowledge, this is the first study to demonstrate that automotive radar mounting angles can be estimated during complex, real traffic conditions using only onboard sensor data.

Conventional radar segmentation research has typically focused on learning category labels for different moving objects. Although fundamental differences between radar and optical sensors lead to differences in the reliability of predicting accurate and consistent category labels, a review of common radar perception tasks in automotive applications reveals that determining whether an object is moving or static is a prerequisite for most tasks. To fill this gap, this study proposes a neural network (NN)-based solution that can simultaneously segment static and moving objects from radar point clouds. Furthermore, since the measured radial velocity of static objects is correlated with the motion of the radar, this approach can also estimate the instantaneous 2-D velocity of the moving platform/vehicle (ego-motion). Notably, despite performing dual tasks, the proposed method employs very simple yet effective building blocks for feature extraction: multilayer perceptrons (MLPs) and recurrent NNs (RNNs). In addition to being the first of its kind in the literature, the proposed method also demonstrates the feasibility of extracting the information required for the dual tasks directly from unprocessed point clouds, without the need for cloud aggregation, Doppler compensation, motion compensation, or any other intermediate signal processing steps. To measure its performance, this study introduces a set of novel evaluation metrics and tests the proposed method using a challenging real-world radar dataset, RadarScenes. The results show that the proposed method not only performs well on the dual tasks but also has broad application potential in other radar perception tasks. More qualitative results can be viewed here: https://youtu.be/3ejS1chSvQ8?si=uGRugVA63BCyvNBV

This article studies the problem of estimating the 2-D motion state of a moving vehicle (ego motion) using millimeter-wave (mmWave) automotive radar sensors. Unlike prior single-radar or synchronized radar systems, the proposed approach (named DeepEgo+) can achieve sensor fusion and estimate ego motion using an unsynchronized radar sensor network. To achieve this goal, DeepEgo+ combines two neural network (NN)-based components (i.e., Module A for motion estimation and Module B for sensor fusion) with a decentralized processing architecture using the late fusion technique. Specifically, each radar sensor in the network has a Module A that processes its output and computes an initial motion estimate, while Module B fuses the initial estimates from all radar sensors and outputs the final estimate. This novel architecture and fusion scheme not only eliminates the synchronization requirement but also provides robustness and scalability to the system. To benchmark its performance, DeepEgo+ has been tested using a challenging real-world radar dataset, RadarScenes. The results show that DeepEgo+ provides significant performance advantages over recent state-of-the-art approaches in terms of estimation accuracy, long-term stability, and robustness against high outlier ratios and sensor failures. Furthermore, the influence of vehicle nonzero acceleration on ego-motion estimation is identified for the first time, and DeepEgo+ demonstrates the feasibility of compensating for its effect and further improving the estimation accuracy.

This paper focuses on the challenge of estimating the 2D instantaneous ego -motion of vehicles equipped with an automotive radar. To further improve our previous study based on the weighted least squares (wLSQ) method and purpose-designed neural networks (NNs), this work proposes a new network architecture that supports local and global feature extraction as well as point-wise dynamic feature channel mixing. Compared with our previous work, the proposed method provides better estimation accuracy, lighter network size, and faster runtime performance.

Linked to the increasing availability of datasets for radar-based human activity recognition (HAR), in this Student Highlights contribution, we report on a classification project that a group of 23 graduate students performed at TU Delft. The students were asked to work in groups of 2-3 members and to use the publicly available University of Glasgow dataset to develop the best classification pipeline as possible. This involved development and justification of both choices for the preprocessing techniques on the radar data (e.g., time-frequency distributions and cleaning of the signatures), and for the classification algorithms (e.g., the type of the algorithm, the hyperparameters' selection, the training-validation-testing split). While this student activity was performed at a small scale and with educational rather than research aims, we are happy to report it to the AESS readership, as we believe that such initiatives with open datasets sharing and classification algorithm benchmarking are beneficial for the wider radar research community. Furthermore, a list of publicly available datasets for radar-based HAR that can be used for similar initiatives is also reported in this article.