This article studies the problem of estimating the 2-D motion state of a moving vehicle (ego motion) using millimeter-wave (mmWave) automotive radar sensors. Unlike prior single-radar or synchronized radar systems, the proposed approach (named DeepEgo+) can achieve sensor fusion and estimate ego motion using an unsynchronized radar sensor network. To achieve this goal, DeepEgo+ combines two neural network (NN)-based components (i.e., Module A for motion estimation and Module B for sensor fusion) with a decentralized processing architecture using the late fusion technique. Specifically, each radar sensor in the network has a Module A that processes its output and computes an initial motion estimate, while Module B fuses the initial estimates from all radar sensors and outputs the final estimate. This novel architecture and fusion scheme not only eliminates the synchronization requirement but also provides robustness and scalability to the system. To benchmark its performance, DeepEgo+ has been tested using a challenging real-world radar dataset, RadarScenes. The results show that DeepEgo+ provides significant performance advantages over recent state-of-the-art approaches in terms of estimation accuracy, long-term stability, and robustness against high outlier ratios and sensor failures. Furthermore, the influence of vehicle nonzero acceleration on ego-motion estimation is identified for the first time, and DeepEgo+ demonstrates the feasibility of compensating for its effect and further improving the estimation accuracy.

A novel temporal-spatial object classification neural network model is proposed to improve the classification capability of tracked objects. It takes queued points of tracked objects using multiple frames as input, utilizes spatial and temporal information from these points for sampling and grouping as well as extracts hierarchical temporal-spatial features for target classification. Experimental results on a proprietary 4D Imaging Radar dataset and open-source 2D RadarScenes dataset demonstrate that the proposed tracker-cued radar point-cloud target classification method allows the model to learn meaningful appearance and motion features from sparse radar points data, and achieves accurate classification output as compared to a baseline method, while being efficient to run on edge hardware with limited resources.

A neural network (NN) based multi-frame classification approach is proposed to solve the problem of classification of tracked objects. Initially, a baseline tracker is implemented that uses the classification output of an object detection network for classification. Afterwards, two approaches for multi-frame classification are applied to perform classification of tracked objects. The first approach aggregates points from multiple frames and applies a single frame NN for classification, whereas the second approach uses bidirectional long short term memory (BiLSTM) layers to process points from multiple frames. Extensive experiments on the opensource 2D RadarScenes dataset showed a consistent increase in track performance when using either of the two techniques for multi-frame classification.

This paper focuses on the challenge of estimating the 2D instantaneous ego -motion of vehicles equipped with an automotive radar. To further improve our previous study based on the weighted least squares (wLSQ) method and purpose-designed neural networks (NNs), this work proposes a new network architecture that supports local and global feature extraction as well as point-wise dynamic feature channel mixing. Compared with our previous work, the proposed method provides better estimation accuracy, lighter network size, and faster runtime performance.