Sensing and Machine Learning for Automotive Perception
A Review
Ashish Pandharipande (NXP Semiconductors)
Chih Hong Cheng (Fraunhofer Iks)
J.H.G. Dauwels (TU Delft - Signal Processing Systems)
Sevgi Z. Gurbuz (University of South Alabama)
Javier Ibanez-Guzman (Group Renault)
Guofa Li (Chongqing University)
Andrea Piazzoni (Nanyang Technological University)
Pu Wang (Mitsubishi Electric Research Laboratories)
Avik Santra (Infineon Technologies, North America)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Automotive perception involves understanding the external driving environment and the internal state of the vehicle cabin and occupants using sensor data. It is critical to achieving high levels of safety and autonomy in driving. This article provides an overview of different sensor modalities, such as cameras, radars, and light detection and ranging (LiDAR) used commonly for perception, along with the associated data processing techniques. Critical aspects of perception are considered, such as architectures for processing data from single or multiple sensor modalities, sensor data processing algorithms and the role of machine learning techniques, methodologies for validating the performance of perception systems, and safety. The technical challenges for each aspect are analyzed, emphasizing machine learning approaches, given their potential impact on improving perception. Finally, future research opportunities in automotive perception for their wider deployment are outlined.