Modelling, predicting and analysing driver behaviours are essential to advanced driver assistance systems (ADAS) and the comprehensive understanding of complex driving scenarios. Recently, with the development of deep learning (DL), numerous driver behaviour learning (DBL) methods have been proposed and applied in connected vehicles (CV) and intelligent transportation systems (ITS). This study provides a review of DBL, which mainly focuses on typical applications in CV and ITS. First, a comprehensive review of the state-of-the-art DBL is presented. Next, Given the constantly changing nature of real driving scenarios, most existing learning-based models may suffer from the so-called “catastrophic forgetting,” which refers to their inability to perform well in previously learned scenarios after acquiring new ones. As a solution to the aforementioned issue, this paper presents a framework for continual driver behaviour learning (CDBL) by leveraging continual learning technology. The proposed CDBL framework is demonstrated to outperform existing methods in behaviour prediction through a case study. Finally, future works, potential challenges and emerging trends in this area are highlighted.

Intelligent vehicles have achieved a considerable development in technologies and can fulfill the basic functions of autonomous driving in a limited closed environment. However, results of actual road tests show that the current technologies of intelligent vehicles still have many limitations and their large-scale application in complex urban and off-road environments still faces many challenges. As one of the key technologies, the motion planning and control technology has basically formed a complete theoretical system and has been widely applied in engineering. However, the traditional methods still have some defects in practical application, such as the inability of understanding dynamic and complex scenes, poor adaptability for different scenes, high complexity of the model, and difficulty in parameter tuning. Due to the strong ability in knowledge representation and model fitting, machine learning methods have been widely applied in perception and navigation technology for intelligent vehicles. In order to solve the problems of generalization and applicability in traditional motion planning and control techniques, many researchers have also devoted themselves to exploring the usage of deep learning, reinforcement learning, and so on machine learning methods in motion planning and control policy for intelligent vehicles. In this paper, machine learning-based methods were reviewed for motion planning and control in intelligent vehicles, analyzing the existing policy learning methods for motion planning and control from three aspects, including basic framework, basic learning paradigms, and different planning and control methods based on learning. Finally, the research status and future development directions were summarized and prospected.

To deal with the nonlinear interference caused by chassis movement and road surface undulations with the tracking and aiming of unmanned combat ground vehicles, a tracking and aiming adaptive control method for unmanned combat ground vehicles on the move based on reinforcement learning compensation is proposed. This method consists of a main controller and a compensation controller. The main controller uses the PID control algorithm combined with the current tracking error to obtain the main control quantity, and the compensation controller uses the Dueling DQN reinforcement learning network to process the current state of the combat vehicle as well as the road surface undulation information near the local planning path to obtain the compensation control quantity. Firstly, the integrated kinematics model of the unmanned combat ground vehicle is established. Then, the compensation control algorithm based on reinforcement learning is described. Finally, simulation and verification are performed in three-dimensional scenes based on the V-REP dynamic software. The experimental results show that the tracking and aiming control method based on reinforcement learning compensation has good adaptive ability for chassis movement and road surface undulations, which effectively improves the tracking/aiming accuracy and stability of unmanned combat vehicles.