Comfort-Oriented Motion Planning for Automated Vehicles Using Deep Reinforcement Learning

Comfort-Oriented Motion Planning for Automated Vehicles Using Deep Reinforcement Learning

Rajesh, Nishant (Siemens)
Zheng, Y. (TU Delft Intelligent Vehicles)
Shyrokau, B. (TU Delft Intelligent Vehicles)

2023

Automated vehicles promise numerous advantages to their users. The proposed benefits could however be overshadowed by a rise in the susceptibility of passengers to motion sickness due to their engagement in non-driving tasks. Increasing attention is paid to designing vehicle motion to mitigate motion sickness. In this work, the deep reinforcement learning (DRL) method is used to plan vehicle trajectories, with a focus on minimizing low-frequency accelerations. These are known to be the primary cause of motion sickness. The goal is achieved by incorporating a frequency-weighted discomfort term into the reward function during training. The ability of the trained agent to target undesirable frequencies in accelerations is verified by comparing it with another agent trained for improving overall acceleration comfort. A reduction of 9.6% in frequency-weighted discomfort is achieved. The motion plan from the DRL agent is further compared with trajectories generated by human drivers in real-world scenarios. The results demonstrate comparable performance between the DRL agent and human drivers. Meanwhile, a significant reduction in online computation time has been observed when compared to a motion planner based on numerical optimization.

Automated driving
deep reinforcement learning
motion planning
motion sickness
proximal policy optimization

http://resolver.tudelft.nl/uuid:37e340ca-9d89-440e-b0b1-3d678bd05516

https://doi.org/10.1109/OJITS.2023.3275275

2687-7813

IEEE Open Journal of Intelligent Transportation Systems, 4, 348-359

Institutional Repository

journal article

© 2023 Nishant Rajesh, Y. Zheng, B. Shyrokau