Potential Field Methods for Safe Reinforcement Learning

Potential Field Methods for Safe Reinforcement Learning: Exploring Q-Learning and Potential Fields

Bhowal, Abhranil (TU Delft Aerospace Engineering; TU Delft Control & Operations)

van Kampen, E. (mentor)
Mannucci, T. (mentor)

Delft University of Technology

Aerospace Engineering | Control & Simulation

2017-08-11

A Reinforcement Learning (RL) agent learns about its environment through exploration. For most physical applications such as search and rescue UAVs, this exploration must take place with safety in mind. Unregulated exploration, especially at the beginning of a run, will lead to fatal situations such as crashes. One approach to mitigating these risks is by using Artificial Potential Fields (APFs). Various approaches to effectively use the potential information gathered by the agent are proposed, tested and discussed. The agent is placed in an environment-model-free setting, where it is still provided with knowledge of its own dynamics. A gridworld simulation is developed using MATLAB to test the interoperability of APFs with Q-learning. It is shown that safety of exploration benefits from adding this layer of information to the agents’ decision making process. In effect, the Q-table gets updated more efficiently due to the agent explicitly knowing of high potential ‘dangerous’ states.

Reinforcement Learning
RL
Potential Fields
Artificial Potential Fields
drone
UAV
AI
Path Planning
Q-Learning

http://resolver.tudelft.nl/uuid:767537cb-c54f-4496-b812-55d11d150f98

Student theses

master thesis

© 2017 Abhranil Bhowal