Flight test of Quadcopter Guidance with Vision-Based Reinforcement Learning

Flight test of Quadcopter Guidance with Vision-Based Reinforcement Learning

Siddiquee, M. (Student TU Delft)
Junell, J. (TU Delft Control & Simulation)
van Kampen, E. (TU Delft Control & Simulation)

2019

Reinforcement Learning (RL) has been applied to teach quadcopters guidance tasks. Most applications rely on position information from an absolute reference system such as Global Positioning System (GPS). The dependence on “absolute position” information is a general limitation in the autonomous flight of Unmanned Aerial Vehicles (UAVs). Environments that have weak or no GPS signals are difficult to traverse for them. Instead of using absolute position, it is possible to sense the environment and the information contained within it in order to come up with a “relative” description of the UAV’s position. This paper presents the design of an RL agent with relative vision-based states and rewards for the teaching of a guidance task to a quadcopter. The agent is taught the task of turning towards a red marker and approaching it in simulation and in flight tests. A more complex task of travelling between a blue and a red marker is trained in simulation. This work shows that relative vision-based states and rewards can be used with RL to teach quadcopters simple guidance tasks. The performance of the trained agent is inconsistent in simulation and flight test due to the inherent partial observability in the relative description of the state.

http://resolver.tudelft.nl/uuid:d35d3fa1-1d5b-42a2-a555-b100a9aa568b

https://doi.org/10.2514/6.2019-0142

978-1-62410-578-4

AIAA Scitech 2019 Forum: 7-11 January 2019, San Diego, California, USA

AIAA Scitech Forum, 2019, 2019-01-07 → 2019-01-11, San Diego, United States

Institutional Repository

conference paper

© 2019 M. Siddiquee, J. Junell, E. van Kampen