Sample-efficient reinforcement learning for quadcopter flight control

Sample-efficient reinforcement learning for quadcopter flight control

Koomen, Lenard (TU Delft Aerospace Engineering)

van Kampen, Erik-jan (mentor)

Delft University of Technology

Aerospace Engineering

2020-06-25

The combination of reinforcement learning and deep neural networks has the potential to train intelligent autonomous agents on high dimensional sensory inputs, with applications in flight control. However, the amount of samples needed by these methods is often too large to use real-world interaction. In this work, mirror-descent guided policy search is identified as a promising algorithm to train high-dimensional policies on real-world samples. Several experiments are conducted to investigate how the use of expert-demonstrations can further improve the sample-efficiency of this algorithm when applied to the control of a quadcopter in simulation. It is shown how demonstrations, when combined with certain alterations in the mirror descent guided policy search algorithm, can significantly reduce the amount of samples needed to achieve good performance. Additionally, it is shown how these improvements are robust to sub-optimal demonstrations.

quadcopter
flight control
reinforcement learning
guided policy search
sample efficiency
learning from demonstrations

http://resolver.tudelft.nl/uuid:1f9b8378-b2b1-4dc3-98c2-d16a87e493e6

Student theses

master thesis

© 2020 Lenard Koomen