Deep-Reinforcement-Learning-based Nonlinear Adaptive Flight Control

On the gap between simulation and reality

Student Report (2023)
Author(s)

A. Beňo (TU Delft - Aerospace Engineering)

Contributor(s)

E. van Kampen – Mentor (TU Delft - Aerospace Engineering)

Faculty
Aerospace Engineering
More Info
expand_more
Publication Year
2023
Language
English
Graduation Date
04-08-2023
Awarding Institution
Delft University of Technology
Programme
Aerospace Engineering, Control & Simulation
Faculty
Aerospace Engineering
Downloads counter
21
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

This paper presents a novel corrective algorithm bridging the gap between simulation and reality by online fine-tuning an offline pre-trained deep reinforcement learning agent. The novel control architecture is inspired by the incremental model-based heuristic dynamic programming, which is described together with the basics of reinforcement learning first. This novel control architecture is applied in an illustrative control environment. It was found that the corrective algorithm can help reach the desired reference state in an environment governed by moderately different dynamics from those used during pre-training of the reinforcement learning agent.