Online Adaptive Helicopter Control Using Incremental Dual Heuristic Programming

Conference Paper (2021)
Author(s)

B. Helder (Student TU Delft)

Erik-Jan van Kampen (TU Delft - Control & Simulation)

M. D. Pavel (TU Delft - Control & Simulation)

Research Group
Control & Simulation
Copyright
© 2021 B. Helder, E. van Kampen, M.D. Pavel
DOI related publication
https://doi.org/10.2514/6.2021-1118
More Info
expand_more
Publication Year
2021
Language
English
Copyright
© 2021 B. Helder, E. van Kampen, M.D. Pavel
Research Group
Control & Simulation
Pages (from-to)
1-18
ISBN (electronic)
978-1-62410-609-5
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

Reinforcement learning is an appealing approach for adaptive, fault-tolerant flight control, but is generally plagued by its need for accurate system models and lengthy offline training phases. The novel Incremental Dual Heuristic Programming (IDHP) method removes these dependencies by using an online-identified local system model. A recent implementation has shown to be capable of reliably learning near-optimal control policies for a fixed-wing aircraft in cruise by using outer loop PID and inner-loop IDHP rate controllers. However, fixed wing aircraft are inherently stable, enabling a trade-off between learning speed and learning stability which is not trivially extended to a physically unstable system. This paper presents an implementation of IDHP for control of a non-linear, six-degree-of-freedom simulation of an MBB Bo-105 helicopter. The proposed system uses two separate IDHP controllers for direct pitch angle and altitude control combined with outer loop and lateral PID controllers. After a short online training phase, the agent is shown to be able to fly a modified ADS-33 acceleration-deceleration manoeuvre as well as a one-engine-inoperative continued landing with high success rates.

Files

6.2021_1118.pdf
(pdf | 0.957 Mb)
License info not available