A comparison of Active Inference and Linear-Quadratic Gaussian control
Equivalence and differences for two settings
J.D. Coehoorn (TU Delft - Mechanical Engineering)
Martijn Wisse – Mentor (TU Delft - Robot Dynamics)
P. Mohajerin Mohajerin Esfahani – Mentor (TU Delft - Team Peyman Mohajerin Esfahani)
R Babuska – Graduation committee member (TU Delft - Learning & Autonomous Control)
Ajith Anil Anil Meera – Graduation committee member (TU Delft - Robot Dynamics)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
The Free Energy Principle, which underlies Active Inference (AI), is a way to explain human perception and behaviour. Previous literature has hinted at a relation between AI and Linear-Quadratic Gaussian (LQG) control, the latter being a textbook controller. AI and LQG are, however, defined with different settings in mind: LQG has access to inputs, whereas AI estimates these; LQG is optimal for White Gaussian Noise, whereas noise needs to be coloured for AI, in order to make derivatives. Therefore, a comparison is provided on two bases: the setting of LQG control; and the setting of AI. The optimal LQG controller is obtained for both settings, and AI is applied to both settings as well. When AI is reduced to the setting of LQG, an equivalent expression can be obtained by a proper choice of tuning parameters. This entails choosing a matrix such that the closed-loop is stable, which contrasts LQG control, which is always a stabilizing controller. When LQG is extended closer to the normal AI setting, we find that tuning of AI becomes harder for more complex systems, but that AI is mostly able to show optimal behaviour.