Print Email Facebook Twitter Experience-based model predictive control using reinforcement learning Title Experience-based model predictive control using reinforcement learning Author Negenborn, R.R. De Schutter, B. Wiering, M.A. Hellendoorn, J. Faculty Mechanical, Maritime and Materials Engineering Department Delft Center for Systems and Control Date 2004-11-01 Abstract Model predictive control (MPC) is becoming an increasingly popular method to select actions for controlling dynamic systems. TraditionallyMPC uses a model of the system to be controlled and a performance function to characterize the desired behavior of the system. The MPC agent finds actions over a finite horizon that lead the system into a desired direction. A significant problem with conventional MPC is the amount of computations required and suboptimality of chosen actions. In this paper we propose the use of MPC to control systems that can be described as Markov decision processes. We discuss how a straightforward MPC algorithm for Markov decision processes can be implemented, and how it can be improved in terms of speed and decision quality by considering value functions. We propose the use of reinforcement learning techniques to let the agent incorporate experience from the interaction with the system in its decision making. This experience speeds up the decision making of the agent significantly. Also, it allows the agent to base its decisions on an infinite instead of finite horizon. The proposed approach can be beneficial for any system that can be modeled as Markov decision process, including systems found in areas like logistics, traffic control, and vehicle automation. Subject Markov decision processmodel predictive controlreinforcement learning To reference this document use: http://resolver.tudelft.nl/uuid:d8339178-a237-4dbb-8e2b-df3783d87282 Publisher TRAIL Research School Source Proceedings of the 8th TRAIL Congress, November 2004, Rotterdam, The Netherlands Part of collection Institutional Repository Document type conference paper Rights (c) 2004 The Author(s) Files PDF Negenborn2004.pdf 133.81 KB Close viewer /islandora/object/uuid:d8339178-a237-4dbb-8e2b-df3783d87282/datastream/OBJ/view