Print Email Facebook Twitter Deep Reinforcement Learning with Feedback-based Exploration Title Deep Reinforcement Learning with Feedback-based Exploration Author Scholten, Jan (Student TU Delft) Wout, Daan (Student TU Delft) Celemin, Carlos (TU Delft Learning & Autonomous Control) Kober, J. (TU Delft Learning & Autonomous Control) Date 2020 Abstract Deep Reinforcement Learning has enabled the control of increasingly complex and high-dimensional problems. However, the need of vast amounts of data before reasonable performance is attained prevents its widespread application. We employ binary corrective feedback as a general and intuitive manner to incorporate human intuition and domain knowledge in model-free machine learning. The uncertainty in the policy and the corrective feedback is combined directly in the action space as probabilistic conditional exploration. As a result, the greatest part of the otherwise ignorant learning process can be avoided. We demonstrate the proposed method, Predictive Probabilistic Merging of Policies (PPMP), in combination with DDPG. In experiments on continuous control problems of the OpenAI Gym, we achieve drastic improvements in sample efficiency, final performance, and robustness to erroneous feedback, both for human and synthetic feedback. Additionally, we show solutions beyond the demonstrated knowledge. To reference this document use: http://resolver.tudelft.nl/uuid:f0be4b85-7957-445c-b226-c0754ee05ae1 DOI https://doi.org/10.1109/CDC40024.2019.9029503 Publisher IEEE Embargo date 2021-09-12 ISBN 978-1-7281-1398-2 Source Proceedings of the IEEE 58th Conference on Decision and Control, CDC 2019 Event 58th IEEE Conference on Decision and Control, CDC 2019, 2019-12-11 → 2019-12-13, Nice, France Bibliographical note Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public. Part of collection Institutional Repository Document type conference paper Rights © 2020 Jan Scholten, Daan Wout, Carlos Celemin, J. Kober Files PDF Deep_Reinforcement_Learni ... ration.pdf 815.69 KB Close viewer /islandora/object/uuid:f0be4b85-7957-445c-b226-c0754ee05ae1/datastream/OBJ/view