Print Email Facebook Twitter Building day-ahead bidding functions for seasonal storage systems Title Building day-ahead bidding functions for seasonal storage systems: A reinforcement learning approach Author Lago, Jesus (TU Delft Team Bart De Schutter) Sogancioglu, Ecem (Radboud Universiteit Nijmegen) Suryanarayana, Gowri (VITO-Energyville) Ridder, Fjo De (Thomas More) De Schutter, B.H.K. (TU Delft Delft Center for Systems and Control; TU Delft Team Bart De Schutter) Department Delft Center for Systems and Control Date 2019 Abstract Due to the increasing integration of renewable sources in the electrical grid, electricity generation is expected to become more uncertain. In this context, seasonal thermal energy storage systems (STESSs) are key to shift the delivery of renewable energy sources and tackle their uncertainty problems. In this paper, we propose an optimal controller for STESSs that, using reinforcement learning, builds bidding functions for the day-ahead market. In detail, considering that there is an uncertain energy demand that the STESS has to satisfy, the controller buys energy in the day-ahead market so that the uncertain demand is satisfied while the profits are maximized. Since prices are low during periods of large renewable energy generation (and vice versa), maximizing the profit of a STESS indirectly shifts the delivery of renewable energy to periods of high energy demand while reducing their uncertainty problems. To evaluate the proposed algorithm, we consider a real STESS providing different yearly-demand levels; then, we compare the performance of the controller to the theoretical upper bound, i.e. the optimal cost of buying energy given perfect knowledge of the demand and prices. The results indicate that the proposed controller performs reasonably well: despite the large uncertainty in prices and demand, the proposed controller obtains 70%-50% of the maximum gains given by the theoretical bound. Subject Bidding FunctionsEnergy StorageReinforcement LearningSeasonal Storage To reference this document use: http://resolver.tudelft.nl/uuid:edeefab7-bb4f-4a0e-8d83-a26918b10568 DOI https://doi.org/10.1016/j.ifacol.2019.08.258 ISSN 1474-6670 Source IFAC-PapersOnLine, 52 (4), 488-493 Event IFAC Workshop on Control of Smart Grid and Renewable Energy Systems, CSGRES 2019, 2019-06-10 → 2019-06-12, Jeju, Korea, Republic of Part of collection Institutional Repository Document type journal article Rights © 2019 Jesus Lago, Ecem Sogancioglu, Gowri Suryanarayana, Fjo De Ridder, B.H.K. De Schutter Files PDF 1_s2.0_S2405896319305956_main.pdf 750.09 KB Close viewer /islandora/object/uuid:edeefab7-bb4f-4a0e-8d83-a26918b10568/datastream/OBJ/view