Unlocking the Flexibility of District Heating Pipeline Energy Storage with Reinforcement Learning

Unlocking the Flexibility of District Heating Pipeline Energy Storage with Reinforcement Learning

The integration of pipeline energy storage in the control of a district heating system can lead to profit gain, for example by adjusting the electricity production of a combined heat and power (CHP) unit to the fluctuating electricity price. The uncertainty from the environment, the computational complexity of an accurate model, and the scarcity...

Distributed coordination of deferrable loads: A real-time market with self-fulfilling forecasts

Increased uptake of variable renewable generation and further electrification of energy demand necessitate efficient coordination of flexible demand resources to make most efficient use of power system assets. Flexible electrical loads are typically small, numerous, heterogeneous and owned by self-interested agents. Considering the multi...

Bounding the probability of resource constraint violations in multi-agent MDPs

Multi-agent planning problems with constraints on global resource consumption occur in several domains. Existing algorithms for solving Multi-agent Markov Decision Processes can compute policies that meet a resource constraint in expectation, but these policies provide no guarantees on the probability that a resource constraint violation will...

Solving Transition-Independent Multi-agent MDPs with Sparse Interactions

In cooperative multi-agent sequential decision making under uncertainty, agents must coordinate to find an optimal joint policy that maximises joint value. Typical algorithms exploit additive structure in the value function, but in the fully-observable multi-agent MDP (MMDP) setting such structure is not present. We propose a new optimal solver...