- document
-
Spaan, M.T.J. (author), Oliehoek, F.A. (author), Amato, C. (author)We advance the state of the art in optimal solving of decentralized partially observable Markov decision processes (Dec-POMDPs), which provide a formal model for multiagent planning under uncertainty.conference paper 2011
- document
-
Scharpff, J.C.D. (author), Spaan, M.T.J. (author), De Weerdt, M.M. (author)We study the planning of maintenance activities on public infrastructural networks – road networks, Internet, power grids, etc. – in contingent environments such that the negative impact on the network user is minimised. Traditional efforts hereto are mainly of a regulatory nature, whereas we propose charging the service-providers (agents)...conference paper 2012
- document
-
Spaan, M.T.J. (author), Oliehoek, F.A. (author)Multiagent Partially Observable Markov Decision Processes (MPOMDPs) provide a powerful framework for optimal decision making under the assumption of instantaneous communication. We focus on a delayed communication setting (MPOMDP-DC), in which broadcasted information is delayed by at most one time step. In this paper, we show that computation of...conference paper 2012
- document
-
Oliehoek, F.A. (author), Spaan, M.T.J. (author), Amato, C. (author), Whiteson, S. (author)This article presents the state-of-the-art in optimal solution methods for decentralized partially observable Markov decision processes (Dec-POMDPs), which are general models for collaborative multiagent planning under uncertainty. Building off the generalized multiagent A* (GMAA*) algorithm, which reduces the problem to a tree of one-shot...journal article 2013
- document
-
Scharpff, J. (author), Spaan, M.T.J. (author), Volker, L. (author), De Weerdt, M.M. (author)We address efficient planning of maintenance activities in infrastructural networks, inspired by the real-world problem of servicing a highway network. A road authority is responsible for the quality, throughput and maintenance costs of the network, while the actual maintenance is performed by autonomous, third-party contractors. From a (multi...conference paper 2013
- document
-
Oliehoek, F.A. (author), Whiteson, S. (author), Spaan, M.T.J. (author)Dec-POMDPs are a powerful framework for planning in multiagent systems, but are provably intractable to solve. This paper proposes a factored forward-sweep policy computation method that tackles the stages of the problem one by one, exploiting weakly coupled structure at each of these stages. An empirical evaluation shows that the loss in...conference paper 2013
- document
-
Scharpff, J.C.D. (author), Spaan, M.T.J. (author), Volker, L. (author), De Weerdt, M.M. (author)Scheduling of infrastructural maintenance poses a complex multi-agent problem. Commonly a central authority is responsible for the quality and throughput of the infrastructure, while the actual maintenance is performed by multiple self-interested contractors. Not only does the central authority have to (economically) incentivise agents to...conference paper 2013
- document
-
Elffers, J. (author), Konijnenberg, D. (author), Walraven, E.M.P. (author), Spaan, M.T.J. (author)Several approaches exist to solve Artificial Intelligence planning problems, but little attention has been given to the combination of using landmark knowledge and satisfiability (SAT). Landmark knowledge has been exploited successfully in the heuristics of classical planning. Recently it was also shown that landmark knowledge can improve the...conference paper 2013
- document
-
Elffers, J. (author), Konijnenberg, D. (author), Walraven, E. (author), Spaan, M.T.J. (author)Several approaches exist to solve Artificial Intelligence planning problems, but little attention has been given to the combination of using landmark knowledge and satisfiability (SAT). Landmark knowledge has been exploited successfully in the heuristics of classical planning. Recently it was also shown that landmark knowledge can improve the...conference paper 2013
- document
-
Scharpff, J.C.D. (author), Spaan, M.T.J. (author), Volker, L. (author), De Weerdt, M.M. (author)Scheduling of infrastructural maintenance poses a complex multi-agent problem. Commonly a central authority is responsible for the quality and throughput of the infrastructure, while the actual maintenance is performed by multiple self-interested contractors. Not only does the central authority have to (economically) incentivise agents to...conference paper 2013
- document
-
Oliehoek, F.A. (author), Whiteson, S. (author), Spaan, M.T.J. (author)Dec-POMDPs are a powerful framework for planning in multiagent systems, but are provably intractable to solve. This paper proposes a factored forward-sweep policy computation method that tackles the stages of the problem one by one, exploiting weakly coupled structure at each of these stages. An empirical evaluation shows that the loss in...conference paper 2013
- document
-
Walraven, E.M.P. (author), Spaan, M.T.J. (author)Integration of renewable energy in power systems is a potential source of uncertainty, because renewable generation is variable and may depend on changing and highly uncertain weather conditions. In this paper we present and evaluate a new method to schedule power-demanding tasks with release times and deadlines under uncertainty, in order to...conference paper 2015
- document
-
Walraven, E.M.P. (author), Spaan, M.T.J. (author)In many planning domains external factors are hard to model using a compact Markovian state. However, long-term dependencies between consecutive states of an environment might exist, which can be exploited during planning. In this paper we propose a scenario representation which enables agents to reason about sequences of future states. We show...conference paper 2015
- document
-
Scharpff, J.C.D. (author), Roijers, Diederik M. (author), Oliehoek, F.A. (author), Spaan, M.T.J. (author), de Weerdt, M.M. (author)In cooperative multi-agent sequential decision making under uncertainty, agents must coordinate to find an optimal joint policy that maximises joint value. Typical algorithms exploit additive structure in the value function, but in the fully-observable multi-agent MDP (MMDP) setting such structure is not present. We propose a new optimal solver...conference paper 2016
- document
-
de Nijs, F. (author), Spaan, M.T.J. (author), de Weerdt, M.M. (author)When multiple independent agents use a limited shared resource, they need to coordinate and thereby their planning problems become coupled. We present a resource assignment strategy that decouples agents using marginal utility cost, allowing them to plan individually. We show that agents converge to an expected cost curve by keeping a history of...conference paper 2016
- document
-
Walraven, E.M.P. (author), Spaan, M.T.J. (author)The increasing penetration of renewable energy sources and electric vehicles raises important challenges related to the operation of electricity grids. For instance, the amount of power generated by wind turbines is time-varying and dependent on the weather, which makes it hard to match flexible electric vehicle demand and uncertain wind power...conference paper 2016
- document
-
Walraven, E.M.P. (author), Spaan, M.T.J. (author)Renewable energy sources introduce uncertainty regarding generated power in smart grids. For instance, power that is generated by wind turbines is time-varying and dependent on the weather. Electric vehicles will become increasingly important in the development of smart grids with a high penetration of renewables, because their flexibility makes...conference paper 2016
- document
-
de Nijs, F. (author), Walraven, E.M.P. (author), de Weerdt, M.M. (author), Spaan, M.T.J. (author)Multi-agent planning problems with constraints on global resource consumption occur in several domains. Existing algorithms for solving Multi-agent Markov Decision Processes can compute policies that meet a resource constraint in expectation, but these policies provide no guarantees on the probability that a resource constraint violation will...conference paper 2017
- document
-
van der Blij, N.H. (author), Ramirez Elizondo, L.M. (author), Spaan, M.T.J. (author), Bauer, P. (author)Instability caused by low inertia and constant power loads is a major challenge of DC distribution grids. Previous research uses oversimplified models or does not provide general rules for stability. Therefore, a comprehensive approach to analyze the stability of DC distribution systems is desired. This paper presents a method to algebraically...journal article 2017
- document
-
Walraven, E.M.P. (author), Spaan, M.T.J. (author)Partially Observable Markov Decision Processes (POMDPs) are powerful models for planning under uncertainty in partially observable domains. However, computing optimal solutions for POMDPs is challenging because of the high computational requirements of POMDP solution algorithms. Several algorithms use a subroutine to prune dominated vectors in...conference paper 2017