Pages
- 1
- 2
- document
-
Oliehoek, F.A. (author), Spaan, M.T.J. (author), Amato, C. (author), Whiteson, S. (author)This article presents the state-of-the-art in optimal solution methods for decentralized partially observable Markov decision processes (Dec-POMDPs), which are general models for collaborative multiagent planning under uncertainty. Building off the generalized multiagent A* (GMAA*) algorithm, which reduces the problem to a tree of one-shot...journal article 2013
- document
-
van der Blij, N.H. (author), Ramirez Elizondo, L.M. (author), Spaan, M.T.J. (author), Bauer, P. (author)Instability caused by low inertia and constant power loads is a major challenge of DC distribution grids. Previous research uses oversimplified models or does not provide general rules for stability. Therefore, a comprehensive approach to analyze the stability of DC distribution systems is desired. This paper presents a method to algebraically...journal article 2017
- document
-
Oliehoek, F.A. (author), Spaan, M.T.J. (author), Terwijn, Bas (author), Robbel, Philipp (author), Messias, João V. (author)This article describes the MultiAgent Decision Process (MADP) toolbox, a software library to support planning and learning for intelligent agents and multiagent systems in uncertain environments. Key features are that it supports partially observable environments and stochastic transition models; has unified support for single- and multiagent...journal article 2017
- document
-
van der Blij, N.H. (author), Ramirez Elizondo, L.M. (author), Spaan, M.T.J. (author), Bauer, P. (author)Many modelling methods for the analysis of dc distribution grids only consider monopolar configurations and do not allow for mutual couplings to be taken into account. The modelling method presented in this paper aims to deal with both of these issues. A state-space approach was chosen for its flexibility and computational speed. The derived...journal article 2018
- document
-
van der Blij, N.H. (author), Ramirez Elizondo, L.M. (author), Spaan, M.T.J. (author), Bauer, P. (author)Employing bipolar dc distribution systems introduces the possibility of imbalance in the system. To analyze these systems it is crucial to create novel modelling techniques. This paper presents a method to decompose dc distribution systems into symmetrical components. The presented method simplifies the analysis of balanced, unbalanced, and...journal article 2018
- document
-
Satsangi, Yash (author), Whiteson, Shimon (author), Oliehoek, F.A. (author), Spaan, M.T.J. (author)In active perception tasks, an agent aims to select sensory actions that reduce its uncertainty about one or more hidden variables. For example, a mobile robot takes sensory actions to efficiently navigate in a new environment. While partially observable Markov decision processes (POMDPs) provide a natural model for such problems, reward...journal article 2018
- document
-
Walraven, E.M.P. (author), Spaan, M.T.J. (author)In several real-world domains it is required to plan ahead while there are finite resources available for executing the plan. The limited availability of resources imposes constraints on the plans that can be executed, which need to be taken into account while computing a plan. A Constrained Partially Observable Markov Decision Process ...journal article 2018
- document
-
van der Blij, N.H. (author), Ramirez Elizondo, L.M. (author), Spaan, M.T.J. (author), Bauer, P. (author)Changes in distribution grids pose significant challenges with respect to the control and management of these grids. Stability and decentralized control are vital to ensure the availability and accessibility of plug-and-play dc distribution grids that are (temporarily) without communication. Therefore, this paper presents guidelines for these...journal article 2018
- document
-
Walraven, E.M.P. (author), Spaan, M.T.J. (author)Partially Observable Markov Decision Processes (POMDPs) are a popular formalism for sequential decision making in partially observable environments. Since solving POMDPs to optimality is a difficult task, point-based value iteration methods are widely used. These methods compute an approximate POMDP solution, and in some cases they even provide...journal article 2019
- document
-
Ter Berg, C.J.A. (author), Leontaris, G. (author), van den Boomen, M. (author), Spaan, M.T.J. (author), Wolfert, A.R.M. (author)The optimal moment at which maintenance activities should be performed on structures with long service-life to guarantee the required quality of service is hard to define, due to uncertainties in their deterioration processes. Most of the developed methods and concepts use historical data to predict the deterioration process with deterministic...journal article 2019
- document
-
van den Boomen, M. (author), Spaan, M.T.J. (author), Schoenmaker, R. (author), Wolfert, A.R.M. (author)Managerial flexibility in infrastructure investment and replacement decisions adds value. Real options analysis (ROA) captures this value under uncertain market prices. The concept of ROA is that future unfavourable payoffs can be deferred as soon as more information about market prices becomes available. The popularity of ROA is seen in a...journal article 2019
- document
-
van der Blij, N.H. (author), Ramirez Elizondo, L.M. (author), Spaan, M.T.J. (author), Bauer, P. (author)Due to the distributed nature of future electrical power systems, decentralized control is essential for these grids. This paper shows that converters that have identical voltage thresholds switch off simultaneously even if some could have remained operational. Therefore, inadequate system and energy utilization can occur when decentralized...journal article 2020
- document
-
Los, J. (author), Schulte, F. (author), Spaan, M.T.J. (author), Negenborn, R.R. (author)The transportation market requires collaboration to improve efficiency and reduce emissions. Individual carriers, however, might be hesitant to share their private information on a transportation platform. Although a few articles have investigated the value of information sharing, they assume identical behaviour of all carriers. In practice,...journal article 2020
- document
-
Scharpff, J.C.D. (author), Schraven, D.F.J. (author), Volker, Leentje (author), Spaan, M.T.J. (author), de Weerdt, M.M. (author)The next step in the use of innovative, dynamic and performance-based contracts for service delivery by contractors could be use of monetary incentives to stimulate self-regulation of the network. Because it is currently unclear how performance-based payments in network tenders can effectively encourage network members to coordinate their own...journal article 2020
- document
-
Los, J. (author), Schulte, F. (author), Spaan, M.T.J. (author), Negenborn, R.R. (author)Cooperation is important in order to find efficient vehicle routing solutions for the growing transportation market. Increasingly, platforms emerge as facilitators for this kind of collaborative transportation. However, individual actors connected to a platform might refuse to share (parts of) their information due to reasons of competition....journal article 2020
- document
-
van der Blij, N.H. (author), Purgat, P. (author), Soeiro, Thiago B. (author), Ramirez Elizondo, L.M. (author), Spaan, M.T.J. (author), Bauer, P. (author)Since the voltages and currents in dc grids do not have a natural zero-crossing, the protection of these grids is more challenging than the protection of conventional ac grids. Literature presents several unit and non-unit protection schemes that rely on communication, or knowledge about the system's topology and parameters in order to...journal article 2020
- document
-
van den Boomen, M. (author), Spaan, M.T.J. (author), Shang, Y. (author), Wolfert, A.R.M. (author)Infrastructure maintenance and replacement decisions are subject to uncertainties such as regular asset degradation, structural failure, and price uncertainty. In the engineering domain, Markov Decision Processes (MDPs) typically focus on uncertainties regarding asset degradation and structural failure. While the literature in the engineering...journal article 2020
- document
-
de Nijs, F. (author), Walraven, E.M.P. (author), de Weerdt, M.M. (author), Spaan, M.T.J. (author)In domains such as electric vehicle charging, smart distribution grids and autonomous warehouses, multiple agents share the same resources. When planning the use of these resources, agents need to deal with the uncertainty in these domains. Although several models and algorithms for such constrained multiagent planning problems under...journal article 2021
- document
-
Los, J. (author), Schulte, F. (author), Gansterer, Margaretha (author), Hartl, Richard F. (author), Spaan, M.T.J. (author), Negenborn, R.R. (author)Carriers can remarkably reduce transportation costs and emissions when they collaborate, for example through a platform. Such gains, however, have only been investigated for relatively small problem instances with low numbers of carriers. We develop auction-based methods for large-scale dynamic collaborative pickup and delivery problems,...journal article 2022
- document
-
Yang, Q. (author), Simão, T. D. (author), Tindemans, Simon H. (author), Spaan, M.T.J. (author)Safety is critical to broadening the real-world use of reinforcement learning. Modeling the safety aspects using a safety-cost signal separate from the reward and bounding the expected safety-cost is becoming standard practice, since it avoids the problem of finding a good balance between safety and performance. However, it can be risky to set...journal article 2022
Pages
- 1
- 2