- document
-
de Nijs, F. (author), Walraven, E.M.P. (author), de Weerdt, M.M. (author), Spaan, M.T.J. (author)In domains such as electric vehicle charging, smart distribution grids and autonomous warehouses, multiple agents share the same resources. When planning the use of these resources, agents need to deal with the uncertainty in these domains. Although several models and algorithms for such constrained multiagent planning problems under...journal article 2021
- document
-
Neustroev, G. (author), Ponnambalam, C.T. (author), de Weerdt, M.M. (author), Spaan, M.T.J. (author)Reinforcement learning requires exploration, leading to repeated execution of sub-optimal actions. Naive exploration techniques address this problem by changing gradually from exploration to exploitation. This approach employs a wide search resulting in exhaustive exploration and low sample-efficiency. More advanced search methods explore...conference paper 2020
- document
-
Ponnambalam, C.T. (author), Oliehoek, F.A. (author), Spaan, M.T.J. (author)The goal in behavior cloning is to extract meaningful information from expertdemonstrations and reproduce the same behavior autonomously. However, theavailable data is unlikely to exhaustively cover the potential problem space. As aresult, the quality of automated decision making is compromised without elegantways to handle the encountering of...conference paper 2020
- document
-
van der Blij, N.H. (author), Ramirez Elizondo, L.M. (author), Spaan, M.T.J. (author), Bauer, P. (author)Due to the distributed nature of future electrical power systems, decentralized control is essential for these grids. This paper shows that converters that have identical voltage thresholds switch off simultaneously even if some could have remained operational. Therefore, inadequate system and energy utilization can occur when decentralized...journal article 2020
- document
-
Los, J. (author), Schulte, F. (author), Spaan, M.T.J. (author), Negenborn, R.R. (author)The transportation market requires collaboration to improve efficiency and reduce emissions. Individual carriers, however, might be hesitant to share their private information on a transportation platform. Although a few articles have investigated the value of information sharing, they assume identical behaviour of all carriers. In practice,...journal article 2020
- document
-
Scharpff, J.C.D. (author), Schraven, D.F.J. (author), Volker, Leentje (author), Spaan, M.T.J. (author), de Weerdt, M.M. (author)The next step in the use of innovative, dynamic and performance-based contracts for service delivery by contractors could be use of monetary incentives to stimulate self-regulation of the network. Because it is currently unclear how performance-based payments in network tenders can effectively encourage network members to coordinate their own...journal article 2020
- document
-
Los, J. (author), Schulte, F. (author), Spaan, M.T.J. (author), Negenborn, R.R. (author)Cooperation is important in order to find efficient vehicle routing solutions for the growing transportation market. Increasingly, platforms emerge as facilitators for this kind of collaborative transportation. However, individual actors connected to a platform might refuse to share (parts of) their information due to reasons of competition....journal article 2020
- document
-
van der Blij, N.H. (author), Purgat, P. (author), Soeiro, Thiago B. (author), Ramirez Elizondo, L.M. (author), Spaan, M.T.J. (author), Bauer, P. (author)Since the voltages and currents in dc grids do not have a natural zero-crossing, the protection of these grids is more challenging than the protection of conventional ac grids. Literature presents several unit and non-unit protection schemes that rely on communication, or knowledge about the system's topology and parameters in order to...journal article 2020
- document
-
van den Boomen, M. (author), Spaan, M.T.J. (author), Shang, Y. (author), Wolfert, A.R.M. (author)Infrastructure maintenance and replacement decisions are subject to uncertainties such as regular asset degradation, structural failure, and price uncertainty. In the engineering domain, Markov Decision Processes (MDPs) typically focus on uncertainties regarding asset degradation and structural failure. While the literature in the engineering...journal article 2020
- document
-
Los, J. (author), Schulte, F. (author), Gansterer, Margaretha (author), Hartl, Richard F. (author), Spaan, M.T.J. (author), Negenborn, R.R. (author)While collaborative vehicle routing has a significant potential to reduce transportation costs and emissions, current approaches are limited in terms of applicability, unrealistic assumptions, and low scalability. Centralized planning generally assumes full information and full control, which is often unacceptable for individual carriers....conference paper 2020
- document
-
Scharpff, J.C.D. (author), Schraven, D.F.J. (author), Volker, Leentje (author), Spaan, M.T.J. (author), de Weerdt, M.M. (author)This white paper describes the Road Maintenance Planning game, a game that simulates planning, coordination and execution of maintenance projects in the domain of infrastructural maintenance. In particular, the game models the dynamic contracting procedure of Volker et al. (2014), an innovative way of contracting public works to a team group of...other 2019
- document
-
Walraven, E.M.P. (author), Spaan, M.T.J. (author)Partially Observable Markov Decision Processes (POMDPs) are a popular formalism for sequential decision making in partially observable environments. Since solving POMDPs to optimality is a difficult task, point-based value iteration methods are widely used. These methods compute an approximate POMDP solution, and in some cases they even provide...journal article 2019
- document
-
Ter Berg, C.J.A. (author), Leontaris, G. (author), van den Boomen, M. (author), Spaan, M.T.J. (author), Wolfert, A.R.M. (author)The optimal moment at which maintenance activities should be performed on structures with long service-life to guarantee the required quality of service is hard to define, due to uncertainties in their deterioration processes. Most of the developed methods and concepts use historical data to predict the deterioration process with deterministic...journal article 2019
- document
-
van den Boomen, M. (author), Spaan, M.T.J. (author), Schoenmaker, R. (author), Wolfert, A.R.M. (author)Managerial flexibility in infrastructure investment and replacement decisions adds value. Real options analysis (ROA) captures this value under uncertain market prices. The concept of ROA is that future unfavourable payoffs can be deferred as soon as more information about market prices becomes available. The popularity of ROA is seen in a...journal article 2019
- document
-
de Nijs, F. (author), de Weerdt, M.M. (author), Spaan, M.T.J. (author)Demand response refers to the concept that power consumption should aim to match supply, instead of supply following demand. It is a key technology to enable the successful transition to an electricity system that incorporates more and more intermittent and uncontrollable renewable energy sources. For instance, loads such as heat pumps or...book chapter 2019
- document
-
de Nijs, F. (author), Theocharous, Georgios (author), Vlassis, Nikos (author), de Weerdt, M.M. (author), Spaan, M.T.J. (author)Personalized recommendations are increasingly important to engage users and guide them through large systems, for example when recommending points of interest to tourists visiting a popular city. To maximize long-term user experience, the system should consider issuing recommendations sequentially, since by observing the user's response to a...conference paper 2018
- document
-
van der Blij, N.H. (author), Ramirez Elizondo, L.M. (author), Spaan, M.T.J. (author), Bauer, P. (author)Many modelling methods for the analysis of dc distribution grids only consider monopolar configurations and do not allow for mutual couplings to be taken into account. The modelling method presented in this paper aims to deal with both of these issues. A state-space approach was chosen for its flexibility and computational speed. The derived...journal article 2018
- document
-
van der Blij, N.H. (author), Ramirez Elizondo, L.M. (author), Spaan, M.T.J. (author), Bauer, P. (author)Employing bipolar dc distribution systems introduces the possibility of imbalance in the system. To analyze these systems it is crucial to create novel modelling techniques. This paper presents a method to decompose dc distribution systems into symmetrical components. The presented method simplifies the analysis of balanced, unbalanced, and...journal article 2018
- document
-
de Nijs, F. (author), Spaan, M.T.J. (author), de Weerdt, M.M. (author)Resource constraints frequently complicate multi-agent planning problems. Existing algorithms for resource-constrained, multi-agent planning problems rely on the assumption that the constraints are deterministic. However, frequently resource constraints are themselves subject to uncertainty from external influences. Uncertainty about constraints...conference paper 2018
- document
-
Satsangi, Yash (author), Whiteson, Shimon (author), Oliehoek, F.A. (author), Spaan, M.T.J. (author)In active perception tasks, an agent aims to select sensory actions that reduce its uncertainty about one or more hidden variables. For example, a mobile robot takes sensory actions to efficiently navigate in a new environment. While partially observable Markov decision processes (POMDPs) provide a natural model for such problems, reward...journal article 2018