Decoupling a Resource Constraint through Fictitious Play in Multi-agent Sequential Decision Making
Frits de Nijs (TU Delft - Electrical Engineering, Mathematics and Computer Science)
Matthijs T. J. Spaan (TU Delft - Electrical Engineering, Mathematics and Computer Science)
M.M. de Weerdt (TU Delft - Electrical Engineering, Mathematics and Computer Science)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
When multiple independent agents use a limited shared resource, they need to coordinate and thereby their planning problems become coupled. We present a resource assignment strategy that decouples agents using marginal utility cost, allowing them to plan individually. We show that agents converge to an expected cost curve by keeping a history of plans, inspired by fictitious play. This performs slightly better than a state-of-the-art best-response approach and is significantly more scalable than a preallocation Mixed-Integer Linear Programming formulation, providing a good trade-off between performance and quality.
help_outline