Decoupling a Resource Constraint through Fictitious Play in Multi-agent Sequential Decision Making

Conference Paper (2016)
Author(s)

Frits de Nijs (TU Delft - Algorithmics)

Matthijs Spaan (TU Delft - Algorithmics)

Mathijs de Weerdt (TU Delft - Algorithmics)

Research Group
Algorithmics
Copyright
© 2016 F. de Nijs, M.T.J. Spaan, M.M. de Weerdt
DOI related publication
https://doi.org/10.3233/978-1-61499-672-9-1724
More Info
expand_more
Publication Year
2016
Language
English
Copyright
© 2016 F. de Nijs, M.T.J. Spaan, M.M. de Weerdt
Research Group
Algorithmics
Volume number
285
Pages (from-to)
1724-1725
ISBN (print)
978-1-61499-671-2
ISBN (electronic)
978-1-61499-672-9
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

When multiple independent agents use a limited shared resource, they need to coordinate and thereby their planning problems become coupled. We present a resource assignment strategy that decouples agents using marginal utility cost, allowing them to plan individually. We show that agents converge to an expected cost curve by keeping a history of plans, inspired by fictitious play. This performs slightly better than a state-of-the-art best-response approach and is significantly more scalable than a preallocation Mixed-Integer Linear Programming formulation, providing a good trade-off between performance and quality.