Learning generalized Nash equilibria in multi-agent dynamical systems via extremum seeking control

Journal Article (2021)
Author(s)

S. Krilašević (TU Delft - Team Sergio Grammatico)

S. Grammatico (TU Delft - Team Sergio Grammatico, TU Delft - Team Bart De Schutter)

Research Group
Team Sergio Grammatico
Copyright
© 2021 S. Krilašević, S. Grammatico
DOI related publication
https://doi.org/10.1016/j.automatica.2021.109846
More Info
expand_more
Publication Year
2021
Language
English
Copyright
© 2021 S. Krilašević, S. Grammatico
Research Group
Team Sergio Grammatico
Volume number
133
Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Abstract

In this paper, we consider the problem of learning a generalized Nash equilibrium (GNE) in strongly monotone games. First, we propose semi-decentralized and distributed continuous-time solution algorithms that use regular projections and first-order information to compute a GNE with and without a central coordinator. As the second main contribution, we design a data-driven variant of the former semi-decentralized algorithm where each agent estimates their individual pseudogradient via zeroth-order information, namely, measurements of their individual cost function values, as typical of extremum seeking control. Third, we generalize our setup and results for multi-agent systems with nonlinear dynamics. Finally, we apply our methods to connectivity control in robotic sensor networks and almost-decentralized wind farm optimization.