English
Related papers

Related papers: Policy-Gradient Algorithms Have No Guarantees of C…

200 papers

Under mild regularity conditions, gradient-based methods converge globally to a critical point in the single-loss setting. This is known to break down for vanilla gradient descent when moving to multi-loss optimization, but can we hope to…

Optimization and Control · Mathematics 2021-01-19 Alistair Letcher

We present a new approach to solving games with a countably or uncountably infinite number of players. Such games are often used to model multiagent systems with a large number of agents. The latter are frequently encountered in economics,…

Computer Science and Game Theory · Computer Science 2025-01-17 Carlos Martin , Tuomas Sandholm

We are concerned with finding Nash Equilibria in agent-based multi-cluster games, where agents are separated into distinct clusters. While the agents inside each cluster collaborate to achieve a common goal, the clusters are considered to…

Systems and Control · Electrical Eng. & Systems 2021-02-19 Jan Zimmermann , Tatiana Tatarenko , Volker Willert , Jürgen Adamy

Distributed Nash equilibrium (NE) seeking problem for multi-coalition games has attracted increasing attention in recent years, but the research mainly focuses on the case without agreement demand within coalitions. This paper considers a…

Optimization and Control · Mathematics 2021-12-10 Jialing Zhou , Yuezu Lv , Guanghui Wen , Jinhu Lv , Dezhi Zheng

Game-theoretic approaches and Nash equilibrium have been widely applied across various engineering domains. However, practical challenges such as disturbances, delays, and actuator limitations can hinder the precise execution of Nash…

Computer Science and Game Theory · Computer Science 2026-03-17 Mahdis Rabbani , Navid Mojahed , Shima Nazari

We study infinite-horizon discounted two-player zero-sum Markov games, and develop a decentralized algorithm that provably converges to the set of Nash equilibria under self-play. Our algorithm is based on running an Optimistic Gradient…

Machine Learning · Computer Science 2021-07-08 Chen-Yu Wei , Chung-Wei Lee , Mengxiao Zhang , Haipeng Luo

We address in this paper Reinforcement Learning (RL) among agents that are grouped into teams such that there is cooperation within each team but general-sum (non-zero sum) competition across different teams. To develop an RL method that…

Machine Learning · Computer Science 2025-02-11 Muhammad Aneeq uz Zaman , Alec Koppel , Mathieu Laurière , Tamer Başar

The theory of quantum games permits players to choose strategies that prepare and measure quantum states. Whereas conventional game theory provides guarantees for fixed-point stability in non-cooperative games, so-called Nash equilibria, we…

Quantum Physics · Physics 2017-12-13 Faisal Shah Khan , Travis S. Humble

Equilibria of realistic multiplayer games constitute a key solution concept both in practical applications, such as online advertising auctions and electricity markets, and in analytical frameworks used to study strategic voting in…

Computer Science and Game Theory · Computer Science 2025-11-18 Jakub Černý , Shuvomoy Das Gupta , Christian Kroer

This paper is concerned with complexity theoretic aspects of a general formulation of quantum game theory that models strategic interactions among rational agents that process and exchange quantum information. In particular, we prove that…

Computational Complexity · Computer Science 2022-12-28 John Bostanci , John Watrous

Cooperative games are those in which both agents share the same payoff structure. Value-based reinforcement-learning algorithms, such as variants of Q-learning, have been applied to learning cooperative games, but they only apply when the…

Machine Learning · Computer Science 2017-05-25 Leonid Peshkin , Kee-Eung Kim , Nicolas Meuleau , Leslie Pack Kaelbling

Cooperative games are those in which both agents share the same payoff structure. Value-based reinforcement-learning algorithms, such as variants of Q-learning, have been applied to learning cooperative games, but they only apply when the…

Artificial Intelligence · Computer Science 2014-08-08 Leonid Peshkin , Kee-Eung Kim , Nicolas Meuleau , Leslie Pack Kaelbling

In this paper, we study the problem of learning the set of pure strategy Nash equilibria and the exact structure of a continuous-action graphical game with quadratic payoffs by observing a small set of perturbed equilibria. A…

Computer Science and Game Theory · Computer Science 2019-11-12 Adarsh Barik , Jean Honorio

Dynamic games can be an effective approach to modeling interactive behavior between multiple non-cooperative agents and they provide a theoretical framework for simultaneous prediction and control in such scenarios. In this work, we propose…

Systems and Control · Electrical Eng. & Systems 2022-09-19 Edward L. Zhu , Francesco Borrelli

Game theory provides a well-established framework for the analysis of concurrent and multi-agent systems. The basic idea is that concurrent processes (agents) can be understood as corresponding to players in a game; plays represent the…

Logic in Computer Science · Computer Science 2023-06-22 Julian Gutierrez , Paul Harrenstein , Giuseppe Perelli , Michael Wooldridge

We examine the long-run behavior of multi-agent online learning in games that evolve over time. Specifically, we focus on a wide class of policies based on mirror descent, and we show that the induced sequence of play (a) converges to Nash…

Computer Science and Game Theory · Computer Science 2022-08-11 Benoit Duvocelle , Panayotis Mertikopoulos , Mathias Staudigl , Dries Vermeulen

This paper considers data-based solutions of linear-quadratic nonzero-sum differential games. Two cases are considered. First, the deterministic game is solved and Nash equilibrium strategies are obtained by using persistently excited data…

Systems and Control · Electrical Eng. & Systems 2026-05-15 Victor G. Lopez , Matthias A. Müller

Policy gradient methods, where one searches for the policy of interest by maximizing the value functions using first-order information, become increasingly popular for sequential decision making in reinforcement learning, games, and…

Optimization and Control · Mathematics 2023-10-10 Shicong Cen , Yuejie Chi

We investigate Nash equilibrium learning in a competitive Markov Game (MG) environment, where multiple agents compete, and multiple Nash equilibria can exist. In particular, for an oligopolistic dynamic pricing environment, exact Nash…

Computer Science and Game Theory · Computer Science 2024-03-05 Larkin Liu

In this work, we introduce a new variant of online gradient descent, which provably converges to Nash Equilibria and simultaneously attains sublinear regret for the class of congestion games in the semi-bandit feedback setting. Our proposed…

Computer Science and Game Theory · Computer Science 2023-06-28 Ioannis Panageas , Stratis Skoulakis , Luca Viano , Xiao Wang , Volkan Cevher