English
Related papers

Related papers: Policy Optimization Provably Converges to Nash Equ…

200 papers

Constrained Markov games offer a formal mathematical framework for modeling multi-agent reinforcement learning problems where the behavior of the agents is subject to constraints. In this work, we focus on the recently introduced class of…

Machine Learning · Computer Science 2024-02-29 Philip Jordan , Anas Barakat , Niao He

We consider a subclass of $n$-player stochastic games, in which players have their own internal state/action spaces while they are coupled through their payoff functions. It is assumed that players' internal chains are driven by independent…

Machine Learning · Computer Science 2023-03-23 S. Rasoul Etesami

Network congestion games are a convenient model for reasoning about routing problems in a network: agents have to move from a source to a target vertex while avoiding congestion, measured as a cost depending on the number of players using…

Computer Science and Game Theory · Computer Science 2022-07-05 Aline Goeminne , Nicolas Markey , Ocan Sankur

A recent body of experimental literature has studied empirical game-theoretical analysis, in which we have partial knowledge of a game, consisting of observations of a subset of the pure-strategy profiles and their associated payoffs to…

Computer Science and Game Theory · Computer Science 2014-02-13 John Fearnley , Martin Gairing , Paul Goldberg , Rahul Savani

We introduce a new algorithm for the numerical computation of Nash equilibria of competitive two-player games. Our method is a natural generalization of gradient descent to the two-player setting where the update is given by the Nash…

Optimization and Control · Mathematics 2020-07-02 Florian Schäfer , Anima Anandkumar

Save for some special cases, current training methods for Generative Adversarial Networks (GANs) are at best guaranteed to converge to a `local Nash equilibrium` (LNE). Such LNEs, however, can be arbitrarily far from an actual Nash…

Machine Learning · Computer Science 2019-11-19 Frans A. Oliehoek , Rahul Savani , Jose Gallego , Elise van der Pol , Roderich Groß

We consider structural and algorithmic questions related to the Nash dynamics of weighted congestion games. In weighted congestion games with linear latency functions, the existence of (pure Nash) equilibria is guaranteed by potential…

Computer Science and Game Theory · Computer Science 2011-11-14 Ioannis Caragiannis , Angelo Fanelli , Nick Gravin , Alexander Skopalik

In this article, we consider generalized Nash games where the associated constraint map is not necessarily self. The classical Nash equilibrium may not exist for such games and therefore we introduce the notion of best approximate solution…

Optimization and Control · Mathematics 2022-04-05 Asrifa Sultana , Shivani Valecha

This paper investigates a fully distributed adaptive Nash equilibrium (NE) seeking algorithm for constrained noncooperative games with prescribed-time stability. On the one hand, prescribed-time stability for the proposed NE seeking…

Optimization and Control · Mathematics 2024-11-07 Sichen Qian

We address payoff-based decentralized learning in infinite-horizon zero-sum Markov games. In this setting, each player makes decisions based solely on received rewards, without observing the opponent's strategy or actions nor sharing…

Computer Science and Game Theory · Computer Science 2025-02-11 Reda Ouhamma , Maryam Kamgarpour

Nash equilibrium is a solution concept in non-strictly competitive, non-cooperative game theory that finds applications in various scientific and engineering disciplines. A non-strictly competitive, non-cooperative game model is presented…

Quantum Physics · Physics 2015-02-05 Faisal Shah Khan

In this paper we present a novel generic mapping between Graphical Games and Markov Random Fields so that pure Nash equilibria in the former can be found by statistical inference on the latter. Thus, the problem of deciding whether a…

Computer Science and Game Theory · Computer Science 2007-05-23 Constantinos Daskalakis

We present novel techniques for neuro-symbolic concurrent stochastic games, a recently proposed modelling formalism to represent a set of probabilistic agents operating in a continuous-space environment using a combination of neural network…

Computer Science and Game Theory · Computer Science 2022-06-22 Rui Yan , Gabriel Santos , Xiaoming Duan , David Parker , Marta Kwiatkowska

We propose a reinforcement learning algorithm for stationary mean-field games, where the goal is to learn a pair of mean-field state and stationary policy that constitutes the Nash equilibrium. When viewing the mean-field state and the…

Machine Learning · Computer Science 2020-10-12 Qiaomin Xie , Zhuoran Yang , Zhaoran Wang , Andreea Minca

Nash equilibria and Pareto optimality are two distinct concepts when dealing with multiple criteria. It is well known that the two concepts do not coincide. However, in this work we show that it is possible to characterize the set of all…

Optimization and Control · Mathematics 2022-12-12 Zachary Feinstein , Birgit Rudloff

Finding Nash equilibria in two-player zero-sum imperfect-information games remains a central challenge in multi-agent reinforcement learning. Recent multi-round regularization methods offer a promising direction, yet existing approaches…

Machine Learning · Computer Science 2026-05-01 Eason Yu , Tzu Hao Liu , Clément L. Canonne , Yunke Wang , Chang Xu , Nguyen H. Tran , Stefano V. Albrecht

The designs of many large-scale systems today, from traffic routing environments to smart grids, rely on game-theoretic equilibrium concepts. However, as the size of an $N$-player game typically grows exponentially with $N$, standard game…

Computer Science and Game Theory · Computer Science 2022-08-23 Paul Muller , Romuald Elie , Mark Rowland , Mathieu Lauriere , Julien Perolat , Sarah Perrin , Matthieu Geist , Georgios Piliouras , Olivier Pietquin , Karl Tuyls

While multi-agent reinforcement learning (MARL) has produced numerous algorithms that converge to Nash or related equilibria, such equilibria are often non-unique and can exhibit widely varying efficiency. This raises a fundamental…

Computer Science and Game Theory · Computer Science 2026-01-29 Runyu Zhang , Gioele Zardini , Asuman Ozdaglar , Jeff Shamma , Na Li

While Online Gradient Descent and other no-regret learning procedures are known to efficiently converge to a coarse correlated equilibrium in games where each agent's utility is concave in their own strategy, this is not the case when…

Computer Science and Game Theory · Computer Science 2025-04-22 Yang Cai , Constantinos Daskalakis , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

We consider learning Nash equilibria in two-player zero-sum Markov Games with nonlinear function approximation, where the action-value function is approximated by a function in a Reproducing Kernel Hilbert Space (RKHS). The key challenge is…

Machine Learning · Computer Science 2022-08-11 Chris Junchi Li , Dongruo Zhou , Quanquan Gu , Michael I. Jordan