English
Related papers

Related papers: Fast Convergence of Optimistic Gradient Ascent in …

200 papers

We examine the long-run behavior of multi-agent online learning in games that evolve over time. Specifically, we focus on a wide class of policies based on mirror descent, and we show that the induced sequence of play (a) converges to Nash…

Computer Science and Game Theory · Computer Science 2022-08-11 Benoit Duvocelle , Panayotis Mertikopoulos , Mathias Staudigl , Dries Vermeulen

The two-timescale gradient descent-ascent (GDA) is a canonical gradient algorithm designed to find Nash equilibria in min-max games. We analyze the two-timescale GDA by investigating the effects of learning rate ratios on convergence…

Optimization and Control · Mathematics 2025-10-13 Jing An , Jianfeng Lu

We show that, for any sufficiently small fixed $\epsilon > 0$, when both players in a general-sum two-player (bimatrix) game employ optimistic mirror descent (OMD) with smooth regularization, learning rate $\eta = O(\epsilon^2)$ and $T =…

Computer Science and Game Theory · Computer Science 2022-10-10 Ioannis Anagnostides , Gabriele Farina , Ioannis Panageas , Tuomas Sandholm

In this paper, we propose a passivity-based methodology for analysis and design of reinforcement learning in multi-agent finite games. Starting from a known exponentially-discounted reinforcement learning scheme, we show that convergence to…

Optimization and Control · Mathematics 2024-10-30 Bolin Gao , Lacra Pavel

In this paper, we investigate the power of {\it regularization}, a common technique in reinforcement learning and optimization, in solving extensive-form games (EFGs). We propose a series of new algorithms based on regularizing the payoff…

Computer Science and Game Theory · Computer Science 2025-07-10 Mingyang Liu , Asuman Ozdaglar , Tiancheng Yu , Kaiqing Zhang

We introduce a new algorithm for the numerical computation of Nash equilibria of competitive two-player games. Our method is a natural generalization of gradient descent to the two-player setting where the update is given by the Nash…

Optimization and Control · Mathematics 2020-07-02 Florian Schäfer , Anima Anandkumar

We introduce a new approach for computing optimal equilibria via learning in games. It applies to extensive-form settings with any number of players, including mechanism design, information design, and solution concepts such as correlated,…

Learning in a multi-agent system is challenging because agents are simultaneously learning and the environment is not stationary, undermining convergence guarantees. To address this challenge, this paper presents a new gradient-based…

Multiagent Systems · Computer Science 2019-03-08 Xinliang Song , Tonghan Wang , Chongjie Zhang

We introduce a stochastic learning process called the dampened gradient approximation process. While learning models have almost exclusively focused on finite games, in this paper we design a learning process for games with continuous…

Computer Science and Game Theory · Computer Science 2018-07-02 Sebastian Bervoets , Mario Bravo , Mathieu Faure

We study the question of obtaining last-iterate convergence rates for no-regret learning algorithms in multi-player games. We show that the optimistic gradient (OG) algorithm with a constant step-size, which is no-regret, achieves a…

Machine Learning · Computer Science 2020-10-27 Noah Golowich , Sarath Pattathil , Constantinos Daskalakis

We study online learning and equilibrium computation in games with polyhedral decision sets, a property shared by both normal-form games and extensive-form games (EFGs), when the learning agent is restricted to using a best-response oracle.…

Computer Science and Game Theory · Computer Science 2023-12-07 Darshan Chakrabarti , Gabriele Farina , Christian Kroer

This paper shows the existence of $\mathcal{O}(\frac{1}{n^\gamma})$-Nash equilibria in $n$-player noncooperative sum-aggregative games in which the players' cost functions, depending only on their own action and the average of all players'…

Optimization and Control · Mathematics 2022-09-27 Kang Liu , Nadia Oudjane , Cheng Wan

No-regret learning dynamics play a central role in game theory, enabling decentralized convergence to equilibrium for concepts such as Coarse Correlated Equilibrium (CCE) or Correlated Equilibrium (CE). In this work, we improve the…

Computer Science and Game Theory · Computer Science 2025-11-05 Asrin Efe Yorulmaz , Tamer Başar

Constructing effective algorithms to converge to Nash Equilibrium (NE) is an important problem in algorithmic game theory. Prior research generally posits that the upper bound on the convergence rate for games is $O\left(T^{-1/2}\right)$.…

Computer Science and Game Theory · Computer Science 2024-09-06 Qi Ju , Falin Hei , Yuxuan Liu , Zhemei Fang , Yunfeng Luo

We address learning Nash equilibria in convex games under the payoff information setting. We consider the case in which the game pseudo-gradient is monotone but not necessarily strictly monotone. This relaxation of strict monotonicity…

Optimization and Control · Mathematics 2023-08-17 Tatiana Tatarenko , Maryam Kamgarpour

This paper studies the last-iterate convergence properties of the exponential weights algorithm with constant learning rates. We consider a repeated interaction in discrete time, where each player uses an exponential weights algorithm…

Artificial Intelligence · Computer Science 2024-07-10 Maurizio d'Andrea , Fabien Gensbittel , Jérôme Renault

Offline learning has become widely used due to its ability to derive effective policies from offline datasets gathered by expert demonstrators without interacting with the environment directly. Recent research has explored various ways to…

Computer Science and Game Theory · Computer Science 2024-03-01 Shiqi Lei , Kanghoon Lee , Linjing Li , Jinkyoo Park , Jiachen Li

Motivated by the pursuit of a systematic computational and algorithmic understanding of Generative Adversarial Networks (GANs), we present a simple yet unified non-asymptotic local convergence theory for smooth two-player games, which…

Machine Learning · Statistics 2020-07-27 Tengyuan Liang , James Stokes

Games are natural models for multi-agent machine learning settings, such as generative adversarial networks (GANs). The desirable outcomes from algorithmic interactions in these games are encoded as game theoretic equilibrium concepts, e.g.…

Computer Science and Game Theory · Computer Science 2022-02-25 Gabriel P. Andrade , Rafael Frongillo , Georgios Piliouras

We develop provably efficient reinforcement learning algorithms for two-player zero-sum finite-horizon Markov games with simultaneous moves. To incorporate function approximation, we consider a family of Markov games where the reward…

Machine Learning · Computer Science 2020-06-25 Qiaomin Xie , Yudong Chen , Zhaoran Wang , Zhuoran Yang