English
Related papers

Related papers: Finite-Time Last-Iterate Convergence for Multi-Age…

200 papers

Several widely-used first-order saddle-point optimization methods yield an identical continuous-time ordinary differential equation (ODE) that is identical to that of the Gradient Descent Ascent (GDA) method when derived naively. However,…

Optimization and Control · Mathematics 2023-08-01 Tatjana Chavdarova , Michael I. Jordan , Manolis Zampetakis

Two of the most prominent algorithms for solving unconstrained smooth games are the classical stochastic gradient descent-ascent (SGDA) and the recently introduced stochastic consensus optimization (SCO) [Mescheder et al., 2017]. SGDA is…

Machine Learning · Computer Science 2021-11-05 Nicolas Loizou , Hugo Berard , Gauthier Gidel , Ioannis Mitliagkas , Simon Lacoste-Julien

Competitive non-cooperative online decision-making agents whose actions increase congestion of scarce resources constitute a model for widespread modern large-scale applications. To ensure sustainable resource behavior, we introduce a novel…

Optimization and Control · Mathematics 2020-10-22 Ezra Tampubolon , Holger Boche

A satisfactory multiagent learning algorithm should, {\em at a minimum}, learn to play optimally against stationary opponents and converge to a Nash equilibrium in self-play. The algorithm that has come closest, WoLF-IGA, has been proven to…

Computer Science and Game Theory · Computer Science 2009-09-29 Vincent Conitzer , Tuomas Sandholm

We study the performance of the gradient play algorithm for stochastic games (SGs), where each agent tries to maximize its own total discounted reward by making decisions independently based on current state information which is shared…

Machine Learning · Computer Science 2023-12-08 Runyu Zhang , Zhaolin Ren , Na Li

Motivated by the pursuit of a systematic computational and algorithmic understanding of Generative Adversarial Networks (GANs), we present a simple yet unified non-asymptotic local convergence theory for smooth two-player games, which…

Machine Learning · Statistics 2020-07-27 Tengyuan Liang , James Stokes

In this work, we introduce a new variant of online gradient descent, which provably converges to Nash Equilibria and simultaneously attains sublinear regret for the class of congestion games in the semi-bandit feedback setting. Our proposed…

Computer Science and Game Theory · Computer Science 2023-06-28 Ioannis Panageas , Stratis Skoulakis , Luca Viano , Xiao Wang , Volkan Cevher

In a recent series of papers it has been established that variants of Gradient Descent/Ascent and Mirror Descent exhibit last iterate convergence in convex-concave zero-sum games. Specifically, \cite{DISZ17, LiangS18} show last iterate…

Machine Learning · Computer Science 2025-09-30 Qi Lei , Sai Ganesh Nagarajan , Ioannis Panageas , Xiao Wang

A variety of practical problems can be modeled by the decision-making process in multi-player games where a group of self-interested players aim at optimizing their own local objectives, while the objectives depend on the actions taken by…

Optimization and Control · Mathematics 2023-01-09 Yuanhanqing Huang , Jianghai Hu

In this paper, we consider a learning problem among non-cooperative agents interacting in a time-varying system. Specifically, we focus on repeated linear quadratic network games, in which the network of interactions changes with time and…

Computer Science and Game Theory · Computer Science 2023-10-23 Feras Al Taha , Kiran Rokade , Francesca Parise

The analysis in Part I revealed interesting properties for subgradient learning algorithms in the context of stochastic optimization when gradient noise is present. These algorithms are used when the risk functions are non-smooth and…

Optimization and Control · Mathematics 2017-04-21 Bicheng Ying , Ali H. Sayed

Learning by experience in Multi-Agent Systems (MAS) is a difficult and exciting task, due to the lack of stationarity of the environment, whose dynamics evolves as the population learns. In order to design scalable algorithms for systems…

Optimization and Control · Mathematics 2020-02-24 Romuald Elie , Julien Pérolat , Mathieu Laurière , Matthieu Geist , Olivier Pietquin

In large systems, it is important for agents to learn to act effectively, but sophisticated multi-agent learning algorithms generally do not scale. An alternative approach is to find restricted classes of games where simple, efficient…

Multiagent Systems · Computer Science 2009-03-16 Ian A. Kash , Eric J. Friedman , Joseph Y. Halpern

In this work, we study the interaction of strategic agents in continuous action Cournot games with limited information feedback. Cournot game is the essential market model for many socio-economic systems where agents learn and compete…

Optimization and Control · Mathematics 2020-09-15 Yuanyuan Shi , Baosen Zhang

In this work, we introduce the concept of non-negative weighted regret, an extension of non-negative regret \cite{anagnostides2022last} in games. Investigating games with non-negative weighted regret helps us to understand games with…

Computer Science and Game Theory · Computer Science 2025-05-22 Nanxiang Zhou , Jing Dong , Baoxiang Wang

In this paper, we study multi-agent network games subject to affine time-varying coupling constraints and a time-varying communication network. We focus on the class of games adopting proximal dynamics and study their convergence to a…

Computer Science and Game Theory · Computer Science 2019-11-20 Carlo Cenedese , Giuseppe Belgioioso , Sergio Grammatico , Ming Cao

To model complex real-world systems, such as traders in stock markets, or the dissemination of contagious diseases, graphon mean-field games (GMFG) have been proposed to model many agents. Despite the empirical success, our understanding of…

Computer Science and Game Theory · Computer Science 2024-10-14 Jing Dong , Baoxiang Wang , Yaoliang Yu

We introduce a stochastic learning process called the dampened gradient approximation process. While learning models have almost exclusively focused on finite games, in this paper we design a learning process for games with continuous…

Computer Science and Game Theory · Computer Science 2018-07-02 Sebastian Bervoets , Mario Bravo , Mathieu Faure

Motivated by alternating learning dynamics in two-player games, a recent work by Cevher et al.(2024) shows that $o(\sqrt{T})$ alternating regret is possible for any $T$-round adversarial Online Linear Optimization (OLO) problem, and left as…

Machine Learning · Computer Science 2025-06-19 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang

We consider a class of fully stochastic and fully distributed algorithms, that we prove to learn equilibria in games. Indeed, we consider a family of stochastic distributed dynamics that we prove to converge weakly (in the sense of weak…

Computer Science and Game Theory · Computer Science 2009-07-14 Olivier Bournez , Johanne Cohen