English
Related papers

Related papers: On the Convergence of No-Regret Learning Dynamics …

200 papers

In game-theoretic learning, several agents are simultaneously following their individual interests, so the environment is non-stationary from each player's perspective. In this context, the performance of a learning algorithm is often…

Computer Science and Game Theory · Computer Science 2021-10-19 Yu-Guan Hsieh , Kimon Antonakopoulos , Panayotis Mertikopoulos

We study the problem of no-regret learning algorithms for general monotone and smooth games and their last-iterate convergence properties. Specifically, we investigate the problem under bandit feedback and strongly uncoupled dynamics, which…

Computer Science and Game Theory · Computer Science 2024-08-19 Jing Dong , Baoxiang Wang , Yaoliang Yu

Online gradient descent (OGD) is well known to be doubly optimal under strong convexity or monotonicity assumptions: (1) in the single-agent setting, it achieves an optimal regret of $\Theta(\log T)$ for strongly convex cost functions; and…

Computer Science and Game Theory · Computer Science 2024-04-01 Michael I. Jordan , Tianyi Lin , Zhengyuan Zhou

We consider online learning in multi-player smooth monotone games. Existing algorithms have limitations such as (1) being only applicable to strongly monotone games; (2) lacking the no-regret guarantee; (3) having only asymptotic or slow…

Machine Learning · Computer Science 2023-09-06 Yang Cai , Weiqiang Zheng

This paper considers no-regret learning for repeated continuous-kernel games with lossy bandit feedback. Since it is difficult to give the explicit model of the utility functions in dynamic environments, the players' action can only be…

Machine Learning · Computer Science 2022-05-17 Wenting Liu , Jinlong Lei , Peng Yi , Yiguang Hong

This paper examines the convergence of no-regret learning in games with continuous action sets. For concreteness, we focus on learning via "dual averaging", a widely used class of no-regret learning schemes where players take small steps…

Optimization and Control · Mathematics 2018-01-17 Panayotis Mertikopoulos , Zhengyuan Zhou

A recent line of work has established uncoupled learning dynamics such that, when employed by all players in a game, each player's \emph{regret} after $T$ repetitions grows polylogarithmically in $T$, an exponential improvement over the…

Computer Science and Game Theory · Computer Science 2022-10-18 Gabriele Farina , Ioannis Anagnostides , Haipeng Luo , Chung-Wei Lee , Christian Kroer , Tuomas Sandholm

Most existing results about \emph{last-iterate convergence} of learning dynamics are limited to two-player zero-sum games, and only apply under rigid assumptions about what dynamics the players follow. In this paper we provide new results…

Computer Science and Game Theory · Computer Science 2022-03-24 Ioannis Anagnostides , Ioannis Panageas , Gabriele Farina , Tuomas Sandholm

We study the question of obtaining last-iterate convergence rates for no-regret learning algorithms in multi-player games. We show that the optimistic gradient (OG) algorithm with a constant step-size, which is no-regret, achieves a…

Machine Learning · Computer Science 2020-10-27 Noah Golowich , Sarath Pattathil , Constantinos Daskalakis

In this paper, we consider multi-agent learning via online gradient descent in a class of games called $\lambda$-cocoercive games, a fairly broad class of games that admits many Nash equilibria and that properly includes unconstrained…

Optimization and Control · Mathematics 2021-07-20 Tianyi Lin , Zhengyuan Zhou , Panayotis Mertikopoulos , Michael I. Jordan

Last-iterate convergence has received extensive study in two player zero-sum games starting from bilinear, convex-concave up to settings that satisfy the MVI condition. Typical methods that exhibit last-iterate convergence for the…

Computer Science and Game Theory · Computer Science 2023-10-05 Yi Feng , Hu Fu , Qun Hu , Ping Li , Ioannis Panageas , Bo Peng , Xiao Wang

The behavior of no-regret learning algorithms is well understood in two-player min-max (i.e, zero-sum) games. In this paper, we investigate the behavior of no-regret learning in min-max games with dependent strategy sets, where the strategy…

Computer Science and Game Theory · Computer Science 2022-04-15 Denizalp Goktas , Jiayi Zhao , Amy Greenwald

We show that, for any sufficiently small fixed $\epsilon > 0$, when both players in a general-sum two-player (bimatrix) game employ optimistic mirror descent (OMD) with smooth regularization, learning rate $\eta = O(\epsilon^2)$ and $T =…

Computer Science and Game Theory · Computer Science 2022-10-10 Ioannis Anagnostides , Gabriele Farina , Ioannis Panageas , Tuomas Sandholm

No-regret learning has been widely used to compute a Nash equilibrium in two-person zero-sum games. However, there is still a lack of regret analysis for network stochastic zero-sum games, where players competing in two subnetworks only…

Optimization and Control · Mathematics 2022-05-31 Shijie Huang , Jinlong Lei , Yiguang Hong

In this work, we introduce the concept of non-negative weighted regret, an extension of non-negative regret \cite{anagnostides2022last} in games. Investigating games with non-negative weighted regret helps us to understand games with…

Computer Science and Game Theory · Computer Science 2025-05-22 Nanxiang Zhou , Jing Dong , Baoxiang Wang

We show that Optimistic Hedge -- a common variant of multiplicative-weights-updates with recency bias -- attains ${\rm poly}(\log T)$ regret in multi-player general-sum games. In particular, when every player of the game uses Optimistic…

Machine Learning · Computer Science 2023-01-26 Constantinos Daskalakis , Maxwell Fishelson , Noah Golowich

Learning from repeated play in a fixed two-player zero-sum game is a classic problem in game theory and online learning. We consider a variant of this problem where the game payoff matrix changes over time, possibly in an adversarial…

Machine Learning · Computer Science 2022-02-01 Mengxiao Zhang , Peng Zhao , Haipeng Luo , Zhi-Hua Zhou

Learning and computation of equilibria are central problems in game theory, theory of computation, and artificial intelligence. In this work, we introduce proximal regret, a new notion of regret based on proximal operators that lies…

Computer Science and Game Theory · Computer Science 2025-11-06 Yang Cai , Constantinos Daskalakis , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

Different types of dynamics have been studied in repeated game play, and one of them which has received much attention recently consists of those based on "no-regret" algorithms from the area of machine learning. It is known that dynamics…

Computer Science and Game Theory · Computer Science 2016-10-14 Po-An Chen , Chi-Jen Lu

Scale-invariance in games has recently emerged as a widely valued desirable property. Yet, almost all fast convergence guarantees in learning in games require prior knowledge of the utility scale. To address this, we develop learning…

Computer Science and Game Theory · Computer Science 2026-02-13 Taira Tsuchiya , Haipeng Luo , Shinji Ito
‹ Prev 1 2 3 10 Next ›