中文
相关论文

相关论文: Faster Rates for Convex-Concave Games

200 篇论文

A recent line of work has established uncoupled learning dynamics such that, when employed by all players in a game, each player's \emph{regret} after $T$ repetitions grows polylogarithmically in $T$, an exponential improvement over the…

计算机科学与博弈论 · 计算机科学 2022-10-18 Gabriele Farina , Ioannis Anagnostides , Haipeng Luo , Chung-Wei Lee , Christian Kroer , Tuomas Sandholm

We consider the problem of minimizing a smooth convex function by reducing the optimization to computing the Nash equilibrium of a particular zero-sum convex-concave game. Zero-sum games can be solved using online learning dynamics, where a…

机器学习 · 计算机科学 2018-11-16 Jun-Kun Wang , Jacob Abernethy

We study the question of obtaining last-iterate convergence rates for no-regret learning algorithms in multi-player games. We show that the optimistic gradient (OG) algorithm with a constant step-size, which is no-regret, achieves a…

机器学习 · 计算机科学 2020-10-27 Noah Golowich , Sarath Pattathil , Constantinos Daskalakis

We develop an algorithmic framework for solving convex optimization problems using no-regret game dynamics. By converting the problem of minimizing a convex function into an auxiliary problem of solving a min-max game in a sequential…

机器学习 · 计算机科学 2023-02-21 Jun-Kun Wang , Jacob Abernethy , Kfir Y. Levy

In game-theoretic learning, several agents are simultaneously following their individual interests, so the environment is non-stationary from each player's perspective. In this context, the performance of a learning algorithm is often…

计算机科学与博弈论 · 计算机科学 2021-10-19 Yu-Guan Hsieh , Kimon Antonakopoulos , Panayotis Mertikopoulos

We establish the first uncoupled learning algorithm that attains $O(n \log^2 d \log T)$ per-player regret in multi-player general-sum games, where $n$ is the number of players, $d$ is the number of actions available to each player, and $T$…

计算机科学与博弈论 · 计算机科学 2025-04-01 Ashkan Soleymani , Georgios Piliouras , Gabriele Farina

We consider online learning in multi-player smooth monotone games. Existing algorithms have limitations such as (1) being only applicable to strongly monotone games; (2) lacking the no-regret guarantee; (3) having only asymptotic or slow…

机器学习 · 计算机科学 2023-09-06 Yang Cai , Weiqiang Zheng

In this work, we study potential games and Markov potential games under stochastic cost and bandit feedback. We propose a variant of the Frank-Wolfe algorithm with sufficient exploration and recursive gradient estimation, which provably…

计算机科学与博弈论 · 计算机科学 2024-04-11 Jing Dong , Baoxiang Wang , Yaoliang Yu

In this work, we introduce the concept of non-negative weighted regret, an extension of non-negative regret \cite{anagnostides2022last} in games. Investigating games with non-negative weighted regret helps us to understand games with…

计算机科学与博弈论 · 计算机科学 2025-05-22 Nanxiang Zhou , Jing Dong , Baoxiang Wang

Most of the literature on learning in games has focused on the restrictive setting where the underlying repeated game does not change over time. Much less is known about the convergence of no-regret learning algorithms in dynamic multiagent…

机器学习 · 计算机科学 2023-10-19 Ioannis Anagnostides , Ioannis Panageas , Gabriele Farina , Tuomas Sandholm

We show that natural classes of regularized learning algorithms with a form of recency bias achieve faster convergence rates to approximate efficiency and to coarse correlated equilibria in multiplayer normal form games. When each player in…

计算机科学与博弈论 · 计算机科学 2015-12-14 Vasilis Syrgkanis , Alekh Agarwal , Haipeng Luo , Robert E. Schapire

No-regret learning dynamics play a central role in game theory, enabling decentralized convergence to equilibrium for concepts such as Coarse Correlated Equilibrium (CCE) or Correlated Equilibrium (CE). In this work, we improve the…

计算机科学与博弈论 · 计算机科学 2025-11-05 Asrin Efe Yorulmaz , Tamer Başar

We consider regret minimization in repeated games with non-convex loss functions. Minimizing the standard notion of regret is computationally intractable. Thus, we define a natural notion of regret which permits efficient optimization and…

机器学习 · 计算机科学 2017-11-06 Elad Hazan , Karan Singh , Cyril Zhang

No-regret learning has a long history of being closely connected to game theory. Recent works have devised uncoupled no-regret learning dynamics that, when adopted by all the players in normal-form games, converge to various equilibrium…

计算机科学与博弈论 · 计算机科学 2024-04-24 Weichao Mao , Haoran Qiu , Chen Wang , Hubertus Franke , Zbigniew Kalbarczyk , Tamer Başar

The Frank-Wolfe algorithm achieves a convergence rate of $\mathcal{O}(1/T)$ for smooth convex optimization over compact convex domains, accelerating to $\mathcal{O}(1/T^2)$ when both the objective and the feasible set are strongly convex.…

最优化与控制 · 数学 2026-05-19 Jannis Halbey , Christophe Roux , Sebastian Pokutta

We study the problem of no-regret learning algorithms for general monotone and smooth games and their last-iterate convergence properties. Specifically, we investigate the problem under bandit feedback and strongly uncoupled dynamics, which…

计算机科学与博弈论 · 计算机科学 2024-08-19 Jing Dong , Baoxiang Wang , Yaoliang Yu

We show that Optimistic Hedge -- a common variant of multiplicative-weights-updates with recency bias -- attains ${\rm poly}(\log T)$ regret in multi-player general-sum games. In particular, when every player of the game uses Optimistic…

机器学习 · 计算机科学 2023-01-26 Constantinos Daskalakis , Maxwell Fishelson , Noah Golowich

Consider a scenario where a player chooses an action in each round $t$ out of $T$ rounds and observes the incurred cost after a delay of $d_{t}$ rounds. The cost functions and the delay sequence are chosen by an adversary. We show that in a…

机器学习 · 计算机科学 2022-05-16 Ilai Bistritz , Zhengyuan Zhou , Xi Chen , Nicholas Bambos , Jose Blanchet

Characterizing the performance of no-regret dynamics in multi-player games is a foundational problem at the interface of online learning and game theory. Recent results have revealed that when all players adopt specific learning algorithms,…

计算机科学与博弈论 · 计算机科学 2023-11-28 Ioannis Anagnostides , Alkis Kalavasis , Tuomas Sandholm , Manolis Zampetakis

The Frank-Wolfe method solves smooth constrained convex optimization problems at a generic sublinear rate of $\mathcal{O}(1/T)$, and it (or its variants) enjoys accelerated convergence rates for two fundamental classes of constraints:…

最优化与控制 · 数学 2020-06-17 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta
‹ 上一页 1 2 3 10 下一页 ›