中文
相关论文

相关论文: Faster No-Regret Learning Dynamics for Extensive-F…

200 篇论文

A natural goal in multiagent learning besides finding equilibria is to learn rationalizable behavior, where players learn to avoid iteratively dominated actions. However, even in the basic setting of multiplayer general-sum games, existing…

机器学习 · 计算机科学 2022-10-21 Yuanhao Wang , Dingwen Kong , Yu Bai , Chi Jin

The Nash Equilibrium (NE) assumes rational play in imperfect-information Extensive-Form Games (EFGs) but fails to ensure optimal strategies for off-equilibrium branches of the game tree, potentially leading to suboptimal outcomes in…

计算机科学与博弈论 · 计算机科学 2025-08-12 Hang Ren , Xiaozhen Sun , Tianzi Ma , Jiajia Zhang , Xuan Wang

Hindsight rationality is an approach to playing general-sum games that prescribes no-regret learning dynamics for individual agents with respect to a set of deviations, and further describes jointly rational behavior among multiple agents…

计算机科学与博弈论 · 计算机科学 2022-06-24 Dustin Morrill , Ryan D'Orazio , Marc Lanctot , James R. Wright , Michael Bowling , Amy Greenwald

Learning in games refers to scenarios where multiple players interact in a shared environment, each aiming to minimize their regret. An equilibrium can be computed at a fast rate of $O(1/T)$ when all players follow the optimistic…

计算机科学与博弈论 · 计算机科学 2025-02-18 Taira Tsuchiya , Shinji Ito , Haipeng Luo

A celebrated result in the interface of online learning and game theory guarantees that the repeated interaction of no-regret players leads to a coarse correlated equilibrium (CCE) -- a natural game-theoretic solution concept. Despite the…

计算机科学与博弈论 · 计算机科学 2024-11-05 Ioannis Anagnostides , Alkis Kalavasis , Tuomas Sandholm

In the context of multi-player, general-sum games, there is an increasing interest in solution concepts modeling some form of communication among players, since they can lead to socially better outcomes with respect to Nash equilibria, and…

计算机科学与博弈论 · 计算机科学 2019-10-15 Andrea Celli , Alberto Marchesi , Tommaso Bianchi , Nicola Gatti

Most of the literature on learning in games has focused on the restrictive setting where the underlying repeated game does not change over time. Much less is known about the convergence of no-regret learning algorithms in dynamic multiagent…

机器学习 · 计算机科学 2023-10-19 Ioannis Anagnostides , Ioannis Panageas , Gabriele Farina , Tuomas Sandholm

We study the problem of no-regret learning algorithms for general monotone and smooth games and their last-iterate convergence properties. Specifically, we investigate the problem under bandit feedback and strongly uncoupled dynamics, which…

计算机科学与博弈论 · 计算机科学 2024-08-19 Jing Dong , Baoxiang Wang , Yaoliang Yu

The literature on game-theoretic equilibrium finding predominantly focuses on single games or their repeated play. Nevertheless, numerous real-world scenarios feature playing a game sampled from a distribution of similar, but not identical…

计算机科学与博弈论 · 计算机科学 2024-02-21 David Sychrovský , Michal Šustr , Elnaz Davoodi , Michael Bowling , Marc Lanctot , Martin Schmid

Understanding the behavior of no-regret dynamics in general $N$-player games is a fundamental question in online learning and game theory. A folk result in the field states that, in finite games, the empirical frequency of play under…

This paper examines the convergence of no-regret learning in games with continuous action sets. For concreteness, we focus on learning via "dual averaging", a widely used class of no-regret learning schemes where players take small steps…

最优化与控制 · 数学 2018-01-17 Panayotis Mertikopoulos , Zhengyuan Zhou

We investigate two notions of correlated equilibrium for extensive-form games: extensive-form correlated equilibrium (EFCE) and behavioral correlated equilibrium (BCE). We show that the two are outcome-equivalent, in the sense that every…

计算机科学与博弈论 · 计算机科学 2024-02-09 Brian Hu Zhang , Tuomas Sandholm

A celebrated connection in the interface of online learning and game theory establishes that players minimizing swap regret converge to correlated equilibria (CE) -- a seminal game-theoretic solution concept. Despite the long history of…

计算机科学与博弈论 · 计算机科学 2024-11-05 Ioannis Anagnostides , Alkis Kalavasis , Tuomas Sandholm

We show for the first time, to our knowledge, that it is possible to reconcile in online learning in zero-sum games two seemingly contradictory objectives: vanishing time-average regret and non-vanishing step sizes. This phenomenon, that we…

计算机科学与博弈论 · 计算机科学 2019-05-14 James P. Bailey , Georgios Piliouras

As quantum processors advance, the emergence of large-scale decentralized systems involving interacting quantum-enabled agents is on the horizon. Recent research efforts have explored quantum versions of Nash and correlated equilibria as…

计算机科学与博弈论 · 计算机科学 2024-12-18 Wayne Lin , Georgios Piliouras , Ryann Sim , Antonios Varvitsiotis

We examine the problem of regret minimization when the learner is involved in a continuous game with other optimizing agents: in this case, if all players follow a no-regret algorithm, it is possible to achieve significantly lower regret…

计算机科学与博弈论 · 计算机科学 2023-03-20 Yu-Guan Hsieh , Kimon Antonakopoulos , Volkan Cevher , Panayotis Mertikopoulos

No-regret learning has a long history of being closely connected to game theory. Recent works have devised uncoupled no-regret learning dynamics that, when adopted by all the players in normal-form games, converge to various equilibrium…

计算机科学与博弈论 · 计算机科学 2024-04-24 Weichao Mao , Haoran Qiu , Chen Wang , Hubertus Franke , Zbigniew Kalbarczyk , Tamer Başar

We consider the problem of simultaneous learning in stochastic games with many players in the finite-horizon setting. While the typical target solution for a stochastic game is a Nash equilibrium, this is intractable with many players. We…

计算机科学与博弈论 · 计算机科学 2022-10-27 William Brown

Many real-world strategic games involve interactions between multiple players. We study a hierarchical multi-player game structure, where players with asymmetric roles can be separated into leaders and followers, a setting often referred to…

机器学习 · 计算机科学 2022-10-25 Yaolong Yu , Haifeng Xu , Haipeng Chen

Self-play methods based on regret minimization have become the state of the art for computing Nash equilibria in large two-players zero-sum extensive-form games. These methods fundamentally rely on the hierarchical structure of the players'…

计算机科学与博弈论 · 计算机科学 2019-10-29 Gabriele Farina , Chun Kai Ling , Fei Fang , Tuomas Sandholm