English
Related papers

Related papers: No-Regret Learning in Bayesian Games

200 papers

A recent line of work has established uncoupled learning dynamics such that, when employed by all players in a game, each player's \emph{regret} after $T$ repetitions grows polylogarithmically in $T$, an exponential improvement over the…

Computer Science and Game Theory · Computer Science 2022-10-18 Gabriele Farina , Ioannis Anagnostides , Haipeng Luo , Chung-Wei Lee , Christian Kroer , Tuomas Sandholm

The designs of many large-scale systems today, from traffic routing environments to smart grids, rely on game-theoretic equilibrium concepts. However, as the size of an $N$-player game typically grows exponentially with $N$, standard game…

Computer Science and Game Theory · Computer Science 2022-08-23 Paul Muller , Romuald Elie , Mark Rowland , Mathieu Lauriere , Julien Perolat , Sarah Perrin , Matthieu Geist , Georgios Piliouras , Olivier Pietquin , Karl Tuyls

Different types of dynamics have been studied in repeated game play, and one of them which has received much attention recently consists of those based on "no-regret" algorithms from the area of machine learning. It is known that dynamics…

Computer Science and Game Theory · Computer Science 2016-10-14 Po-An Chen , Chi-Jen Lu

We give a simple proof of the well-known result that the marginal strategies of a coarse correlated equilibrium form a Nash equilibrium in two-player zero-sum games. A corollary of this fact is that no-external-regret learning algorithms…

Computer Science and Game Theory · Computer Science 2023-10-18 Revan MacQueen

This paper investigates the challenge of learning in black-box games, where the underlying utility function is unknown to any of the agents. While there is an extensive body of literature on the theoretical analysis of algorithms for…

Machine Learning · Computer Science 2024-11-15 Minbiao Han , Fengxue Zhang , Yuxin Chen

Covering and packing problems can be modeled as games to encapsulate interesting social and engineering settings. These games have a high Price of Anarchy in their natural formulation. However, existing research applicable to specific…

Computer Science and Game Theory · Computer Science 2011-09-19 Maria-Florina Balcan , Sara Krehbiel , Georgios Piliouras , Jinwoo Shin

The long-run behavior of multi-agent learning - and, in particular, no-regret learning - is relatively well-understood in potential games, where players have aligned interests. By contrast, in harmonic games - the strategic counterpart of…

Computer Science and Game Theory · Computer Science 2024-12-31 Davide Legacci , Panayotis Mertikopoulos , Christos H. Papadimitriou , Georgios Piliouras , Bary S. R. Pradelski

In this paper, we consider a distributed Bayesian Nash equilibrium (BNE) seeking problem in incomplete-information aggregative games, which is a generalization of Bayesian games and deterministic aggregative games. We handle the aggregation…

Optimization and Control · Mathematics 2023-09-19 Hanzheng Zhang , Guanpu Chen , Huashu Qin

In this paper, we examine the Nash equilibrium convergence properties of no-regret learning in general N-player games. For concreteness, we focus on the archetypal follow the regularized leader (FTRL) family of algorithms, and we consider…

Computer Science and Game Theory · Computer Science 2021-02-05 Angeliki Giannou , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Panayotis Mertikopoulos

We consider a number of questions related to tradeoffs between reward and regret in repeated gameplay between two agents. To facilitate this, we introduce a notion of $\textit{generalized equilibrium}$ which allows for asymmetric regret…

Computer Science and Game Theory · Computer Science 2023-12-19 William Brown , Jon Schneider , Kiran Vodrahalli

We propose efficient no-regret learning dynamics and ellipsoid-based methods for computing linear correlated equilibria$\unicode{x2014}$a relaxation of correlated equilibria and a strengthening of coarse correlated…

Computer Science and Game Theory · Computer Science 2024-12-31 Constantinos Daskalakis , Gabriele Farina , Maxwell Fishelson , Charilaos Pipis , Jon Schneider

A recent body of experimental literature has studied empirical game-theoretical analysis, in which we have partial knowledge of a game, consisting of observations of a subset of the pure-strategy profiles and their associated payoffs to…

Computer Science and Game Theory · Computer Science 2014-02-13 John Fearnley , Martin Gairing , Paul Goldberg , Rahul Savani

Nash equilibrium is perhaps the best-known solution concept in game theory. Such a solution assigns a strategy to each player which offers no incentive to unilaterally deviate. While a Nash equilibrium is guaranteed to always exist, the…

Computer Science and Game Theory · Computer Science 2025-04-29 David Sychrovský , Christopher Solinas , Revan MacQueen , Kevin Wang , James R. Wright , Nathan R. Sturtevant , Michael Bowling

We tackle a fundamental problem in empirical game-theoretic analysis (EGTA), that of learning equilibria of simulation-based games. Such games cannot be described in analytical form; instead, a black-box simulator can be queried to obtain…

Computer Science and Game Theory · Computer Science 2019-06-03 Enrique Areyan Viqueira , Cyrus Cousins , Eli Upfal , Amy Greenwald

We consider distributed learning problem in games with an unknown cost-relevant parameter, and aim to find the Nash equilibrium while learning the true parameter. Inspired by the social learning literature, we propose a distributed…

Optimization and Control · Mathematics 2023-03-14 Shijie Huang , Jinlong Lei , Yiguang Hong

In this tutorial article, we give an overview of new challenges and representative results on distributed no-regret learning in multi-agent systems modeled as repeated unknown games. Four emerging game characteristics---dynamicity,…

Computer Science and Game Theory · Computer Science 2020-02-24 Xiao Xu , Qing Zhao

We consider the problem of simultaneous learning in stochastic games with many players in the finite-horizon setting. While the typical target solution for a stochastic game is a Nash equilibrium, this is intractable with many players. We…

Computer Science and Game Theory · Computer Science 2022-10-27 William Brown

No-regret learners seek to minimize the difference between the loss they cumulated through the actions they played, and the loss they would have cumulated in hindsight had they consistently modified their behavior according to some strategy…

Computer Science and Game Theory · Computer Science 2023-11-09 Gabriele Farina , Charilaos Pipis

We formulate and study a general time-varying multi-agent system where players repeatedly compete under incomplete information. Our work is motivated by scenarios commonly observed in online advertising and retail marketplaces, where agents…

Computer Science and Game Theory · Computer Science 2025-05-27 Ludovico Crippa , Yonatan Gur , Bar Light

A line of recent work provides welfare guarantees of simple combinatorial auction formats, such as selling m items via simultaneous second price auctions (SiSPAs) (Christodoulou et al. 2008, Bhawalkar and Roughgarden 2011, Feldman et al.…

Computer Science and Game Theory · Computer Science 2016-04-07 Constantinos Daskalakis , Vasilis Syrgkanis