English
Related papers

Related papers: Backward Induction for Repeated Games

200 papers

Two fundamental problems in computational game theory are computing a Nash equilibrium and learning to exploit opponents given observations of their play (opponent exploitation). The latter is perhaps even more important than the former:…

Computer Science and Game Theory · Computer Science 2018-06-29 Sam Ganzfried , Qingyun Sun

We study the amount of entropy players asymptotically need to play a repeated normal-form game in a Nash equilibrium. Hub\'a\v{c}ek, Naor, and Ullman (SAGT'15, TCSys'16) gave sufficient conditions on a game for the minimal amount of…

Computer Science and Game Theory · Computer Science 2023-12-22 Farid Arthaud

Nash equilibrium is a popular solution concept for solving imperfect-information games in practice. However, it has a major drawback: it does not preclude suboptimal play in branches of the game tree that are not reached in equilibrium.…

Computer Science and Game Theory · Computer Science 2017-05-29 Christian Kroer , Gabriele Farina , Tuomas Sandholm

Game theory is a very profound study on distributed decision-making behavior and has been extensively developed by many scholars. However, many existing works rely on certain strict assumptions such as knowing the opponent's private…

Computer Science and Game Theory · Computer Science 2020-04-21 Kuo Chun Tsai , Zhu Han

We use techniques from the statistical mechanics of disordered systems to analyse the properties of Nash equilibria of bimatrix games with large random payoff matrices. By means of an annealed bound, we calculate their number and analyse…

Disordered Systems and Neural Networks · Physics 2009-10-31 Johannes Berg , Martin Weigt

We introduce a stochastic learning process called the dampened gradient approximation process. While learning models have almost exclusively focused on finite games, in this paper we design a learning process for games with continuous…

Computer Science and Game Theory · Computer Science 2018-07-02 Sebastian Bervoets , Mario Bravo , Mathieu Faure

We study infinite-horizon discounted two-player zero-sum Markov games, and develop a decentralized algorithm that provably converges to the set of Nash equilibria under self-play. Our algorithm is based on running an Optimistic Gradient…

Machine Learning · Computer Science 2021-07-08 Chen-Yu Wei , Chung-Wei Lee , Mengxiao Zhang , Haipeng Luo

Since the seminal PPAD-completeness result for computing a Nash equilibrium even in two-player games, an important line of research has focused on relaxations achievable in polynomial time. In this paper, we consider the notion of…

Computer Science and Game Theory · Computer Science 2022-07-15 Argyrios Deligkas , Michail Fasoulakis , Evangelos Markakis

Estimating discrete games of complete information is often computationally difficult due to partial identification and the absence of closed-form moment characterizations. This paper proposes computationally tractable approaches to…

Econometrics · Economics 2025-10-02 Paul S. Koh

We study the deterministic and randomized query complexity of finding approximate equilibria in bimatrix games. We show that the deterministic query complexity of finding an $\epsilon$-Nash equilibrium when $\epsilon < \frac{1}{2}$ is…

Computer Science and Game Theory · Computer Science 2014-02-13 John Fearnley , Rahul Savani

In this letter, we study dynamic game optimal control with imperfect state observations and introduce an iterative method to find a local Nash equilibrium. The algorithm consists of an iterative procedure combining a backward recursion…

Optimization and Control · Mathematics 2022-06-24 Armand Jordana , Bilal Hammoud , Justin Carpentier , Ludovic Righetti

For some well-known games, such as the Traveler's Dilemma or the Centipede Game, traditional game-theoretic solution concepts--and most notably Nash equilibrium--predict outcomes that are not consistent with empirical observations. In this…

Computer Science and Game Theory · Computer Science 2008-10-20 Joseph Y. Halpern , Rafael Pass

Under what conditions do the behaviors of players, who play a game repeatedly, converge to a Nash equilibrium? If one assumes that the players' behavior is a discrete-time or continuous-time rule whereby the current mixed strategy profile…

Computer Science and Game Theory · Computer Science 2022-03-29 Jason Milionis , Christos Papadimitriou , Georgios Piliouras , Kelly Spendlove

We study discounted infinitely repeated games in which players agree on a cooperative mixed action profile but, at each step, observe only the realized pure actions. This form of imperfect monitoring breaks classical trigger strategies,…

Applications · Statistics 2026-03-09 Aymeric Capitaine , Antoine Scheid , Etienne Boursier , Alain Durmus , Michael I. Jordan

Extensive-form games with imperfect recall are an important game-theoretic model that allows a compact representation of strategies in dynamic strategic interactions. Practical use of imperfect recall games is limited due to negative…

Computer Science and Game Theory · Computer Science 2017-05-25 Branislav Bosansky , Jiri Cermak , Karel Horak , Michal Pechoucek

Contemporary applications of machine learning in two-team e-sports and the superior expressivity of multi-agent generative adversarial networks raise important and overlooked theoretical questions regarding optimization in two-team games.…

Computer Science and Game Theory · Computer Science 2023-04-18 Fivos Kalogiannis , Ioannis Panageas , Emmanouil-Vasileios Vlatakis-Gkaragkounis

We consider evolutionary dynamics for population games in which players have a continuum of strategies at their disposal. Models in this setting amount to infinite-dimensional differential equations evolving on the manifold of probability…

Dynamical Systems · Mathematics 2025-04-23 Brendon G. Anderson , Jingqi Li , Somayeh Sojoudi , Murat Arcak

We consider the problem of finding Nash equilibrium for two-player turn-based zero-sum games. Inspired by the AlphaGo Zero (AGZ) algorithm, we develop a Reinforcement Learning based approach. Specifically, we propose…

Machine Learning · Computer Science 2020-02-26 Devavrat Shah , Varun Somani , Qiaomin Xie , Zhi Xu

Most existing results about \emph{last-iterate convergence} of learning dynamics are limited to two-player zero-sum games, and only apply under rigid assumptions about what dynamics the players follow. In this paper we provide new results…

Computer Science and Game Theory · Computer Science 2022-03-24 Ioannis Anagnostides , Ioannis Panageas , Gabriele Farina , Tuomas Sandholm

We study the problem of computing an $\epsilon$-approximate Nash equilibrium of a two-player, bilinear game with a bounded payoff matrix $A \in \mathbb{R}^{m \times n}$, when the players' strategies are constrained to lie in simple sets. We…

Optimization and Control · Mathematics 2026-01-08 Ishani Karmarkar , Liam O'Carroll , Aaron Sidford