English
Related papers

Related papers: Solving Imperfect-Recall Games via Sum-of-Squares …

200 papers

Designing efficient algorithms to find Nash equilibrium (NE) refinements in sequential games is of paramount importance in practice. Indeed, it is well known that the NE has several weaknesses, since it may prescribe to play sub-optimal…

Computer Science and Game Theory · Computer Science 2022-08-18 Martino Bernasconi , Alberto Marchesi , Francesco Trovò

We study the computational complexity of solving stochastic games with mean-payoff objectives. Instead of identifying special classes in which simple strategies are sufficient to play $\epsilon$-optimally, or form $\epsilon$-Nash…

Computer Science and Game Theory · Computer Science 2024-05-16 Sougata Bose , Rasmus Ibsen-Jensen , Patrick Totzke

Understanding how players adjust their strategies in games, based on their experience, is a crucial tool for policymakers. It enables them to forecast the system's eventual behavior, exert control over the system, and evaluate…

Computer Science and Game Theory · Computer Science 2024-10-14 Iosif Sakos , Antonios Varvitsiotis , Georgios Piliouras

A major open question in algorithmic game theory is whether normal-form correlated equilibria (NFCE) can be computed efficiently in succinct games such as extensive-form games [DFF+25,6PR24,FP23,HvS08,VSF08,PR08]. Motivated by this…

Computer Science and Game Theory · Computer Science 2025-07-16 Vincent Cheval , Florian Horn , Soumyajit Paul , Mahsa Shirmohammadi

There has been tremendous recent progress on equilibrium-finding algorithms for zero-sum imperfect-information extensive-form games, but there has been a puzzling gap between theory and practice. First-order methods have significantly…

Computer Science and Game Theory · Computer Science 2018-10-09 Christian Kroer , Gabriele Farina , Tuomas Sandholm

In this paper, we introduce the first algorithmic framework for Blackwell approachability on the sequence-form polytope, the class of convex polytopes capturing the strategies of players in extensive-form games (EFGs). This leads to a new…

Computer Science and Game Theory · Computer Science 2024-03-08 Darshan Chakrabarti , Julien Grand-Clément , Christian Kroer

We study the problem of finding optimal correlated equilibria of various sorts in extensive-form games: normal-form coarse correlated equilibrium (NFCCE), extensive-form coarse correlated equilibrium (EFCCE), and extensive-form correlated…

Computer Science and Game Theory · Computer Science 2025-01-28 Brian Zhang , Gabriele Farina , Andrea Celli , Tuomas Sandholm

No-regret learning has emerged as a powerful tool for solving extensive-form games. This was facilitated by the counterfactual-regret minimization (CFR) framework, which relies on the instantiation of regret minimizers for simplexes at each…

Computer Science and Game Theory · Computer Science 2017-11-10 Gabriele Farina , Christian Kroer , Tuomas Sandholm

Multiagent decision-making in partially observable environments is usually modelled as either an extensive-form game (EFG) in game theory or a partially observable stochastic game (POSG) in multiagent reinforcement learning (MARL). One…

Artificial Intelligence · Computer Science 2021-09-29 Vojtěch Kovařík , Martin Schmid , Neil Burch , Michael Bowling , Viliam Lisý

This work investigates the ambient potential identification problem in inverse Mean-Field Games (MFGs), where the goal is to recover the unknown potential from the value function at equilibrium. We propose a simple yet effective iterative…

Optimization and Control · Mathematics 2025-10-14 Jiajia Yu , Jian-Guo Liu , Hongkai Zhao

A conceptually appealing approach for learning Extensive-Form Games (EFGs) is to convert them to Normal-Form Games (NFGs). This approach enables us to directly translate state-of-the-art techniques and analyses in NFGs to learning EFGs, but…

Machine Learning · Computer Science 2022-10-28 Yu Bai , Chi Jin , Song Mei , Ziang Song , Tiancheng Yu

A recent theory shows that a multi-player decentralized partially observable Markov decision process can be transformed into an equivalent single-player game, enabling the application of \citeauthor{bellman}'s principle of optimality to…

Computer Science and Game Theory · Computer Science 2025-01-03 Johan Peralez , Aurélien Delage , Olivier Buffet , Jilles S. Dibangoye

Regret minimization is a powerful tool for solving large-scale extensive-form games. State-of-the-art methods rely on minimizing regret locally at each decision point. In this work we derive a new framework for regret minimization on…

Computer Science and Game Theory · Computer Science 2018-09-11 Gabriele Farina , Christian Kroer , Tuomas Sandholm

Function approximation (FA) has been a critical component in solving large zero-sum games. Yet, little attention has been given towards FA in solving \textit{general-sum} extensive-form games, despite them being widely regarded as being…

Computer Science and Game Theory · Computer Science 2023-04-04 Chun Kai Ling , J. Zico Kolter , Fei Fang

The Sum-of-Squares (SOS) approximation method is a technique used in optimization problems to derive lower bounds on the optimal value of an objective function. By representing the objective function as a sum of squares in a feature space,…

Optimization and Control · Mathematics 2024-03-12 Francis Bach , Elisabetta Cornacchia , Luca Pesce , Giovanni Piccioli

We introduce a new framework for unifying and systematizing the performance analysis of first-order black-box optimization algorithms for unconstrained convex minimization. The low-cost iteration complexity enjoyed by first-order algorithms…

Optimization and Control · Mathematics 2021-06-23 Sandra S. Y. Tan , Antonios Varvitsiotis , Vincent Y. F. Tan

Equilibrium finding in two-player zero-sum games with perfect recall is a well-studied topic that has led to many breakthroughs in computational game theory. This paper aims to generalize such techniques to (timeable) two-player zero-sum…

Computer Science and Game Theory · Computer Science 2026-05-05 Luca Carminati , Brian Hu Zhang , Federico Cacciamani , Junkang Li , Gabriele Farina , Nicola Gatti , Tuomas Sandholm

In this work we present a hierarchical framework for solving discrete stochastic pursuit-evasion games (PEGs) in large grid worlds. With a partition of the grid world into superstates (e.g., "rooms"), the proposed approach creates a…

Multiagent Systems · Computer Science 2023-03-20 Yue Guan , Mohammad Afshari , Qifan Zhang , Panagiotis Tsiotras

The complexity of computing equilibrium refinements has been at the forefront of algorithmic game theory research, but it has remained open in the seminal class of potential games; we close this fundamental gap in this paper. We first show…

Computer Science and Game Theory · Computer Science 2026-02-11 Ioannis Anagnostides , Maria-Florina Balcan , Kiriaki Fragkia , Tuomas Sandholm , Emanuel Tewolde , Brian Hu Zhang

Counterfactual regret minimization (CFR) is an effective algorithm for solving extensive games with imperfect information (IIEGs). However, CFR is only allowed to be applied in known environments, where the transition function of the chance…

Computer Science and Game Theory · Computer Science 2024-10-30 Chen Qiu , Xuan Wang , Tianzi Ma , Yaojun Wen , Jiajia Zhang