English
Related papers

Related papers: SpinGPT: A Large-Language-Model Approach to Playin…

200 papers

Counterfactual Regret Minimization (CFR) is the most popular iterative algorithm for solving zero-sum imperfect-information games. Regret-Based Pruning (RBP) is an improvement that allows poorly-performing actions to be temporarily pruned,…

Computer Science and Game Theory · Computer Science 2016-09-13 Noam Brown , Tuomas Sandholm

Counterfactual Regret Minimization (CFR) algorithms are widely used to compute a Nash equilibrium (NE) in two-player zero-sum imperfect-information extensive-form games (IIGs). Among them, Predictive CFR$^+$ (PCFR$^+$) is particularly…

Machine Learning · Computer Science 2025-11-14 Linjian Meng , Tianpei Yang , Youzhi Zhang , Zhenxing Ge , Yang Gao

No-regret learning has emerged as a powerful tool for solving extensive-form games. This was facilitated by the counterfactual-regret minimization (CFR) framework, which relies on the instantiation of regret minimizers for simplexes at each…

Computer Science and Game Theory · Computer Science 2017-11-10 Gabriele Farina , Christian Kroer , Tuomas Sandholm

Extensive-form games are a common model for multiagent interactions with imperfect information. In two-player zero-sum games, the typical solution concept is a Nash equilibrium over the unconstrained strategy set for each player. In many…

Computer Science and Game Theory · Computer Science 2019-02-07 Trevor Davis , Kevin Waugh , Michael Bowling

Game theory has grown into a major field over the past few decades, and poker has long served as one of its key case studies. Game-Theory-Optimal (GTO) provides strategies to avoid loss in poker, but pure GTO does not guarantee maximum…

Computer Science and Game Theory · Computer Science 2025-09-30 SeungHyun Yi , Seungjun Yi

To establish last-iterate convergence for Counterfactual Regret Minimization (CFR) algorithms in learning a Nash equilibrium (NE) of extensive-form games (EFGs), recent studies reformulate learning an NE of the original EFG as learning the…

Computer Science and Game Theory · Computer Science 2025-03-19 Linjian Meng , Youzhi Zhang , Zhenxing Ge , Shangdong Yang , Tianyu Ding , Wenbin Li , Tianpei Yang , Bo An , Yang Gao

Counterfactual regret minimization (CFR) algorithms are a foundational class of methods for solving imperfect-information games, with the time average of their iterates converging to a Nash equilibrium in two-player zero-sum games. Prior…

Computer Science and Game Theory · Computer Science 2026-02-10 Naifeng Zhang , Stephen McAleer , Tuomas Sandholm

Poker is a landmark challenge for artificial intelligence. The dominant approach relies on equilibrium solvers built on counterfactual regret minimization, requiring millions of core-hours of training. Large Language Models (LLMs) possess…

Artificial Intelligence · Computer Science 2026-05-29 Boning Li , Baoxiang Wang , Longbo Huang

Imperfect Information Games (IIGs) offer robust models for scenarios where decision-makers face uncertainty or lack complete information. Counterfactual Regret Minimization (CFR) has been one of the most successful family of algorithms for…

Machine Learning · Computer Science 2025-11-12 Jiayu Chen , Zhekai Wang , Vaneet Aggarwal

Artificial intelligence (AI) has surpassed top human players in a variety of games. In imperfect information games, these achievements have primarily been driven by Counterfactual Regret Minimization (CFR) and its variants for computing…

Computer Science and Game Theory · Computer Science 2025-05-29 Qi Ju , Thomas Tellier , Meng Sun , Zhemei Fang , Yunfeng Luo

A dominant approach to solving large imperfect-information games is Counterfactural Regret Minimization (CFR). In CFR, many regret minimization problems are combined to solve the game. For very large games, abstraction is typically needed…

Machine Learning · Computer Science 2019-12-02 Ryan D'Orazio , Dustin Morrill , James R. Wright

A considerable chasm has been looming for decades between theory and practice in zero-sum game solving through first-order methods. Although a convergence rate of $T^{-1}$ has long been established, the most effective paradigm in practice…

Computer Science and Game Theory · Computer Science 2026-02-18 Brian Hu Zhang , Ioannis Anagnostides , Tuomas Sandholm

In general, two-agent decision-making problems can be modeled as a two-player game, and a typical solution is to find a Nash equilibrium in such game. Counterfactual regret minimization (CFR) is a well-known method to find a Nash…

Computer Science and Game Theory · Computer Science 2020-12-07 Huale Li , Xuan Wang , Shuhan Qi , Jiajia Zhang , Yang Liu , Yulin Wu , Fengwei Jia

Counterfactual regret minimization (CFR) is the most popular algorithm on solving two-player zero-sum extensive games with imperfect information and achieves state-of-the-art performance in practice. However, the performance of CFR is not…

Machine Learning · Computer Science 2018-12-27 Yichi Zhou , Tongzheng Ren , Jialian Li , Dong Yan , Jun Zhu

Counterfactual Regret Minimization (CRF) is a fundamental and effective technique for solving Imperfect Information Games (IIG). However, the original CRF algorithm only works for discrete state and action spaces, and the resulting strategy…

Artificial Intelligence · Computer Science 2018-12-31 Hui Li , Kailiang Hu , Zhibang Ge , Tao Jiang , Yuan Qi , Le Song

High-quality information set abstraction remains a core challenge in solving large-scale imperfect-information extensive-form games (IIEFGs)--such as no-limit Texas Hold'em--where the finite nature of spatial resources hinders solving…

Artificial Intelligence · Computer Science 2025-12-10 Yanchang Fu , Shengda Liu , Pei Xu , Kaiqi Huang

Counterfactual regret minimization (CFR) is a family of algorithms for effectively solving imperfect-information games. It decomposes the total regret into counterfactual regrets, utilizing local regret minimization algorithms, such as…

Machine Learning · Computer Science 2024-05-15 Hang Xu , Kai Li , Bingyun Liu , Haobo Fu , Qiang Fu , Junliang Xing , Jian Cheng

Regret minimization is a general approach to online optimization which plays a crucial role in many algorithms for approximating Nash equilibria in two-player zero-sum games. The literature mainly focuses on solving individual games in…

Computer Science and Game Theory · Computer Science 2025-04-29 David Sychrovský , Martin Schmid , Michal Šustr , Michael Bowling

The extensive-form game has been studied considerably in recent years. It can represent games with multiple decision points and incomplete information, and hence it is helpful in formulating games with uncertain inputs, such as poker. We…

Computer Science and Game Theory · Computer Science 2023-03-21 Keigo Habara , Ellen Hidemi Fukuda , Nobuo Yamashita

Much of the advancement in Multi-Agent Reinforcement Learning (MARL) for imperfect-information games has historically depended on the manual, iterative refinement of algorithmic baselines. Recently, evolutionary coding agents powered by…

Computer Science and Game Theory · Computer Science 2026-05-11 Zun Li , John Schultz , Daniel Hennes , Marc Lanctot