English
Related papers

Related papers: ExIt-OOS: Towards Learning from Planning in Imperf…

200 papers

Non-cooperative games serve as a powerful framework for capturing the interactions among self-interested players and have broad applicability in modeling a wide range of practical scenarios, ranging from power management to drug delivery.…

Optimization and Control · Mathematics 2023-09-08 Yuanhanqing Huang , Jianghai Hu

We consider online learning in multi-player smooth monotone games. Existing algorithms have limitations such as (1) being only applicable to strongly monotone games; (2) lacking the no-regret guarantee; (3) having only asymptotic or slow…

Machine Learning · Computer Science 2023-09-06 Yang Cai , Weiqiang Zheng

Counterfactual Regret Minimization and variants (e.g. Public Chance Sampling CFR and Pure CFR) have been known as the best approaches for creating approximate Nash equilibrium solutions for imperfect information games such as poker. This…

Computer Science and Game Theory · Computer Science 2014-07-21 Oskari Tammelin

We study the iteration complexity of decentralized learning of approximate correlated equilibria in incomplete information games. On the negative side, we prove that in $\mathit{extensive}$-$\mathit{form}$ $\mathit{games}$, assuming…

Computer Science and Game Theory · Computer Science 2024-06-05 Binghui Peng , Aviad Rubinstein

For zero-sum two-player continuous-time games with integral payoff and incomplete information on one side, one shows that the optimal strategy of the informed player can be computed through an auxiliary optimization problem over some…

Probability · Mathematics 2008-10-02 Pierre Cardaliaguet , Catherine Rainer

Learning in multi-player games can model a large variety of practical scenarios, where each player seeks to optimize its own local objective function, which at the same time relies on the actions taken by others. Motivated by the frequent…

Optimization and Control · Mathematics 2023-09-08 Yuanhanqing Huang , Jianghai Hu

In their seminal work, Nayyar et al. (2013) showed that imperfect information can be abstracted away from common-payoff games by having players publicly announce their policies as they play. This insight underpins sound solvers and…

Computer Science and Game Theory · Computer Science 2023-08-02 Samuel Sokota , Ryan D'Orazio , Chun Kai Ling , David J. Wu , J. Zico Kolter , Noam Brown

This paper introduces a novel algorithm for two-player deterministic games with perfect information, which we call PROBS (Predict Results of Beam Search). Unlike existing methods that predominantly rely on Monte Carlo Tree Search (MCTS) for…

Artificial Intelligence · Computer Science 2024-04-26 Sergey Pastukhov

Task planning for mobile robots often assumes full environment knowledge and so popular approaches, like planning via the PDDL, cannot plan when the locations of task-critical objects are unknown. Recent learning-driven object search…

Extensive-form games are a common model for multiagent interactions with imperfect information. In two-player zero-sum games, the typical solution concept is a Nash equilibrium over the unconstrained strategy set for each player. In many…

Computer Science and Game Theory · Computer Science 2019-02-07 Trevor Davis , Kevin Waugh , Michael Bowling

We propose a new framework for imitation learning -- treating imitation as a two-player ranking-based game between a policy and a reward. In this game, the reward agent learns to satisfy pairwise performance rankings between behaviors,…

Machine Learning · Computer Science 2023-01-18 Harshit Sikchi , Akanksha Saran , Wonjoon Goo , Scott Niekum

Distributed online optimization and game have been increasingly researched in the last decade, mostly motivated by its wide applications in sensor networks, robotics (e.g., distributed target tracking and formation control), smart grids,…

Machine Learning · Computer Science 2023-01-24 Xiuxian Li , Lihua Xie , Na Li

This work tackles the complexities of multi-player scenarios in \emph{unknown games}, where the primary challenge lies in navigating the uncertainty of the environment through bandit feedback alongside strategic decision-making. We…

Machine Learning · Computer Science 2024-02-27 Yingru Li , Liangqi Liu , Wenqiang Pu , Hao Liang , Zhi-Quan Luo

The game of chess is the most widely-studied domain in the history of artificial intelligence. The strongest programs are based on a combination of sophisticated search techniques, domain-specific adaptations, and handcrafted evaluation…

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games. OpenSpiel supports n-player (single- and multi- agent) zero-sum, cooperative and general-sum, one-shot and…

AlphaZero, using a combination of Deep Neural Networks and Monte Carlo Tree Search (MCTS), has successfully trained reinforcement learning agents in a tabula-rasa way. The neural MCTS algorithm has been successful in finding near-optimal…

Artificial Intelligence · Computer Science 2021-10-12 Prashank Kadam , Ruiyang Xu , Karl Lieberherr

We present an end-to-end learning method for chess, relying on deep neural networks. Without any a priori knowledge, in particular without any knowledge regarding the rules of chess, a deep neural network is trained using a combination of…

Neural and Evolutionary Computing · Computer Science 2017-11-28 Eli David , Nathan S. Netanyahu , Lior Wolf

Fictitious play with reinforcement learning is a general and effective framework for zero-sum games. However, using the current deep neural network models, the implementation of fictitious play faces crucial challenges. Neural network model…

Machine Learning · Computer Science 2019-12-02 Rong-Jun Qin , Jing-Cheng Pang , Yang Yu

We present a game framework tailored for deduction games, enabling structured analysis from the perspective of Shannon entropy variations. Additionally, we introduce a new forward search algorithm, Information Set Entropy Search (ISES),…

Artificial Intelligence · Computer Science 2024-08-01 Fandi Meng , Simon Lucas

We introduce a framework for translating game descriptions in natural language into extensive-form representations in game theory, leveraging Large Language Models (LLMs) and in-context learning. Given the varying levels of strategic…

Artificial Intelligence · Computer Science 2025-02-03 Shilong Deng , Yongzhao Wang , Rahul Savani