English
Related papers

Related papers: Simultaneous AlphaZero: Extending Tree Search to M…

200 papers

Reinforcement learning has recently been used to approach well-known NP-hard combinatorial problems in graph theory. Among these problems, Hamiltonian cycle problems are exceptionally difficult to analyze, even when restricted to individual…

Artificial Intelligence · Computer Science 2022-11-18 Kevin Du , Ian Gemp , Yi Wu , Yingying Wu

Monte Carlo Tree Search (MCTS)-based algorithms, such as MuZero and its derivatives, have achieved widespread success in various decision-making domains. These algorithms employ the reanalyze process to enhance sample efficiency from stale…

Artificial Intelligence · Computer Science 2025-01-03 Chunyu Xuan , Yazhe Niu , Yuan Pu , Shuai Hu , Yu Liu , Jing Yang

Imperfect-information games (IIGs) are challenging, as players must make decisions without fully observing the true game state. While AlphaZero has achieved remarkable success in perfect-information games, extending it to IIGs remains…

Artificial Intelligence · Computer Science 2026-05-26 Qian-Rong Li , Hung Guei , I-Chen Wu , Ti-Rong Wu

AlphaZero and its extension MuZero are computer programs that use machine-learning techniques to play at a superhuman level in chess, go, and a few other games. They achieved this level of play solely with reinforcement learning from…

Artificial Intelligence · Computer Science 2022-07-05 Evgeny Dantsin , Vladik Kreinovich , Alexander Wolpert

Neural network supported tree-search has shown strong results in a variety of perfect information multi-agent tasks. However, the performance of these methods on partial information games has generally been below competing approaches. Here…

Multiagent Systems · Computer Science 2024-06-18 Ryan Yu , Alex Olshevsky , Peter Chin

Recent achievements from AlphaZero using self-play has shown remarkable performance on several board games. It is plausible to think that self-play, starting from zero knowledge, can gradually approximate a winning strategy for certain…

Artificial Intelligence · Computer Science 2021-01-19 Ruiyang Xu , Karl Lieberherr

We introduce a recursive AlphaZero-style Monte--Carlo tree search algorithm, "RMCTS". The advantage of RMCTS over AlphaZero's MCTS-UCB is speed. In RMCTS, the search tree is explored in a breadth-first manner, so that network inferences…

Artificial Intelligence · Computer Science 2026-01-12 Keith Frankston , Benjamin Howard

A core novelty of Alpha Zero is the interleaving of tree search and deep learning, which has proven very successful in board games like Chess, Shogi and Go. These games have a discrete action space. However, many real-world reinforcement…

Machine Learning · Statistics 2018-05-25 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

Monte Carlo Tree Search (MCTS) is particularly adapted to domains where the potential actions can be represented as a tree of sequential decisions. For an effective action selection, MCTS performs many simulations to build a reliable tree…

Artificial Intelligence · Computer Science 2018-09-10 Seydou Ba , Takuya Hiraoka , Takashi Onishi , Toru Nakata , Yoshimasa Tsuruoka

Monte-Carlo planning and Reinforcement Learning (RL) are essential to sequential decision making. The recent AlphaGo and AlphaZero algorithms have shown how to successfully combine these two paradigms in order to solve large scale…

Machine Learning · Computer Science 2021-02-17 Tuan Dam , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Monte Carlo Tree Search (MCTS) is a branch of stochastic modeling that utilizes decision trees for optimization, mostly applied to artificial intelligence (AI) game players. This project imagines a game in which an AI player searches for a…

Machine Learning · Computer Science 2020-12-01 Elana Kozak , Scott Hottovy

Monte Carlo Tree Search (MCTS) has proven to be capable of solving challenging tasks in domains such as Go, chess and Atari. Previous research has developed parallel versions of MCTS, exploiting today's multiprocessing architectures. These…

Machine Learning · Computer Science 2020-04-01 Karl Kurzer , Christoph Hörtnagl , J. Marius Zöllner

We revisit the problem of learning in two-player zero-sum Markov games, focusing on developing an algorithm that is uncoupled, convergent, and rational, with non-asymptotic convergence rates. We start from the case of stateless matrix game…

Computer Science and Game Theory · Computer Science 2023-11-10 Yang Cai , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

Monte Carlo Tree Search (MCTS) has improved the performance of game engines in domains such as Go, Hex, and general game playing. MCTS has been shown to outperform classic alpha-beta search in games where good heuristic evaluations are…

Artificial Intelligence · Computer Science 2014-06-23 Marc Lanctot , Mark H. M. Winands , Tom Pepels , Nathan R. Sturtevant

We present an extension of Monte Carlo Tree Search (MCTS) that strongly increases its efficiency for trees with asymmetry and/or loops. Asymmetric termination of search trees introduces a type of uncertainty for which the standard upper…

Machine Learning · Statistics 2018-05-24 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

Monte Carlo Tree Search (MCTS) is a powerful approach to designing game-playing bots or solving sequential decision problems. The method relies on intelligent tree search that balances exploration and exploitation. MCTS performs random…

Artificial Intelligence · Computer Science 2023-04-04 Maciej Świechowski , Konrad Godlewski , Bartosz Sawicki , Jacek Mańdziuk

Zero-sum games have long guided artificial intelligence research, since they possess both a rich strategy space of best-responses and a clear evaluation metric. What's more, competition is a vital mechanism in many real-world multi-agent…

Computer Science and Game Theory · Computer Science 2020-03-03 Edward Hughes , Thomas W. Anthony , Tom Eccles , Joel Z. Leibo , David Balduzzi , Yoram Bachrach

AlphaZero is a self-play reinforcement learning algorithm that achieves superhuman play in chess, shogi, and Go via policy iteration. To be an effective policy improvement operator, AlphaZero's search requires accurate value estimates for…

Artificial Intelligence · Computer Science 2023-03-02 Alexandre Trudeau , Michael Bowling

In this paper, we explore and compare multiple algorithms for solving the complex strategy game of Terra Mystica, hereafter abbreviated as TM. Previous work in the area of super-human game-play using AI has proven effective, with recent…

Multiagent Systems · Computer Science 2021-02-23 Luis Perez

We study an original problem of pure exploration in a strategic bandit model motivated by Monte Carlo Tree Search. It consists in identifying the best action in a game, when the player may sample random outcomes of sequentially chosen pairs…

Statistics Theory · Mathematics 2016-02-16 Aurélien Garivier , Emilie Kaufmann , Wouter Koolen