English
Related papers

Related papers: Convergence of Monte Carlo Tree Search in Simultan…

200 papers

Monte Carlo Tree Search (MCTS) has recently been successfully used to create strategies for playing imperfect-information games. Despite its popularity, there are no theoretic results that guarantee its convergence to a well-defined…

Computer Science and Game Theory · Computer Science 2015-09-02 Vojtěch Kovařík , Viliam Lisý

Monte Carlo Tree Search (MCTS) is a powerful approach to designing game-playing bots or solving sequential decision problems. The method relies on intelligent tree search that balances exploration and exploitation. MCTS performs random…

Artificial Intelligence · Computer Science 2023-04-04 Maciej Świechowski , Konrad Godlewski , Bartosz Sawicki , Jacek Mańdziuk

Hannan consistency, or no external regret, is a~key concept for learning in games. An action selection algorithm is Hannan consistent (HC) if its performance is eventually as good as selecting the~best fixed action in hindsight. If both…

Computer Science and Game Theory · Computer Science 2019-07-09 Vojtěch Kovařík , Viliam Lisý

Monte Carlo Tree Search (MCTS) is a branch of stochastic modeling that utilizes decision trees for optimization, mostly applied to artificial intelligence (AI) game players. This project imagines a game in which an AI player searches for a…

Machine Learning · Computer Science 2020-12-01 Elana Kozak , Scott Hottovy

We examine a type of modified Monte Carlo Tree Search (MCTS) for strategising in combinatorial games. The modifications are derived by analysing simplified strategies and simplified versions of the underlying game and then using the results…

Computer Science and Game Theory · Computer Science 2025-01-14 Michael Haythorpe , Alex Newcombe , Damian O'Dea

This paper introduces Monte Carlo *-Minimax Search (MCMS), a Monte Carlo search algorithm for turned-based, stochastic, two-player, zero-sum games of perfect information. The algorithm is designed for the class of of densely stochastic…

Computer Science and Game Theory · Computer Science 2013-04-23 Marc Lanctot , Abdallah Saffidine , Joel Veness , Christopher Archibald , Mark H. M. Winands

Monte-Carlo Tree Search (MCTS) is a family of sampling-based search algorithms widely used for online planning in sequential decision-making domains and at the heart of many recent advances in artificial intelligence. Understanding the…

Artificial Intelligence · Computer Science 2025-09-25 Yiyu Qian , Tim Miller , Zheng Qian , Liyuan Zhao

We propose Monte Carlo Permutation Search (MCPS), a general-purpose Monte Carlo Tree Search (MCTS) algorithm that improves upon the GRAVE algorithm. MCPS is relevant when deep reinforcement learning is not an option or when the computing…

Machine Learning · Computer Science 2026-05-27 Tristan Cazenave

This article discusses two contributions to decision-making in complex partially observable stochastic games. First, we apply two state-of-the-art search techniques that use Monte-Carlo sampling to the task of approximating a…

Computer Science and Game Theory · Computer Science 2014-01-21 Marc Ponsen , Steven de Jong , Marc Lanctot

In this paper we explore the application of simultaneous move Monte Carlo Tree Search (MCTS) based online framework for tactical maneuvering between two unmanned aircrafts. Compared to other techniques, MCTS enables efficient search over…

Artificial Intelligence · Computer Science 2020-09-21 Kunal Srivastava , Amit Surana

Proof-Number Search (PNS) and Monte-Carlo Tree Search (MCTS) have been successfully applied for decision making in a range of games. This paper proposes a new approach called PN-MCTS that combines these two tree-search methods by…

Artificial Intelligence · Computer Science 2022-06-09 Elliot Doe , Mark H. M. Winands , Dennis J. N. J. Soemers , Cameron Browne

This paper proposes a new game-search algorithm, PN-MCTS, which combines Monte-Carlo Tree Search (MCTS) and Proof-Number Search (PNS). These two algorithms have been successfully applied for decision making in a range of domains. We define…

Artificial Intelligence · Computer Science 2024-05-30 Jakub Kowalski , Elliot Doe , Mark H. M. Winands , Daniel Górski , Dennis J. N. J. Soemers

The combination of Monte-Carlo Tree Search (MCTS) and deep reinforcement learning is state-of-the-art in two-player perfect-information games. In this paper, we describe a search algorithm that uses a variant of MCTS which we enhanced by 1)…

Machine Learning · Computer Science 2020-05-26 Arta Seify , Michael Buro

In this study, we explore the efficiency of the Monte Carlo Tree Search (MCTS), a prominent decision-making algorithm renowned for its effectiveness in complex decision environments, contingent upon the volume of simulations conducted.…

Artificial Intelligence · Computer Science 2024-03-19 Ye Zhang , Mengran Zhu , Kailin Gui , Jiayue Yu , Yong Hao , Haozhan Sun

Monte Carlo Tree Search (MCTS), most famously used in game-play artificial intelligence (e.g., the game of Go), is a well-known strategy for constructing approximate solutions to sequential decision problems. Its primary innovation is the…

Optimization and Control · Mathematics 2017-04-21 Daniel R. Jiang , Lina Al-Kanj , Warren B. Powell

We present an extension of Monte Carlo Tree Search (MCTS) that strongly increases its efficiency for trees with asymmetry and/or loops. Asymmetric termination of search trees introduces a type of uncertainty for which the standard upper…

Machine Learning · Statistics 2018-05-24 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

AlphaZero, using a combination of Deep Neural Networks and Monte Carlo Tree Search (MCTS), has successfully trained reinforcement learning agents in a tabula-rasa way. The neural MCTS algorithm has been successful in finding near-optimal…

Artificial Intelligence · Computer Science 2021-10-12 Prashank Kadam , Ruiyang Xu , Karl Lieberherr

Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The MCTS's popularity is based on its extraordinary results in the challenging two-player based game Go, a game considered much harder than…

Neural and Evolutionary Computing · Computer Science 2021-12-21 Edgar Galván , Gavin Simpson

Monte Carlo Tree Search (MCTS) is particularly adapted to domains where the potential actions can be represented as a tree of sequential decisions. For an effective action selection, MCTS performs many simulations to build a reliable tree…

Artificial Intelligence · Computer Science 2018-09-10 Seydou Ba , Takuya Hiraoka , Takashi Onishi , Toru Nakata , Yoshimasa Tsuruoka

In this work, we consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of infinite-horizon discounted cost Markov Decision Process (MDP). While…

Machine Learning · Statistics 2020-01-14 Devavrat Shah , Qiaomin Xie , Zhi Xu
‹ Prev 1 2 3 10 Next ›