English
Related papers

Related papers: Bayesian Inference in Monte-Carlo Tree Search

200 papers

Monte-Carlo Tree Search (MCTS) typically uses multi-armed bandit (MAB) strategies designed to minimize cumulative regret, such as UCB1, as its selection strategy. However, in the root node of the search tree, it is more sensible to minimize…

Machine Learning · Computer Science 2024-11-12 Dominic Sagers , Mark H. M. Winands , Dennis J. N. J. Soemers

Monte Carlo Tree Search (MCTS) has proven highly effective in solving complex planning tasks by balancing exploration and exploitation using Upper Confidence Bound for Trees (UCT). However, existing work have not considered MCTS-based…

Artificial Intelligence · Computer Science 2025-02-04 Zuyuan Zhang , Tian Lan

Monte Carlo Tree Search (MCTS) has shown its strength for a lot of deterministic and stochastic examples, but literature lacks reports of applications to real world industrial processes. Common reasons for this are that there is no…

Artificial Intelligence · Computer Science 2021-08-05 Dorina Weichert , Felix Horchler , Alexander Kister , Marcus Trost , Johannes Hartung , Stefan Risse

Decision trees have found widespread application within the machine learning community due to their flexibility and interpretability. This paper is directed towards learning decision trees from data using a Bayesian approach, which is…

Machine Learning · Computer Science 2023-12-05 Jodie A. Cochrane , Adrian G. Wills , Sarah J. Johnson

Decision trees are commonly used predictive models due to their flexibility and interpretability. This paper is directed at quantifying the uncertainty of decision tree predictions by employing a Bayesian inference approach. This is…

Machine Learning · Computer Science 2024-03-28 Jodie A. Cochrane , Adrian Wills , Sarah J. Johnson

Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The success of MCTS depends heavily on how the tree is built and the selection process plays a fundamental role in this. One particular…

Neural and Evolutionary Computing · Computer Science 2022-08-30 Edgar Galván , Gavin Simpson , Fred Valdez Ameneyro

We explore applying the Monte Carlo Tree Search (MCTS) algorithm in a notoriously difficult task: tuning programs for high-performance deep learning and image processing. We build our framework on top of Halide and show that MCTS can…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Ameer Haj-Ali , Hasan Genc , Qijing Huang , William Moses , John Wawrzynek , Krste Asanović , Ion Stoica

We present a new Monte Carlo Tree Search (MCTS) algorithm to solve the stochastic orienteering problem with chance constraints, i.e., a version of the problem where travel costs are random, and one is assigned a bound on the tolerable…

Robotics · Computer Science 2024-09-06 Stefano Carpin

One weakness of Monte Carlo Tree Search (MCTS) is its sample efficiency which can be addressed by building and using state and/or action abstractions in parallel to the tree search such that information can be shared among nodes of the same…

Artificial Intelligence · Computer Science 2025-10-29 Robin Schmöcker , Alexander Dockhorn , Bodo Rosenhahn

Monte Carlo Tree Search (MCTS) has proven effective in solving decision-making problems in perfect information settings. However, its application to stochastic and imperfect information domains remains limited. This paper extends the…

Machine Learning · Computer Science 2025-02-12 Can Cömer , Jannis Blüml , Cedric Derstroff , Kristian Kersting

Probabilistic search algorithms, such as Monte Carlo Tree Search (MCTS), have proven very effective in solving sequential decision-making tasks under uncertainty. However, interpreting asymmetric search trees that incorporate bandit-based…

Human-Computer Interaction · Computer Science 2026-05-21 Siqi Lu , Mirsaleh Bahavarnia , Hiba Baroud , Yixuan Zhang , Hemant Purohit , Ayan Mukhopadhyay

Monte Carlo tree search (MCTS) is a popular choice for solving sequential anytime problems. However, it depends on a numeric feedback signal, which can be difficult to define. Real-time MCTS is a variant which may only rarely encounter…

Artificial Intelligence · Computer Science 2018-09-20 Tobias Joppen , Christian Wirth , Johannes Fürnkranz

This paper presents Generalized Proof-Number Monte-Carlo Tree Search: a generalization of recently proposed combinations of Proof-Number Search (PNS) with Monte-Carlo Tree Search (MCTS), which use (dis)proof numbers to bias UCB1-based…

Artificial Intelligence · Computer Science 2025-06-17 Jakub Kowalski , Dennis J. N. J. Soemers , Szymon Kosakowski , Mark H. M. Winands

Monte Carlo Tree Search (MCTS) has emerged as a powerful tool for decision-making in robotics, enabling efficient exploration of large search spaces. However, traditional MCTS methods struggle in environments characterized by high…

Robotics · Computer Science 2025-03-10 Xibai Wang

Monte Carlo Tree Search (MCTS) is particularly adapted to domains where the potential actions can be represented as a tree of sequential decisions. For an effective action selection, MCTS performs many simulations to build a reliable tree…

Artificial Intelligence · Computer Science 2018-09-10 Seydou Ba , Takuya Hiraoka , Takashi Onishi , Toru Nakata , Yoshimasa Tsuruoka

Monte-Carlo Tree Search (MCTS) is a class of methods for solving complex decision-making problems through the synergy of Monte-Carlo planning and Reinforcement Learning (RL). The highly combinatorial nature of the problems commonly…

Artificial Intelligence · Computer Science 2022-02-16 Tuan Dam , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Monte Carlo tree search (MCTS) has achieved state-of-the-art results in many domains such as Go and Atari games when combining with deep neural networks (DNNs). When more simulations are executed, MCTS can achieve higher performance but…

Artificial Intelligence · Computer Science 2020-12-16 Li-Cheng Lan , Meng-Yu Tsai , Ti-Rong Wu , I-Chen Wu , Cho-Jui Hsieh

Gradient-based methods are often used for policy optimization in deep reinforcement learning, despite being vulnerable to local optima and saddle points. Although gradient-free methods (e.g., genetic algorithms or evolution strategies) help…

Machine Learning · Computer Science 2019-12-24 Xiaobai Ma , Katherine Driggs-Campbell , Zongzhang Zhang , Mykel J. Kochenderfer

Bayesian phylogenetic inference is currently done via Markov chain Monte Carlo (MCMC) with simple proposal mechanisms. This hinders exploration efficiency and often requires long runs to deliver accurate posterior estimates. In this paper,…

Machine Learning · Statistics 2024-05-24 Cheng Zhang , Frederick A. Matsen

Monte Carlo Tree Search (MCTS) is a relatively new sampling method with multiple variants in the literature. They can be applied to a wide variety of challenging domains including board games, video games, and energy-based problems to…

Artificial Intelligence · Computer Science 2020-10-06 Fred Valdez Ameneyro , Edgar Galvan , Anger Fernando Kuri Morales