English
Related papers

Related papers: MALinZero: Efficient Low-Dimensional Search for Ma…

200 papers

Monte Carlo Tree Search (MCTS) is a powerful approach to designing game-playing bots or solving sequential decision problems. The method relies on intelligent tree search that balances exploration and exploitation. MCTS performs random…

Artificial Intelligence · Computer Science 2023-04-04 Maciej Świechowski , Konrad Godlewski , Bartosz Sawicki , Jacek Mańdziuk

One weakness of Monte Carlo Tree Search (MCTS) is its sample efficiency which can be addressed by building and using state and/or action abstractions in parallel to the tree search such that information can be shared among nodes of the same…

Artificial Intelligence · Computer Science 2025-10-29 Robin Schmöcker , Alexander Dockhorn , Bodo Rosenhahn

How resources are deployed to secure critical targets in networks can be modelled by Network Security Games (NSGs). While recent advances in deep learning (DL) provide a powerful approach to dealing with large-scale NSGs, DL methods such as…

Cryptography and Security · Computer Science 2022-01-20 Wanqi Xue , Bo An , Chai Kiat Yeo

The AlphaZero/MuZero (A/MZ) family of algorithms has achieved remarkable success across various challenging domains by integrating Monte Carlo Tree Search (MCTS) with learned models. Learned models introduce epistemic uncertainty, which is…

Machine Learning · Computer Science 2026-05-18 Yaniv Oren , Viliam Vadocz , Matthijs T. J. Spaan , Wendelin Böhmer

Effective decision-making and problem-solving in conversational systems require the ability to identify and acquire missing information through targeted questioning. A key challenge lies in efficiently narrowing down a large space of…

Artificial Intelligence · Computer Science 2025-06-03 Harshita Chopra , Chirag Shah

Inference-time scaling strategies, particularly Monte Carlo Tree Search (MCTS), have significantly enhanced the reasoning capabilities of Large Language Models (LLMs). However, current approaches remain predominantly stateless, discarding…

Artificial Intelligence · Computer Science 2026-02-05 Hao Lu , Haoyuan Huang , Yulin Zhou , Chen Li , Ningxin Zhu

Monte Carlo Tree Search (MCTS) efficiently balances exploration and exploitation in tree search based on count-derived uncertainty. However, these local visit counts ignore a second type of uncertainty induced by the size of the subtree…

Artificial Intelligence · Computer Science 2020-05-21 Thomas M Moerland , Joost Broekens , Aske Plaat , Catholijn M Jonker

Monte-Carlo Tree Search (MCTS) methods, such as Upper Confidence Bound applied to Trees (UCT), are instrumental to automated planning techniques. However, UCT can be slow to explore an optimal action when it initially appears inferior to…

Artificial Intelligence · Computer Science 2024-04-12 Michael Painter , Mohamed Baioumy , Nick Hawes , Bruno Lacerda

Monte-Carlo Tree Search (MCTS) methods are drawing great interest after yielding breakthrough results in computer Go. This paper proposes a Bayesian approach to MCTS that is inspired by distributionfree approaches such as UCT [13], yet…

Machine Learning · Computer Science 2012-03-19 Gerald Tesauro , V T Rajan , Richard Segal

The Multi-Agent Pathfinding (MAPF) problem involves finding a set of conflict-free paths for a group of agents confined to a graph. In typical MAPF scenarios, the graph and the agents' starting and ending vertices are known beforehand,…

Artificial Intelligence · Computer Science 2023-12-27 Alexey Skrynnik , Anton Andreychuk , Konstantin Yakovlev , Aleksandr Panov

Monte Carlo Tree Search (MCTS) algorithms such as AlphaGo and MuZero have achieved superhuman performance in many challenging tasks. However, the computational complexity of MCTS-based algorithms is influenced by the size of the search…

Artificial Intelligence · Computer Science 2023-10-11 Yangqing Fu , Ming Sun , Buqing Nie , Yue Gao

We present a scalable tree search planning algorithm for large multi-agent sequential decision problems that require dynamic collaboration. Teams of agents need to coordinate decisions in many domains, but naive approaches fail due to the…

Artificial Intelligence · Computer Science 2021-01-14 Shushman Choudhury , Jayesh K. Gupta , Peter Morales , Mykel J. Kochenderfer

This paper presents an efficient approach to object manipulation planning using Monte Carlo Tree Search (MCTS) to find contact sequences and an efficient ADMM-based trajectory optimization algorithm to evaluate the dynamic feasibility of…

Robotics · Computer Science 2023-03-21 Huaijiang Zhu , Avadesh Meduri , Ludovic Righetti

Monte Carlo Tree Search (MCTS) is a best-first sampling method employed in the search for optimal decisions. The effectiveness of MCTS relies on the construction of its statistical tree, with the selection policy playing a crucial role. A…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Edgar Galvan , Fred Valdez Ameneyro

Monte Carlo Tree Search (MCTS) has proven effective in solving decision-making problems in perfect information settings. However, its application to stochastic and imperfect information domains remains limited. This paper extends the…

Machine Learning · Computer Science 2025-02-12 Can Cömer , Jannis Blüml , Cedric Derstroff , Kristian Kersting

We present an extension of Monte Carlo Tree Search (MCTS) that strongly increases its efficiency for trees with asymmetry and/or loops. Asymmetric termination of search trees introduces a type of uncertainty for which the standard upper…

Machine Learning · Statistics 2018-05-24 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

Monte Carlo Tree Search (MCTS) has been proposed as a transformative approach to join-order optimization in database query processing, with recent frameworks such as AlphaJoin and HyperQO claiming to outperform traditional methods. However,…

We introduce MCTS-RAG, a novel approach that enhances the reasoning capabilities of small language models on knowledge-intensive tasks by leveraging retrieval-augmented generation (RAG) to provide relevant context and Monte Carlo Tree…

Computation and Language · Computer Science 2025-10-09 Yunhai Hu , Yilun Zhao , Chen Zhao , Arman Cohan

A recent theoretical analysis of a Monte-Carlo tree search (MCTS) method properly modified from the ``upper confidence bound applied to trees" (UCT) algorithm established a surprising result, due to a great deal of empirical successes…

Optimization and Control · Mathematics 2025-02-04 Hyeong Soo Chang

Non-monotone object rearrangement planning in confined spaces such as cabinets and shelves is a widely occurring but challenging problem in robotics. Both the robot motion and the available regions for object relocation are highly…

Robotics · Computer Science 2024-08-09 Hanwen Ren , Ahmed H. Qureshi