English
Related papers

Related papers: Improving Monte Carlo Tree Search for Symbolic Reg…

200 papers

Monte Carlo Tree Search (MCTS), which leverages Upper Confidence Bound for Trees (UCTs) to balance exploration and exploitation through randomized sampling, is instrumental to solving complex planning problems. However, for multi-agent…

Artificial Intelligence · Computer Science 2025-11-11 Sizhe Tang , Jiayu Chen , Tian Lan

Probabilistic search algorithms, such as Monte Carlo Tree Search (MCTS), have proven very effective in solving sequential decision-making tasks under uncertainty. However, interpreting asymmetric search trees that incorporate bandit-based…

Human-Computer Interaction · Computer Science 2026-05-21 Siqi Lu , Mirsaleh Bahavarnia , Hiba Baroud , Yixuan Zhang , Hemant Purohit , Ayan Mukhopadhyay

We propose a novel Parallel Monte Carlo tree search with Batched Simulations (PMBS) algorithm for accelerating long-horizon, episodic robotic planning tasks. Monte Carlo tree search (MCTS) is an effective heuristic search algorithm for…

Robotics · Computer Science 2022-07-15 Baichuan Huang , Abdeslam Boularias , Jingjin Yu

Much current research in AI and games is being devoted to Monte Carlo search (MCS) algorithms. While the quest for a single unified MCS algorithm that would perform well on all problems is of major interest for AI, practitioners often know…

Artificial Intelligence · Computer Science 2015-03-20 Francis Maes , David Lupien St-Pierre , Damien Ernst

Popular Monte-Carlo tree search (MCTS) algorithms for online planning, such as epsilon-greedy tree search and UCT, aim at rapidly identifying a reasonably good action, but provide rather poor worst-case guarantees on performance improvement…

Artificial Intelligence · Computer Science 2013-09-27 Zohar Feldman , Carmel Domshlak

One of the most important AI research questions is to trade off computation versus performance since ``perfect rationality" exists in theory but is impossible to achieve in practice. Recently, Monte-Carlo tree search (MCTS) has attracted…

Artificial Intelligence · Computer Science 2022-10-25 Weirui Ye , Pieter Abbeel , Yang Gao

Monte-Carlo Tree Search (MCTS) is one of the most-widely used methods for planning, and has powered many recent advances in artificial intelligence. In MCTS, one typically performs computations (i.e., simulations) to collect statistics…

Artificial Intelligence · Computer Science 2020-11-20 Eren Sezener , Peter Dayan

The combination of Monte-Carlo Tree Search (MCTS) and deep reinforcement learning is state-of-the-art in two-player perfect-information games. In this paper, we describe a search algorithm that uses a variant of MCTS which we enhanced by 1)…

Machine Learning · Computer Science 2020-05-26 Arta Seify , Michael Buro

Monte-Carlo Tree Search (MCTS) is a family of sampling-based search algorithms widely used for online planning in sequential decision-making domains and at the heart of many recent advances in artificial intelligence. Understanding the…

Artificial Intelligence · Computer Science 2025-09-25 Yiyu Qian , Tim Miller , Zheng Qian , Liyuan Zhao

Monte Carlo Tree Search (MCTS) is a best-first sampling method employed in the search for optimal decisions. The effectiveness of MCTS relies on the construction of its statistical tree, with the selection policy playing a crucial role. A…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Edgar Galvan , Fred Valdez Ameneyro

We introduce MCTS-RAG, a novel approach that enhances the reasoning capabilities of small language models on knowledge-intensive tasks by leveraging retrieval-augmented generation (RAG) to provide relevant context and Monte Carlo Tree…

Computation and Language · Computer Science 2025-10-09 Yunhai Hu , Yilun Zhao , Chen Zhao , Arman Cohan

This study investigates the combined use of generative grammar rules and Monte Carlo Tree Search (MCTS) for optimizing truss structures. Our approach accommodates intermediate construction stages characteristic of progressive construction…

Computational Engineering, Finance, and Science · Computer Science 2025-04-03 Gabriel Garayalde , Luca Rosafalco , Matteo Torzoni , Alberto Corigliano

With the aim of improving performance in Markov Decision Problem in an Off-Policy setting, we suggest taking inspiration from what is done in Offline Reinforcement Learning (RL). In Offline RL, it is a common practice during policy learning…

Artificial Intelligence · Computer Science 2024-10-29 Jérôme Arjonilla , Abdallah Saffidine , Tristan Cazenave

We propose Monte Carlo Permutation Search (MCPS), a general-purpose Monte Carlo Tree Search (MCTS) algorithm that improves upon the GRAVE algorithm. MCPS is relevant when deep reinforcement learning is not an option or when the computing…

Machine Learning · Computer Science 2026-05-27 Tristan Cazenave

Tree search-based methods have made significant progress in enhancing the code generation capabilities of large language models. However, due to the difficulty in effectively evaluating intermediate algorithmic steps and the inability to…

Artificial Intelligence · Computer Science 2025-12-18 Yuanyuan Lin , Xiangyu Ouyang , Teng Zhang , Kaixin Sui

Monte-Carlo Tree Search (MCTS) methods, such as Upper Confidence Bound applied to Trees (UCT), are instrumental to automated planning techniques. However, UCT can be slow to explore an optimal action when it initially appears inferior to…

Artificial Intelligence · Computer Science 2024-04-12 Michael Painter , Mohamed Baioumy , Nick Hawes , Bruno Lacerda

Deep Neural Network guided Monte-Carlo Tree Search (DNN-MCTS) is a powerful class of AI algorithms. In DNN-MCTS, a Deep Neural Network model is trained collaboratively with a dynamic Monte-Carlo search tree to guide the agent towards…

Performance · Computer Science 2023-10-10 Yuan Meng , Qian Wang , Tianxin Zu , Viktor Prasanna

In nature, the behaviors of many complex systems can be described by parsimonious math equations. Automatically distilling these equations from limited data is cast as a symbolic regression process which hitherto remains a grand challenge.…

Machine Learning · Computer Science 2023-05-25 Yilong Xu , Yang Liu , Hao Sun

This work investigates the Monte Carlo Tree Search (MCTS) method combined with dedicated heuristics for solving the Weighted Vertex Coloring Problem. In addition to the basic MCTS algorithm, we study several MCTS variants where the…

Artificial Intelligence · Computer Science 2025-03-05 Cyril Grelier , Olivier Goudet , Jin-Kao Hao

Monte Carlo tree search (MCTS) has achieved state-of-the-art results in many domains such as Go and Atari games when combining with deep neural networks (DNNs). When more simulations are executed, MCTS can achieve higher performance but…

Artificial Intelligence · Computer Science 2020-12-16 Li-Cheng Lan , Meng-Yu Tsai , Ti-Rong Wu , I-Chen Wu , Cho-Jui Hsieh