English
Related papers

Related papers: Mastering truss structure optimization with tree s…

200 papers

Flexible implementations of Monte Carlo Tree Search (MCTS), combined with domain specific knowledge and hybridization with other search algorithms, can be powerful for finding the solutions to problems in complex planning. We introduce…

Machine Learning · Computer Science 2021-08-24 Larkin Liu , Jun Tao Luo

Monte-Carlo Tree Search (MCTS) is a powerful tool for many non-differentiable search related problems such as adversarial games. However, the performance of such approach highly depends on the order of the nodes that are considered at each…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Mehraveh Javan Roshtkhari , Matthew Toews , Marco Pedersoli

Probabilistic search algorithms, such as Monte Carlo Tree Search (MCTS), have proven very effective in solving sequential decision-making tasks under uncertainty. However, interpreting asymmetric search trees that incorporate bandit-based…

Human-Computer Interaction · Computer Science 2026-05-21 Siqi Lu , Mirsaleh Bahavarnia , Hiba Baroud , Yixuan Zhang , Hemant Purohit , Ayan Mukhopadhyay

This paper introduces the Constrained Monte Carlo Tree Search (CMCTS) framework to enhance the mathematical reasoning capabilities of Large Language Models (LLM). By incorporating a constrained action space, Process Reward Model (PRM), and…

Computation and Language · Computer Science 2025-06-17 Qingwen Lin , Boyan Xu , Guimin Hu , Zijian Li , Zhifeng Hao , Keli Zhang , Ruichu Cai

Monte Carlo Tree Search (MCTS) is a best-first sampling method employed in the search for optimal decisions. The effectiveness of MCTS relies on the construction of its statistical tree, with the selection policy playing a crucial role. A…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Edgar Galvan , Fred Valdez Ameneyro

Monte Carlo Tree Search (MCTS), most famously used in game-play artificial intelligence (e.g., the game of Go), is a well-known strategy for constructing approximate solutions to sequential decision problems. Its primary innovation is the…

Optimization and Control · Mathematics 2017-04-21 Daniel R. Jiang , Lina Al-Kanj , Warren B. Powell

Effective decision-making and problem-solving in conversational systems require the ability to identify and acquire missing information through targeted questioning. A key challenge lies in efficiently narrowing down a large space of…

Artificial Intelligence · Computer Science 2025-06-03 Harshita Chopra , Chirag Shah

Monte-Carlo Tree Search (MCTS) is a family of sampling-based search algorithms widely used for online planning in sequential decision-making domains and at the heart of many recent advances in artificial intelligence. Understanding the…

Artificial Intelligence · Computer Science 2025-09-25 Yiyu Qian , Tim Miller , Zheng Qian , Liyuan Zhao

Monte Carlo Tree Search (MCTS) based methods provide promising approaches for generating synthetic data to enhance the self-training of Large Language Model (LLM) based multi-agent systems (MAS). These methods leverage Q-values to estimate…

Computation and Language · Computer Science 2026-04-27 Wentao Shi , Zichun Yu , Fuli Feng , Xiangnan He , Chenyan Xiong

Tree search methods have demonstrated impressive performance in code generation. Previous methods combine tree search with reflection that summarizes past mistakes to achieve iterative improvement. However, these methods face significant…

Software Engineering · Computer Science 2025-10-27 Qingyao Li , Wei Xia , Kounianhua Du , Xinyi Dai , Ruiming Tang , Yasheng Wang , Yong Yu , Weinan Zhang

Monte-Carlo tree search (MCTS) is an effective anytime algorithm with a vast amount of applications. It strategically allocates computational resources to focus on promising segments of the search tree, making it a very attractive search…

Artificial Intelligence · Computer Science 2024-02-14 Cedric Derstroff , Jannis Brugger , Jannis Blüml , Mira Mezini , Stefan Kramer , Kristian Kersting

In this work, we consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of infinite-horizon discounted cost Markov Decision Process (MDP). While…

Machine Learning · Statistics 2020-01-14 Devavrat Shah , Qiaomin Xie , Zhi Xu

We introduce MCTS-RAG, a novel approach that enhances the reasoning capabilities of small language models on knowledge-intensive tasks by leveraging retrieval-augmented generation (RAG) to provide relevant context and Monte Carlo Tree…

Computation and Language · Computer Science 2025-10-09 Yunhai Hu , Yilun Zhao , Chen Zhao , Arman Cohan

Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The success of MCTS depends heavily on how the MCTS statistical tree is built and the selection policy plays a fundamental role in this. A…

Artificial Intelligence · Computer Science 2023-02-08 Fred Valdez Ameneyro , Edgar Galvan

The key to Black-Box Optimization is to efficiently search through input regions with potentially widely-varying numerical properties, to achieve low-regret descent and fast progress toward the optima. Monte Carlo Tree Search (MCTS) methods…

Machine Learning · Computer Science 2022-11-03 Yaoguang Zhai , Sicun Gao

Online planning under uncertainty remains a critical challenge in robotics and autonomous systems. While tree search techniques are commonly employed to construct partial future trajectories within computational constraints, most existing…

Artificial Intelligence · Computer Science 2024-12-24 Michael Novitsky , Moran Barenboim , Vadim Indelman

Online planning is crucial for high performance in many complex sequential decision-making tasks. Monte Carlo Tree Search (MCTS) employs a principled mechanism for trading off exploration for exploitation for efficient online planning, and…

Artificial Intelligence · Computer Science 2024-02-08 Kalle Kujanpää , Amin Babadi , Yi Zhao , Juho Kannala , Alexander Ilin , Joni Pajarinen

We propose a novel method for reconstructing floor plans from noisy 3D point clouds. Our main contribution is a principled approach that relies on the Monte Carlo Tree Search (MCTS) algorithm to maximize a suitable objective function…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Sinisa Stekovic , Mahdi Rad , Friedrich Fraundorfer , Vincent Lepetit

This study explores how to enhance the reasoning capabilities of large language models (LLMs) in knowledge base question answering (KBQA) by leveraging Monte Carlo Tree Search (MCTS). Semantic parsing-based KBQA methods are particularly…

Computation and Language · Computer Science 2025-02-20 Guanming Xiong , Haochen Li , Wen Zhao

We examine a type of modified Monte Carlo Tree Search (MCTS) for strategising in combinatorial games. The modifications are derived by analysing simplified strategies and simplified versions of the underlying game and then using the results…

Computer Science and Game Theory · Computer Science 2025-01-14 Michael Haythorpe , Alex Newcombe , Damian O'Dea