English
Related papers

Related papers: Diverse, Top-k, and Top-Quality Planning Over Simu…

200 papers

Monte-Carlo tree search (MCTS) is an effective anytime algorithm with a vast amount of applications. It strategically allocates computational resources to focus on promising segments of the search tree, making it a very attractive search…

Artificial Intelligence · Computer Science 2024-02-14 Cedric Derstroff , Jannis Brugger , Jannis Blüml , Mira Mezini , Stefan Kramer , Kristian Kersting

The performance of Variational Quantum Algorithms (VQAs) strongly depends on the choice of the parameterized quantum circuit to optimize. One of the biggest challenges in VQAs is designing quantum circuits tailored to the particular…

Quantum Physics · Physics 2026-05-06 Vincenzo Lipardi , Domenica Dibenedetto , Georgios Stamoulis , Mark H. M. Winands

Monte Carlo Tree Search (MCTS) is a powerful algorithm for solving complex decision-making problems. This paper presents an optimized MCTS implementation applied to the FrozenLake environment, a classic reinforcement learning task…

Artificial Intelligence · Computer Science 2024-09-26 Esteban Aldana Guerra

Monte Carlo Tree Search (MCTS) is a best-first sampling method employed in the search for optimal decisions. The effectiveness of MCTS relies on the construction of its statistical tree, with the selection policy playing a crucial role. A…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Edgar Galvan , Fred Valdez Ameneyro

We propose a novel method applicable in many scene understanding problems that adapts the Monte Carlo Tree Search (MCTS) algorithm, originally designed to learn to play games of high-state complexity. From a generated pool of proposals, our…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Sinisa Stekovic , Mahdi Rad , Alireza Moradi , Friedrich Fraundorfer , Vincent Lepetit

Monte Carlo Tree Search (MCTS), most famously used in game-play artificial intelligence (e.g., the game of Go), is a well-known strategy for constructing approximate solutions to sequential decision problems. Its primary innovation is the…

Optimization and Control · Mathematics 2017-04-21 Daniel R. Jiang , Lina Al-Kanj , Warren B. Powell

In this work we study a well-known and challenging problem of Multi-agent Pathfinding, when a set of agents is confined to a graph, each agent is assigned a unique start and goal vertices and the task is to find a set of collision-free…

Artificial Intelligence · Computer Science 2023-07-26 Yelisey Pitanov , Alexey Skrynnik , Anton Andreychuk , Konstantin Yakovlev , Aleksandr Panov

Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The success of MCTS depends heavily on how the MCTS statistical tree is built and the selection policy plays a fundamental role in this. A…

Artificial Intelligence · Computer Science 2023-02-08 Fred Valdez Ameneyro , Edgar Galvan

Popular Monte-Carlo tree search (MCTS) algorithms for online planning, such as epsilon-greedy tree search and UCT, aim at rapidly identifying a reasonably good action, but provide rather poor worst-case guarantees on performance improvement…

Artificial Intelligence · Computer Science 2013-09-27 Zohar Feldman , Carmel Domshlak

We consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of finite-horizon Markov decision process. We propose a dynamic sampling tree policy that…

Artificial Intelligence · Computer Science 2023-05-09 Gongbo Zhang , Yijie Peng , Yilong Xu

High-dimensional design spaces underpin a wide range of physics-based modeling and computational design tasks in science and engineering. These problems are commonly formulated as constrained black-box searches over rugged objective…

Machine Learning · Computer Science 2026-01-13 Suvo Banik , Troy D. Loeffler , Henry Chan , Sukriti Manna , Orcun Yildiz , Tom Peterka , Subramanian Sankaranarayanan

Monte-Carlo tree search (MCTS) has driven many recent breakthroughs in deep reinforcement learning (RL). However, scaling MCTS to parallel compute has proven challenging in practice which has motivated alternative planners like sequential…

Machine Learning · Computer Science 2025-07-09 Joery A. de Vries , Jinke He , Yaniv Oren , Matthijs T. J. Spaan

The Job Shop Scheduling Problem (JSSP) is a well-known optimization problem in manufacturing, where the goal is to determine the optimal sequence of jobs across different machines to minimize a given objective. In this work, we focus on…

Artificial Intelligence · Computer Science 2025-01-31 Laurie Boveroux , Damien Ernst , Quentin Louveaux

Monte Carlo Tree Search (MCTS) is a widely used approach for policy improvement through search with increasing popularity for real world applications. Due to the sequential and deterministic nature of its search, runtime-scaling of MCTS…

Machine Learning · Computer Science 2026-05-22 Yaniv Oren , Viliam Vadocz , Joery A. de Vries , Wendelin Böhmer , Matthijs T. J. Spaan , Hendrik Baier

Large language models (LLMs) have demonstrated remarkable capabilities in code generation and structured reasoning; however, their performance often degrades on complex tasks that require consistent multi-step planning. Recent work has…

Machine Learning · Computer Science 2025-08-11 Fei Xu Yu , Gina Adam , Nathaniel D. Bastian , Tian Lan

We propose a novel Parallel Monte Carlo tree search with Batched Simulations (PMBS) algorithm for accelerating long-horizon, episodic robotic planning tasks. Monte Carlo tree search (MCTS) is an effective heuristic search algorithm for…

Robotics · Computer Science 2022-07-15 Baichuan Huang , Abdeslam Boularias , Jingjin Yu

This work investigates the Monte Carlo Tree Search (MCTS) method combined with dedicated heuristics for solving the Weighted Vertex Coloring Problem. In addition to the basic MCTS algorithm, we study several MCTS variants where the…

Artificial Intelligence · Computer Science 2025-03-05 Cyril Grelier , Olivier Goudet , Jin-Kao Hao

It is common practice to use large computational resources to train neural networks, as is known from many examples, such as reinforcement learning applications. However, while massively parallel computing is often used for training models,…

Artificial Intelligence · Computer Science 2021-04-07 Xiufeng Yang , Tanuj Kr Aasawat , Kazuki Yoshizoe

In the world of embedded systems, optimizing actions with the uncertain costs of multiple resources is a complex challenge. Existing methods include plan building based on Monte Carlo Tree Search (MCTS), an approach that thrives in multiple…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Franco Cordeiro , Samuel Tardieu , Laurent Pautet

The AutoML task consists of selecting the proper algorithm in a machine learning portfolio, and its hyperparameter values, in order to deliver the best performance on the dataset at hand. Mosaic, a Monte-Carlo tree search (MCTS) based…

Machine Learning · Computer Science 2019-10-09 Herilalaina Rakotoarison , Marc Schoenauer , Michèle Sebag