English
Related papers

Related papers: Monte Carlo Tree Search Based Tactical Maneuvering

200 papers

Popular Monte-Carlo tree search (MCTS) algorithms for online planning, such as epsilon-greedy tree search and UCT, aim at rapidly identifying a reasonably good action, but provide rather poor worst-case guarantees on performance improvement…

Artificial Intelligence · Computer Science 2013-09-27 Zohar Feldman , Carmel Domshlak

Today's automated vehicles lack the ability to cooperate implicitly with others. This work presents a Monte Carlo Tree Search (MCTS) based approach for decentralized cooperative planning using macro-actions for automated vehicles in…

Artificial Intelligence · Computer Science 2020-02-04 Karl Kurzer , Chenyang Zhou , J. Marius Zöllner

Planning problems are among the most important and well-studied problems in artificial intelligence. They are most typically solved by tree search algorithms that simulate ahead into the future, evaluate future states, and back-up those…

Artificial Intelligence · Computer Science 2018-07-18 Arthur Guez , Théophane Weber , Ioannis Antonoglou , Karen Simonyan , Oriol Vinyals , Daan Wierstra , Rémi Munos , David Silver

In recent years, Monte Carlo tree search (MCTS) has achieved widespread adoption within the game community. Its use in conjunction with deep reinforcement learning has produced success stories in many applications. While these approaches…

Artificial Intelligence · Computer Science 2024-04-02 Kimiya Saadat , Richard Zhao

This paper proposes a new game-search algorithm, PN-MCTS, which combines Monte-Carlo Tree Search (MCTS) and Proof-Number Search (PNS). These two algorithms have been successfully applied for decision making in a range of domains. We define…

Artificial Intelligence · Computer Science 2024-05-30 Jakub Kowalski , Elliot Doe , Mark H. M. Winands , Daniel Górski , Dennis J. N. J. Soemers

Monte Carlo Tree Search (MCTS) algorithms have achieved great success on many challenging benchmarks (e.g., Computer Go). However, they generally require a large number of rollouts, making their applications costly. Furthermore, it is also…

Machine Learning · Computer Science 2020-02-27 Anji Liu , Jianshu Chen , Mingze Yu , Yu Zhai , Xuewen Zhou , Ji Liu

Monte Carlo tree search (MCTS) has achieved state-of-the-art results in many domains such as Go and Atari games when combining with deep neural networks (DNNs). When more simulations are executed, MCTS can achieve higher performance but…

Artificial Intelligence · Computer Science 2020-12-16 Li-Cheng Lan , Meng-Yu Tsai , Ti-Rong Wu , I-Chen Wu , Cho-Jui Hsieh

We present Doubly Robust Monte Carlo Tree Search (DR-MCTS), a novel algorithm that integrates Doubly Robust (DR) off-policy estimation into Monte Carlo Tree Search (MCTS) to enhance sample efficiency and decision quality in complex…

Machine Learning · Statistics 2025-02-05 Manqing Liu , Andrew L. Beam

Monte Carlo Tree Search (MCTS) has recently been successfully used to create strategies for playing imperfect-information games. Despite its popularity, there are no theoretic results that guarantee its convergence to a well-defined…

Computer Science and Game Theory · Computer Science 2015-09-02 Vojtěch Kovařík , Viliam Lisý

Monte Carlo Tree Search (MCTS) is a widely used approach for policy improvement through search with increasing popularity for real world applications. Due to the sequential and deterministic nature of its search, runtime-scaling of MCTS…

Machine Learning · Computer Science 2026-05-22 Yaniv Oren , Viliam Vadocz , Joery A. de Vries , Wendelin Böhmer , Matthijs T. J. Spaan , Hendrik Baier

Deep Neural Network guided Monte-Carlo Tree Search (DNN-MCTS) is a powerful class of AI algorithms. In DNN-MCTS, a Deep Neural Network model is trained collaboratively with a dynamic Monte-Carlo search tree to guide the agent towards…

Performance · Computer Science 2023-10-10 Yuan Meng , Qian Wang , Tianxin Zu , Viktor Prasanna

Online planning under uncertainty remains a critical challenge in robotics and autonomous systems. While tree search techniques are commonly employed to construct partial future trajectories within computational constraints, most existing…

Artificial Intelligence · Computer Science 2024-12-24 Michael Novitsky , Moran Barenboim , Vadim Indelman

We present a new Monte Carlo Tree Search (MCTS) algorithm to solve the stochastic orienteering problem with chance constraints, i.e., a version of the problem where travel costs are random, and one is assigned a bound on the tolerable…

Robotics · Computer Science 2024-09-06 Stefano Carpin

Despite its groundbreaking success in Go and computer games, Monte Carlo Tree Search (MCTS) is computationally expensive as it requires a substantial number of rollouts to construct the search tree, which calls for effective…

Machine Learning · Computer Science 2020-10-06 Anji Liu , Yitao Liang , Ji Liu , Guy Van den Broeck , Jianshu Chen

Taking into account future risk is essential for an autonomously operating robot to find online not only the best but also a safe action to execute. In this paper, we build upon the recently introduced formulation of probabilistic…

Artificial Intelligence · Computer Science 2024-11-12 Andrey Zhitnikov , Vadim Indelman

We study how to efficiently combine formal methods, Monte Carlo Tree Search (MCTS), and deep learning in order to produce high-quality receding horizon policies in large Markov Decision processes (MDPs). In particular, we use model-checking…

Artificial Intelligence · Computer Science 2023-08-16 Debraj Chakraborty , Damien Busatto-Gaston , Jean-François Raskin , Guillermo A. Pérez

Urban traffic scenarios often require a high degree of cooperation between traffic participants to ensure safety and efficiency. Observing the behavior of others, humans infer whether or not others are cooperating. This work aims to extend…

Artificial Intelligence · Computer Science 2020-02-04 Karl Kurzer , Florian Engelhorn , J. Marius Zöllner

Monte-Carlo Tree Search (MCTS) is a fundamental sampling-based search algorithm widely used for online planning in sequential decision-making domains. Despite its success in driving recent advances in artificial intelligence, understanding…

Artificial Intelligence · Computer Science 2026-04-17 Yiyu Qian , Liyuan Zhao , Tim Miller

Leveraging the power of a graph neural network (GNN) with message passing, we present a Monte Carlo Tree Search (MCTS) method to solve stochastic orienteering problems with chance constraints. While adhering to an assigned travel budget the…

Robotics · Computer Science 2025-08-19 Marcos Abel Zuzuárregui , Stefano Carpin

Monte-Carlo Tree Search (MCTS) methods are drawing great interest after yielding breakthrough results in computer Go. This paper proposes a Bayesian approach to MCTS that is inspired by distributionfree approaches such as UCT [13], yet…

Machine Learning · Computer Science 2012-03-19 Gerald Tesauro , V T Rajan , Richard Segal