English
Related papers

Related papers: Single-Agent Optimization Through Policy Iteration…

200 papers

Monte Carlo Tree Search (MCTS) methods have proven powerful in planning for sequential decision-making problems such as Go and video games, but their performance can be poor when the planning depth and sampling trajectories are limited or…

Artificial Intelligence · Computer Science 2016-04-26 Xiaoxiao Guo , Satinder Singh , Richard Lewis , Honglak Lee

Monte Carlo Tree Search (MCTS) is a relatively new sampling method with multiple variants in the literature. They can be applied to a wide variety of challenging domains including board games, video games, and energy-based problems to…

Artificial Intelligence · Computer Science 2020-10-06 Fred Valdez Ameneyro , Edgar Galvan , Anger Fernando Kuri Morales

Monte-Carlo planning and Reinforcement Learning (RL) are essential to sequential decision making. The recent AlphaGo and AlphaZero algorithms have shown how to successfully combine these two paradigms in order to solve large scale…

Machine Learning · Computer Science 2021-02-17 Tuan Dam , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Monte Carlo tree search (MCTS) has been successful in a variety of domains, but faces challenges with long-horizon exploration when compared to sampling-based motion planning algorithms like Rapidly-Exploring Random Trees. To address these…

Machine Learning · Computer Science 2024-07-09 Liam Schramm , Abdeslam Boularias

Bayes-optimal behavior, while well-defined, is often difficult to achieve. Recent advances in the use of Monte-Carlo tree search (MCTS) have shown that it is possible to act near-optimally in Markov Decision Processes (MDPs) with very large…

Artificial Intelligence · Computer Science 2012-02-20 John Asmuth , Michael L. Littman

Inspired by recent successes of Monte-Carlo tree search (MCTS) in a number of artificial intelligence (AI) application domains, we propose a model-based reinforcement learning (RL) technique that iteratively applies MCTS on batches of…

Artificial Intelligence · Computer Science 2018-05-16 Daniel R. Jiang , Emmanuel Ekwedike , Han Liu

Today's automated vehicles lack the ability to cooperate implicitly with others. This work presents a Monte Carlo Tree Search (MCTS) based approach for decentralized cooperative planning using macro-actions for automated vehicles in…

Artificial Intelligence · Computer Science 2020-02-04 Karl Kurzer , Chenyang Zhou , J. Marius Zöllner

Inference-time scaling strategies, particularly Monte Carlo Tree Search (MCTS), have significantly enhanced the reasoning capabilities of Large Language Models (LLMs). However, current approaches remain predominantly stateless, discarding…

Artificial Intelligence · Computer Science 2026-02-05 Hao Lu , Haoyuan Huang , Yulin Zhou , Chen Li , Ningxin Zhu

Games, including abstract board games, constitute a convenient ground to create, design, and improve new AI methods. In this field, Monte Carlo Tree Search is a popular algorithm family, aiming to build game trees and explore them…

Artificial Intelligence · Computer Science 2024-06-14 Florian Richoux

We present Doubly Robust Monte Carlo Tree Search (DR-MCTS), a novel algorithm that integrates Doubly Robust (DR) off-policy estimation into Monte Carlo Tree Search (MCTS) to enhance sample efficiency and decision quality in complex…

Machine Learning · Statistics 2025-02-05 Manqing Liu , Andrew L. Beam

In many games, moves consist of several decisions made by the player. These decisions can be viewed as separate moves, which is already a common practice in multi-action games for efficiency reasons. Such division of a player move into a…

Artificial Intelligence · Computer Science 2021-12-16 Jakub Kowalski , Maksymilian Mika , Wojciech Pawlik , Jakub Sutowicz , Marek Szykuła , Mark H. M. Winands

Despite its groundbreaking success in Go and computer games, Monte Carlo Tree Search (MCTS) is computationally expensive as it requires a substantial number of rollouts to construct the search tree, which calls for effective…

Machine Learning · Computer Science 2020-10-06 Anji Liu , Yitao Liang , Ji Liu , Guy Van den Broeck , Jianshu Chen

In this paper, we study the effects of several Monte Carlo Tree Search (MCTS) modifications for video game testing. Although MCTS modifications are highly studied in game playing, their impacts on finding bugs are blank. We focused on bug…

Artificial Intelligence · Computer Science 2020-03-18 Sinan Ariyurek , Aysu Betin-Can , Elif Surer

Recent advances in bandit tools and techniques for sequential learning are steadily enabling new applications and are promising the resolution of a range of challenging related problems. We study the game tree search problem, where the goal…

Machine Learning · Statistics 2017-11-07 Emilie Kaufmann , Wouter Koolen

Traditional reinforcement learning and planning typically requires vast amounts of data and training to develop effective policies. In contrast, large language models (LLMs) exhibit strong generalization and zero-shot capabilities, but…

Artificial Intelligence · Computer Science 2025-07-30 Jonathan Light , Min Cai , Weiqin Chen , Guanzhi Wang , Xiusi Chen , Wei Cheng , Yisong Yue , Ziniu Hu

In this research, we investigate the possibility of applying a search strategy to genetic algorithms to explore the entire genetic tree structure. Several methods aid in performing tree searches; however, simpler algorithms such as…

Neural and Evolutionary Computing · Computer Science 2023-08-10 Akshay Hebbar

This paper introduces Monte Carlo *-Minimax Search (MCMS), a Monte Carlo search algorithm for turned-based, stochastic, two-player, zero-sum games of perfect information. The algorithm is designed for the class of of densely stochastic…

Computer Science and Game Theory · Computer Science 2013-04-23 Marc Lanctot , Abdallah Saffidine , Joel Veness , Christopher Archibald , Mark H. M. Winands

Monte-Carlo Tree Search (MCTS) is a widely-used strategy for online planning that combines Monte-Carlo sampling with forward tree search. Its success relies on the Upper Confidence bound for Trees (UCT) algorithm, an extension of the UCB…

Artificial Intelligence · Computer Science 2024-06-05 Tuan Dam , Odalric-Ambrym Maillard , Emilie Kaufmann

The key to Black-Box Optimization is to efficiently search through input regions with potentially widely-varying numerical properties, to achieve low-regret descent and fast progress toward the optima. Monte Carlo Tree Search (MCTS) methods…

Machine Learning · Computer Science 2022-11-03 Yaoguang Zhai , Sicun Gao

This paper introduces a new Negotiating Agent for automated negotiation on continuous domains and without considering a specified deadline. The agent bidding strategy relies on Monte Carlo Tree Search, which is a trendy method since it has…

Artificial Intelligence · Computer Science 2019-04-01 Cédric Buron , Zahia Guessoum , Sylvain Ductor