English
Related papers

Related papers: Policy Gradient Search: Online Planning and Expert…

200 papers

Monte Carlo Tree Search (MCTS) has shown its strength for a lot of deterministic and stochastic examples, but literature lacks reports of applications to real world industrial processes. Common reasons for this are that there is no…

Artificial Intelligence · Computer Science 2021-08-05 Dorina Weichert , Felix Horchler , Alexander Kister , Marcus Trost , Johannes Hartung , Stefan Risse

AlphaZero, using a combination of Deep Neural Networks and Monte Carlo Tree Search (MCTS), has successfully trained reinforcement learning agents in a tabula-rasa way. The neural MCTS algorithm has been successful in finding near-optimal…

Artificial Intelligence · Computer Science 2021-10-12 Prashank Kadam , Ruiyang Xu , Karl Lieberherr

Monte Carlo Tree Search (MCTS) is a branch of stochastic modeling that utilizes decision trees for optimization, mostly applied to artificial intelligence (AI) game players. This project imagines a game in which an AI player searches for a…

Machine Learning · Computer Science 2020-12-01 Elana Kozak , Scott Hottovy

Monte Carlo Tree Search (MCTS) has improved the performance of game engines in domains such as Go, Hex, and general game playing. MCTS has been shown to outperform classic alpha-beta search in games where good heuristic evaluations are…

Artificial Intelligence · Computer Science 2014-06-23 Marc Lanctot , Mark H. M. Winands , Tom Pepels , Nathan R. Sturtevant

Online planning in continuous state, action, and observation spaces remains challenging for autonomous systems. While Monte Carlo Tree Search (MCTS) scales effectively via sampling, most continuous (PO)MDP solvers do not exploit…

Artificial Intelligence · Computer Science 2026-05-19 Idan Lev-Yehudi , Michael Novitsky , Moran Barenboim , Ron Benchetrit , Vadim Indelman

One of the most important AI research questions is to trade off computation versus performance since ``perfect rationality" exists in theory but is impossible to achieve in practice. Recently, Monte-Carlo tree search (MCTS) has attracted…

Artificial Intelligence · Computer Science 2022-10-25 Weirui Ye , Pieter Abbeel , Yang Gao

In this work we study a well-known and challenging problem of Multi-agent Pathfinding, when a set of agents is confined to a graph, each agent is assigned a unique start and goal vertices and the task is to find a set of collision-free…

Artificial Intelligence · Computer Science 2023-07-26 Yelisey Pitanov , Alexey Skrynnik , Anton Andreychuk , Konstantin Yakovlev , Aleksandr Panov

Monte Carlo Tree Search (MCTS) is particularly adapted to domains where the potential actions can be represented as a tree of sequential decisions. For an effective action selection, MCTS performs many simulations to build a reliable tree…

Artificial Intelligence · Computer Science 2018-09-10 Seydou Ba , Takuya Hiraoka , Takashi Onishi , Toru Nakata , Yoshimasa Tsuruoka

The combination of Monte-Carlo tree search (MCTS) with deep reinforcement learning has led to significant advances in artificial intelligence. However, AlphaZero, the current state-of-the-art MCTS algorithm, still relies on handcrafted…

Machine Learning · Computer Science 2020-07-27 Jean-Bastien Grill , Florent Altché , Yunhao Tang , Thomas Hubert , Michal Valko , Ioannis Antonoglou , Rémi Munos

We explore applying the Monte Carlo Tree Search (MCTS) algorithm in a notoriously difficult task: tuning programs for high-performance deep learning and image processing. We build our framework on top of Halide and show that MCTS can…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Ameer Haj-Ali , Hasan Genc , Qijing Huang , William Moses , John Wawrzynek , Krste Asanović , Ion Stoica

Monte-Carlo Tree Search (MCTS) is a fundamental sampling-based search algorithm widely used for online planning in sequential decision-making domains. Despite its success in driving recent advances in artificial intelligence, understanding…

Artificial Intelligence · Computer Science 2026-04-17 Yiyu Qian , Liyuan Zhao , Tim Miller

Sequential decision-making under uncertainty is present in many important problems. Two popular approaches for tackling such problems are reinforcement learning and online search (e.g., Monte Carlo tree search). While the former learns a…

Artificial Intelligence · Computer Science 2024-01-23 Ava Pettet , Yunuo Zhang , Baiting Luo , Kyle Wray , Hendrik Baier , Aron Laszka , Abhishek Dubey , Ayan Mukhopadhyay

Monte Carlo Tree Search (MCTS) methods have proven powerful in planning for sequential decision-making problems such as Go and video games, but their performance can be poor when the planning depth and sampling trajectories are limited or…

Artificial Intelligence · Computer Science 2016-04-26 Xiaoxiao Guo , Satinder Singh , Richard Lewis , Honglak Lee

In this research, we investigate the possibility of applying a search strategy to genetic algorithms to explore the entire genetic tree structure. Several methods aid in performing tree searches; however, simpler algorithms such as…

Neural and Evolutionary Computing · Computer Science 2023-08-10 Akshay Hebbar

In this paper, we study the effects of several Monte Carlo Tree Search (MCTS) modifications for video game testing. Although MCTS modifications are highly studied in game playing, their impacts on finding bugs are blank. We focused on bug…

Artificial Intelligence · Computer Science 2020-03-18 Sinan Ariyurek , Aysu Betin-Can , Elif Surer

This paper presents an efficient approach to object manipulation planning using Monte Carlo Tree Search (MCTS) to find contact sequences and an efficient ADMM-based trajectory optimization algorithm to evaluate the dynamic feasibility of…

Robotics · Computer Science 2023-03-21 Huaijiang Zhu , Avadesh Meduri , Ludovic Righetti

The article presents the use of Monte Carlo Tree Search algorithms for the card game Lord of the Rings. The main challenge was the complexity of the game mechanics, in which each round consists of 5 decision stages and 2 random stages. To…

Artificial Intelligence · Computer Science 2021-09-28 Konrad Godlewski , Bartosz Sawicki

We examine a type of modified Monte Carlo Tree Search (MCTS) for strategising in combinatorial games. The modifications are derived by analysing simplified strategies and simplified versions of the underlying game and then using the results…

Computer Science and Game Theory · Computer Science 2025-01-14 Michael Haythorpe , Alex Newcombe , Damian O'Dea

We propose a novel Parallel Monte Carlo tree search with Batched Simulations (PMBS) algorithm for accelerating long-horizon, episodic robotic planning tasks. Monte Carlo tree search (MCTS) is an effective heuristic search algorithm for…

Robotics · Computer Science 2022-07-15 Baichuan Huang , Abdeslam Boularias , Jingjin Yu

Inference-time search algorithms such as Monte-Carlo Tree Search (MCTS) may seem unnecessary when generating natural language text based on state-of-the-art reinforcement learning such as Proximal Policy Optimization (PPO). In this paper,…

Computation and Language · Computer Science 2024-04-03 Jiacheng Liu , Andrew Cohen , Ramakanth Pasunuru , Yejin Choi , Hannaneh Hajishirzi , Asli Celikyilmaz