English
Related papers

Related papers: Lookahead Pathology in Monte-Carlo Tree Search

200 papers

Monte-Carlo Tree Search (MCTS) is a class of methods for solving complex decision-making problems through the synergy of Monte-Carlo planning and Reinforcement Learning (RL). The highly combinatorial nature of the problems commonly…

Artificial Intelligence · Computer Science 2022-02-16 Tuan Dam , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Popular Monte-Carlo tree search (MCTS) algorithms for online planning, such as epsilon-greedy tree search and UCT, aim at rapidly identifying a reasonably good action, but provide rather poor worst-case guarantees on performance improvement…

Artificial Intelligence · Computer Science 2013-09-27 Zohar Feldman , Carmel Domshlak

The combination of Monte-Carlo Tree Search (MCTS) and deep reinforcement learning is state-of-the-art in two-player perfect-information games. In this paper, we describe a search algorithm that uses a variant of MCTS which we enhanced by 1)…

Machine Learning · Computer Science 2020-05-26 Arta Seify , Michael Buro

One of the most important AI research questions is to trade off computation versus performance since ``perfect rationality" exists in theory but is impossible to achieve in practice. Recently, Monte-Carlo tree search (MCTS) has attracted…

Artificial Intelligence · Computer Science 2022-10-25 Weirui Ye , Pieter Abbeel , Yang Gao

The integration of autonomous vehicles into urban and highway environments necessitates the development of robust and adaptable behavior planning systems. This study presents an innovative approach to address this challenge by utilizing a…

Robotics · Computer Science 2023-10-19 Qianfeng Wen , Zhongyi Gong , Lifeng Zhou , Zhongshun Zhang

The combination of multi-armed bandit (MAB) algorithms with Monte-Carlo tree search (MCTS) has made a significant impact in various research fields. The UCT algorithm, which combines the UCB bandit algorithm with MCTS, is a good example of…

Artificial Intelligence · Computer Science 2016-05-10 Yun-Ching Liu , Yoshimasa Tsuruoka

Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The success of MCTS depends heavily on how the tree is built and the selection process plays a fundamental role in this. One particular…

Neural and Evolutionary Computing · Computer Science 2022-08-30 Edgar Galván , Gavin Simpson , Fred Valdez Ameneyro

Monte Carlo tree search (MCTS) has received considerable interest due to its spectacular success in the difficult problem of computer Go and also proved beneficial in a range of other domains. A major issue that has received little…

Machine Learning · Computer Science 2019-05-10 Aurelien Pelissier , Atsuyoshi Nakamura , Koji Tabata

Computational Intelligence (CI) in computer games plays an important role that could simulate various aspects of real-life problems. CI in real-time decision-making games can provide a platform for the examination of tree search algorithms.…

Human-Computer Interaction · Computer Science 2018-04-30 Shabnam Sadeghi Esfahlani , George Wilson

We consider Monte-Carlo Tree Search (MCTS) applied to Markov Decision Processes (MDPs) and Partially Observable MDPs (POMDPs), and the well-known Upper Confidence bound for Trees (UCT) algorithm. In UCT, a tree with nodes (states) and edges…

Artificial Intelligence · Computer Science 2020-07-14 Tuan Dam , Pascal Klink , Carlo D'Eramo , Jan Peters , Joni Pajarinen

UCT, a state-of-the art algorithm for Monte Carlo tree search (MCTS) in games and Markov decision processes, is based on UCB, a sampling policy for the Multi-armed Bandit problem (MAB) that minimizes the cumulative regret. However, search…

Artificial Intelligence · Computer Science 2012-07-25 David Tolpin , Solomon Eyal Shimony

We examine a type of modified Monte Carlo Tree Search (MCTS) for strategising in combinatorial games. The modifications are derived by analysing simplified strategies and simplified versions of the underlying game and then using the results…

Computer Science and Game Theory · Computer Science 2025-01-14 Michael Haythorpe , Alex Newcombe , Damian O'Dea

General Video Game Playing (GVGP) is a field of Artificial Intelligence where agents play a variety of real-time video games that are unknown in advance. This limits the use of domain-specific heuristics. Monte-Carlo Tree Search (MCTS) is a…

Artificial Intelligence · Computer Science 2024-07-04 Dennis J. N. J. Soemers , Chiara F. Sironi , Torsten Schuster , Mark H. M. Winands

Probabilistic search algorithms, such as Monte Carlo Tree Search (MCTS), have proven very effective in solving sequential decision-making tasks under uncertainty. However, interpreting asymmetric search trees that incorporate bandit-based…

Human-Computer Interaction · Computer Science 2026-05-21 Siqi Lu , Mirsaleh Bahavarnia , Hiba Baroud , Yixuan Zhang , Hemant Purohit , Ayan Mukhopadhyay

AlphaZero, using a combination of Deep Neural Networks and Monte Carlo Tree Search (MCTS), has successfully trained reinforcement learning agents in a tabula-rasa way. The neural MCTS algorithm has been successful in finding near-optimal…

Artificial Intelligence · Computer Science 2021-10-12 Prashank Kadam , Ruiyang Xu , Karl Lieberherr

The discovery of patterns that accurately discriminate one class label from another remains a challenging data mining task. Subgroup discovery (SD) is one of the frameworks that enables to elicit such interesting hypotheses from labeled…

Data Structures and Algorithms · Computer Science 2017-12-07 Guillaume Bosc , Jean-François Boulicaut , Chedy Raïssi , Mehdi Kaytoue

We explore applying the Monte Carlo Tree Search (MCTS) algorithm in a notoriously difficult task: tuning programs for high-performance deep learning and image processing. We build our framework on top of Halide and show that MCTS can…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Ameer Haj-Ali , Hasan Genc , Qijing Huang , William Moses , John Wawrzynek , Krste Asanović , Ion Stoica

Online planning is crucial for high performance in many complex sequential decision-making tasks. Monte Carlo Tree Search (MCTS) employs a principled mechanism for trading off exploration for exploitation for efficient online planning, and…

Artificial Intelligence · Computer Science 2024-02-08 Kalle Kujanpää , Amin Babadi , Yi Zhao , Juho Kannala , Alexander Ilin , Joni Pajarinen

In the world of embedded systems, optimizing actions with the uncertain costs of multiple resources is a complex challenge. Existing methods include plan building based on Monte Carlo Tree Search (MCTS), an approach that thrives in multiple…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Franco Cordeiro , Samuel Tardieu , Laurent Pautet

We consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of finite-horizon Markov decision process. We propose a dynamic sampling tree policy that…

Artificial Intelligence · Computer Science 2023-05-09 Gongbo Zhang , Yijie Peng , Yilong Xu