English
Related papers

Related papers: Improving Hearthstone AI by Combining MCTS and Sup…

200 papers

Traditional reinforcement learning and planning typically requires vast amounts of data and training to develop effective policies. In contrast, large language models (LLMs) exhibit strong generalization and zero-shot capabilities, but…

Artificial Intelligence · Computer Science 2025-07-30 Jonathan Light , Min Cai , Weiqin Chen , Guanzhi Wang , Xiusi Chen , Wei Cheng , Yisong Yue , Ziniu Hu

Today's automated vehicles lack the ability to cooperate implicitly with others. This work presents a Monte Carlo Tree Search (MCTS) based approach for decentralized cooperative planning using macro-actions for automated vehicles in…

Artificial Intelligence · Computer Science 2020-02-04 Karl Kurzer , Chenyang Zhou , J. Marius Zöllner

The Hearthstone AI framework and competition motivates the development of artificial intelligence agents that can play collectible card games. A special feature of those games is the high variety of cards, which can be chosen by the players…

Artificial Intelligence · Computer Science 2019-06-12 Alexander Dockhorn , Sanaz Mostaghim

We present a new Monte Carlo Tree Search (MCTS) algorithm to solve the stochastic orienteering problem with chance constraints, i.e., a version of the problem where travel costs are random, and one is assigned a bound on the tolerable…

Robotics · Computer Science 2024-09-06 Stefano Carpin

The UCT algorithm, which combines the UCB algorithm and Monte-Carlo Tree Search (MCTS), is currently the most widely used variant of MCTS. Recently, a number of investigations into applying other bandit algorithms to MCTS have produced…

Artificial Intelligence · Computer Science 2015-05-13 Yun-Ching Liu , Yoshimasa Tsuruoka

This paper introduces a novel backup strategy for Monte-Carlo Tree Search (MCTS) designed for highly stochastic and partially observable Markov decision processes. We adopt a probabilistic approach, modeling both value and action-value…

Artificial Intelligence · Computer Science 2023-09-20 Tuan Dam , Pascal Stenger , Lukas Schneider , Joni Pajarinen , Carlo D'Eramo , Odalric-Ambrym Maillard

In this paper, we address a method that integrates reinforcement learning into the Monte Carlo tree search to boost online path planning under fully observable environments for automated parking tasks. Sampling-based planning methods under…

Artificial Intelligence · Computer Science 2025-01-03 Xinlong Zheng , Xiaozhou Zhang , Donghao Xu

Recently, the seminal algorithms AlphaGo and AlphaZero have started a new era in game learning and deep reinforcement learning. While the achievements of AlphaGo and AlphaZero - playing Go and other complex games at super human level - are…

Machine Learning · Computer Science 2022-09-27 Johannes Scheiermann , Wolfgang Konen

We study Monte Carlo tree search (MCTS) in zero-sum extensive-form games with perfect information and simultaneous moves. We present a general template of MCTS algorithms for these games, which can be instantiated by various selection…

Computer Science and Game Theory · Computer Science 2013-12-16 Viliam Lisý , Vojtěch Kovařík , Marc Lanctot , Branislav Bošanský

This paper introduces MCTS-EP, an online learning framework that combines large language models (LLM) with Monte Carlo Tree Search (MCTS) for training embodied agents. MCTS-EP integrates three key components: MCTS-guided exploration for…

Artificial Intelligence · Computer Science 2025-12-17 Hang Xu , Zang Yu , Yehui Tang , Pengbo Hu , Yuhao Tang , Hao Dong

This technical report documents the winner of the Computational Intelligence in Games(CIG) 2018 Hanabi competition. We introduce Re-determinizing IS-MCTS, a novel extension of Information Set Monte Carlo Tree Search (IS-MCTS) that prevents…

Artificial Intelligence · Computer Science 2019-05-16 James Goodman

Recent algorithms in machine translation have included a value network to assist the policy network when deciding which word to output at each step of the translation. The addition of a value network helps the algorithm perform better on…

Computation and Language · Computer Science 2020-04-28 Jerrod Parker , Jerry Zikun Chen

Despite its groundbreaking success in Go and computer games, Monte Carlo Tree Search (MCTS) is computationally expensive as it requires a substantial number of rollouts to construct the search tree, which calls for effective…

Machine Learning · Computer Science 2020-10-06 Anji Liu , Yitao Liang , Ji Liu , Guy Van den Broeck , Jianshu Chen

For UAV-aided wireless systems, online path planning attracts much attention recently. To better adapt to the real-time dynamic environment, we, for the first time, propose a Monte Carlo Tree Search (MCTS)-based path planning scheme. In…

Networking and Internet Architecture · Computer Science 2022-02-08 Yuwen Qian , Kexin Sheng , Chuan Ma , Jun Li , Ming Ding , Mahbub Hassan

We propose a novel Parallel Monte Carlo tree search with Batched Simulations (PMBS) algorithm for accelerating long-horizon, episodic robotic planning tasks. Monte Carlo tree search (MCTS) is an effective heuristic search algorithm for…

Robotics · Computer Science 2022-07-15 Baichuan Huang , Abdeslam Boularias , Jingjin Yu

The single-track railway train timetabling problem (TTP) is an important and complex problem. This article proposes an integrated Monte Carlo Tree Search (MCTS) computing framework that combines heuristic methods, unsupervised learning…

Machine Learning · Computer Science 2023-11-03 Feiyu Yang

This paper presents Generalized Proof-Number Monte-Carlo Tree Search: a generalization of recently proposed combinations of Proof-Number Search (PNS) with Monte-Carlo Tree Search (MCTS), which use (dis)proof numbers to bias UCB1-based…

Artificial Intelligence · Computer Science 2025-06-17 Jakub Kowalski , Dennis J. N. J. Soemers , Szymon Kosakowski , Mark H. M. Winands

Decades of research have been invested in making computer programs for playing games such as Chess and Go. This paper focuses on a new game, Tetris Link, a board game that is still lacking any scientific analysis. Tetris Link has a large…

Artificial Intelligence · Computer Science 2020-04-02 Matthias Muller-Brockhausen , Mike Preuss , Aske Plaat

This paper presents an efficient approach to object manipulation planning using Monte Carlo Tree Search (MCTS) to find contact sequences and an efficient ADMM-based trajectory optimization algorithm to evaluate the dynamic feasibility of…

Robotics · Computer Science 2023-03-21 Huaijiang Zhu , Avadesh Meduri , Ludovic Righetti

This study investigates the combined use of generative grammar rules and Monte Carlo Tree Search (MCTS) for optimizing truss structures. Our approach accommodates intermediate construction stages characteristic of progressive construction…

Computational Engineering, Finance, and Science · Computer Science 2025-04-03 Gabriel Garayalde , Luca Rosafalco , Matteo Torzoni , Alberto Corigliano