English
Related papers

Related papers: Monte-Carlo Tree Search for Multi-Agent Pathfindin…

200 papers

Building agents based on tree-search planning capabilities with learned models has achieved remarkable success in classic decision-making problems, such as Go and Atari. However, it has been deemed challenging or even infeasible to extend…

Machine Learning · Computer Science 2023-10-13 Yazhe Niu , Yuan Pu , Zhenjie Yang , Xueyan Li , Tong Zhou , Jiyuan Ren , Shuai Hu , Hongsheng Li , Yu Liu

The article presents research on the use of Monte-Carlo Tree Search (MCTS) methods to create an artificial player for the popular card game "The Lord of the Rings". The game is characterized by complicated rules, multi-stage round…

Machine Learning · Computer Science 2021-09-27 Konrad Godlewski , Bartosz Sawicki

Dynamic resource allocation (DRA) problems are an important class of dynamic stochastic optimization problems that arise in a variety of important real-world applications. DRA problems are notoriously difficult to solve to optimality since…

Optimization and Control · Mathematics 2014-05-22 Dimitris Bertsimas , J. Daniel Griffith , Vishal Gupta , Mykel J. Kochenderfer , Velibor V. Mišić , Robert Moss

The discovery of patterns that accurately discriminate one class label from another remains a challenging data mining task. Subgroup discovery (SD) is one of the frameworks that enables to elicit such interesting hypotheses from labeled…

Data Structures and Algorithms · Computer Science 2017-12-07 Guillaume Bosc , Jean-François Boulicaut , Chedy Raïssi , Mehdi Kaytoue

Sequential decision-making under uncertainty is present in many important problems. Two popular approaches for tackling such problems are reinforcement learning and online search (e.g., Monte Carlo tree search). While the former learns a…

Artificial Intelligence · Computer Science 2024-01-23 Ava Pettet , Yunuo Zhang , Baiting Luo , Kyle Wray , Hendrik Baier , Aron Laszka , Abhishek Dubey , Ayan Mukhopadhyay

Inference-time scaling strategies, particularly Monte Carlo Tree Search (MCTS), have significantly enhanced the reasoning capabilities of Large Language Models (LLMs). However, current approaches remain predominantly stateless, discarding…

Artificial Intelligence · Computer Science 2026-02-05 Hao Lu , Haoyuan Huang , Yulin Zhou , Chen Li , Ningxin Zhu

Automated cyber defense (ACD) seeks to protect computer networks with minimal or no human intervention, reacting to intrusions by taking corrective actions such as isolating hosts, resetting services, deploying decoys, or updating access…

Machine Learning · Computer Science 2026-01-12 Yu Li , Sizhe Tang , Rongqian Chen , Fei Xu Yu , Guangyu Jiang , Mahdi Imani , Nathaniel D. Bastian , Tian Lan

The problem of Multi-Agent Path Finding (MAPF) calls for finding a set of conflict-free paths for a fleet of agents operating in a given environment. Arguably, the state-of-the-art approach to computing optimal solutions is Conflict-Based…

Multiagent Systems · Computer Science 2021-04-20 Ofir Gordon , Yuval Filmus , Oren Salzman

In large domains, Monte-Carlo tree search (MCTS) is required to estimate the values of the states as efficiently and accurately as possible. However, the standard update rule in backpropagation assumes a stationary distribution for the…

Machine Learning · Computer Science 2020-01-28 Yueqin Li , Nengli Lim

We study an efficient implementation of Multi-Armed Bandit (MAB)-based Monte-Carlo Tree Search (MCTS) for classical planning. One weakness of MCTS is that it spends a significant time deciding which node to expand next. While selecting a…

Artificial Intelligence · Computer Science 2025-11-18 Masataro Asai

We present an algorithm for finding optimal paths for multiple stochastic agents in a graph to reach their destinations with a user-specified maximum pairwise collision probability. Our algorithm, called STT-CBS, uses Conflict-Based Search…

Robotics · Computer Science 2021-09-01 Oriana Peltzer , Kyle Brown , Mac Schwager , Mykel J. Kochenderfer , Martin Sehr

Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The success of MCTS depends heavily on how the MCTS statistical tree is built and the selection policy plays a fundamental role in this. A…

Artificial Intelligence · Computer Science 2023-02-08 Fred Valdez Ameneyro , Edgar Galvan

Monte Carlo Tree Search (MCTS) is a widely used approach for policy improvement through search with increasing popularity for real world applications. Due to the sequential and deterministic nature of its search, runtime-scaling of MCTS…

Machine Learning · Computer Science 2026-05-22 Yaniv Oren , Viliam Vadocz , Joery A. de Vries , Wendelin Böhmer , Matthijs T. J. Spaan , Hendrik Baier

UCT, a state-of-the art algorithm for Monte Carlo tree search (MCTS) in games and Markov decision processes, is based on UCB, a sampling policy for the Multi-armed Bandit problem (MAB) that minimizes the cumulative regret. However, search…

Artificial Intelligence · Computer Science 2012-07-25 David Tolpin , Solomon Eyal Shimony

We present a self-learning approach that combines deep reinforcement learning and Monte Carlo tree search to solve the traveling salesman problem. The proposed approach has two advantages. First, it adopts deep reinforcement learning to…

Machine Learning · Computer Science 2020-05-15 Zhihao Xing , Shikui Tu , Lei Xu

Making changes to a program to optimize its performance is an unscalable task that relies entirely upon human intuition and experience. In addition, companies operating at large scale are at a stage where no single individual understands…

Machine Learning · Computer Science 2020-05-08 Don M. Dini

This paper presents Generalized Proof-Number Monte-Carlo Tree Search: a generalization of recently proposed combinations of Proof-Number Search (PNS) with Monte-Carlo Tree Search (MCTS), which use (dis)proof numbers to bias UCB1-based…

Artificial Intelligence · Computer Science 2025-06-17 Jakub Kowalski , Dennis J. N. J. Soemers , Szymon Kosakowski , Mark H. M. Winands

In this paper, we address a method that integrates reinforcement learning into the Monte Carlo tree search to boost online path planning under fully observable environments for automated parking tasks. Sampling-based planning methods under…

Artificial Intelligence · Computer Science 2025-01-03 Xinlong Zheng , Xiaozhou Zhang , Donghao Xu

Competitive program generation aims to automatically produce correct and efficient solutions for programming-contest problems under strict time and memory constraints. Existing LLM-based approaches often fail to perform explicit algorithmic…

Software Engineering · Computer Science 2026-05-05 Minnan Wei , Xiang Chen , Xiaoshuai Niu , Siyu Chen

Gradient-based methods are often used for policy optimization in deep reinforcement learning, despite being vulnerable to local optima and saddle points. Although gradient-free methods (e.g., genetic algorithms or evolution strategies) help…

Machine Learning · Computer Science 2019-12-24 Xiaobai Ma , Katherine Driggs-Campbell , Zongzhang Zhang , Mykel J. Kochenderfer