English
Related papers

Related papers: Bilevel MCTS for Amortized O(1) Node Selection in …

200 papers

Monte Carlo Tree Search (MCTS) scales poorly in cooperative multi-agent domains because expansion must consider an exponentially large set of joint actions, severely limiting exploration under realistic search budgets. We propose NonZero,…

Machine Learning · Computer Science 2026-05-04 Sizhe Tang , Zuyuan Zhang , Mahdi Imani , Tian Lan

Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The MCTS's popularity is based on its extraordinary results in the challenging two-player based game Go, a game considered much harder than…

Neural and Evolutionary Computing · Computer Science 2021-12-21 Edgar Galván , Gavin Simpson

Few real-world hybrid systems are amenable to formal verification, due to their complexity and black box components. Optimization-based falsification---a methodology of search-based testing that employs stochastic optimization---is…

Systems and Control · Computer Science 2018-08-14 Zhenya Zhang , Gidon Ernst , Sean Sedwards , Paolo Arcaini , Ichiro Hasuo

This paper introduces a novel backup strategy for Monte-Carlo Tree Search (MCTS) designed for highly stochastic and partially observable Markov decision processes. We adopt a probabilistic approach, modeling both value and action-value…

Artificial Intelligence · Computer Science 2023-09-20 Tuan Dam , Pascal Stenger , Lukas Schneider , Joni Pajarinen , Carlo D'Eramo , Odalric-Ambrym Maillard

Monte Carlo Tree Search (MCTS) based methods provide promising approaches for generating synthetic data to enhance the self-training of Large Language Model (LLM) based multi-agent systems (MAS). These methods leverage Q-values to estimate…

Computation and Language · Computer Science 2026-04-27 Wentao Shi , Zichun Yu , Fuli Feng , Xiangnan He , Chenyan Xiong

In this paper, we consider the online computation of a strategy that aims at optimizing the expected average reward in a Markov decision process. The strategy is computed with a receding horizon and using Monte Carlo tree search (MCTS). We…

Computer Science and Game Theory · Computer Science 2020-07-17 Damien Busatto-Gaston , Debraj Chakraborty , Jean-Francois Raskin

Monte Carlo Tree Search (MCTS), which leverages Upper Confidence Bound for Trees (UCTs) to balance exploration and exploitation through randomized sampling, is instrumental to solving complex planning problems. However, for multi-agent…

Artificial Intelligence · Computer Science 2025-11-11 Sizhe Tang , Jiayu Chen , Tian Lan

Effective decision-making and problem-solving in conversational systems require the ability to identify and acquire missing information through targeted questioning. A key challenge lies in efficiently narrowing down a large space of…

Artificial Intelligence · Computer Science 2025-06-03 Harshita Chopra , Chirag Shah

Monte Carlo Tree Search (MCTS) algorithms perform simulation-based search to improve policies online. During search, the simulation policy is adapted to explore the most promising lines of play. MCTS has been used by state-of-the-art…

Machine Learning · Computer Science 2019-04-09 Thomas Anthony , Robert Nishihara , Philipp Moritz , Tim Salimans , John Schulman

High-dimensional design spaces underpin a wide range of physics-based modeling and computational design tasks in science and engineering. These problems are commonly formulated as constrained black-box searches over rugged objective…

Machine Learning · Computer Science 2026-01-13 Suvo Banik , Troy D. Loeffler , Henry Chan , Sukriti Manna , Orcun Yildiz , Tom Peterka , Subramanian Sankaranarayanan

Monte Carlo Tree Search (MCTS) has profoundly influenced reinforcement learning (RL) by integrating planning and learning in tasks requiring long-horizon reasoning, exemplified by the AlphaZero family of algorithms. Central to MCTS is the…

Machine Learning · Computer Science 2026-04-28 Maximilian Weichart

Monte-Carlo tree search (MCTS) has driven many recent breakthroughs in deep reinforcement learning (RL). However, scaling MCTS to parallel compute has proven challenging in practice which has motivated alternative planners like sequential…

Machine Learning · Computer Science 2025-07-09 Joery A. de Vries , Jinke He , Yaniv Oren , Matthijs T. J. Spaan

Constraint Optimization Problems (COP) pose intricate challenges in combinatorial problems usually addressed through Branch and Bound (B\&B) methods, which involve maintaining priority queues and iteratively selecting branches to search for…

Artificial Intelligence · Computer Science 2023-12-27 Yingkai Xiao , Jingjin Liu , Hankz Hankui Zhuo

Handcrafting heuristics for solving complex optimization tasks (e.g., route planning and task allocation) is a common practice but requires extensive domain knowledge. Recently, Large Language Model (LLM)-based automatic heuristic design…

Artificial Intelligence · Computer Science 2025-02-03 Zhi Zheng , Zhuoliang Xie , Zhenkun Wang , Bryan Hooi

Monte Carlo Tree Search (MCTS) has shown its strength for a lot of deterministic and stochastic examples, but literature lacks reports of applications to real world industrial processes. Common reasons for this are that there is no…

Artificial Intelligence · Computer Science 2021-08-05 Dorina Weichert , Felix Horchler , Alexander Kister , Marcus Trost , Johannes Hartung , Stefan Risse

This article proposes a method for automated service selection to improve treatment efficacy and reduce re-hospitalization costs. A predictive model is developed using the National Home and Hospice Care Survey (NHHCS) dataset to quantify…

Artificial Intelligence · Computer Science 2020-02-13 Cliff Laschet , Jorn op den Buijs , Mark H. M. Winands , Steffen Pauws

We analyze a tree search problem with an underlying Markov decision process, in which the goal is to identify the best action at the root that achieves the highest cumulative reward. We present a new tree policy that optimally allocates a…

Systems and Control · Electrical Eng. & Systems 2020-09-29 Yunchuan Li , Michael C. Fu , Jie Xu

Computational Intelligence (CI) in computer games plays an important role that could simulate various aspects of real-life problems. CI in real-time decision-making games can provide a platform for the examination of tree search algorithms.…

Human-Computer Interaction · Computer Science 2018-04-30 Shabnam Sadeghi Esfahlani , George Wilson

Making changes to a program to optimize its performance is an unscalable task that relies entirely upon human intuition and experience. In addition, companies operating at large scale are at a stage where no single individual understands…

Machine Learning · Computer Science 2020-05-08 Don M. Dini

Rewrite systems [6, 10, 12] have been widely employing equality saturation [9], which is an optimisation methodology that uses a saturated e-graph to represent all possible sequences of rewrite simultaneously, and then extracts the optimal…

Artificial Intelligence · Computer Science 2023-04-21 Guoliang He , Zak Singh , Eiko Yoneki