English
Related papers

Related papers: Re-determinizing Information Set Monte Carlo Tree …

200 papers

AlphaZero, using a combination of Deep Neural Networks and Monte Carlo Tree Search (MCTS), has successfully trained reinforcement learning agents in a tabula-rasa way. The neural MCTS algorithm has been successful in finding near-optimal…

Artificial Intelligence · Computer Science 2021-10-12 Prashank Kadam , Ruiyang Xu , Karl Lieberherr

We introduce a recursive AlphaZero-style Monte--Carlo tree search algorithm, "RMCTS". The advantage of RMCTS over AlphaZero's MCTS-UCB is speed. In RMCTS, the search tree is explored in a breadth-first manner, so that network inferences…

Artificial Intelligence · Computer Science 2026-01-12 Keith Frankston , Benjamin Howard

This paper presents Generalized Proof-Number Monte-Carlo Tree Search: a generalization of recently proposed combinations of Proof-Number Search (PNS) with Monte-Carlo Tree Search (MCTS), which use (dis)proof numbers to bias UCB1-based…

Artificial Intelligence · Computer Science 2025-06-17 Jakub Kowalski , Dennis J. N. J. Soemers , Szymon Kosakowski , Mark H. M. Winands

Monte Carlo Tree Search (MCTS) based methods provide promising approaches for generating synthetic data to enhance the self-training of Large Language Model (LLM) based multi-agent systems (MAS). These methods leverage Q-values to estimate…

Computation and Language · Computer Science 2026-04-27 Wentao Shi , Zichun Yu , Fuli Feng , Xiangnan He , Chenyan Xiong

Organizations are increasingly focused on leveraging data from their processes to gain insights and drive decision-making. However, converting this data into actionable knowledge remains a difficult and time-consuming task. There is often a…

Artificial Intelligence · Computer Science 2025-10-02 Pietro Totis , Alberto Pozanco , Daniel Borrajo

We explore applying the Monte Carlo Tree Search (MCTS) algorithm in a notoriously difficult task: tuning programs for high-performance deep learning and image processing. We build our framework on top of Halide and show that MCTS can…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Ameer Haj-Ali , Hasan Genc , Qijing Huang , William Moses , John Wawrzynek , Krste Asanović , Ion Stoica

This paper introduces COR-MCTS (Conservation of Resources - Monte Carlo Tree Search), a novel tactical decision-making approach for automated driving focusing on maneuver planning over extended horizons. Traditional decision-making…

Robotics · Computer Science 2025-04-23 Karim Essalmi , Fernando Garrido , Fawzi Nashashibi

Tree search methods have demonstrated impressive performance in code generation. Previous methods combine tree search with reflection that summarizes past mistakes to achieve iterative improvement. However, these methods face significant…

Software Engineering · Computer Science 2025-10-27 Qingyao Li , Wei Xia , Kounianhua Du , Xinyi Dai , Ruiming Tang , Yasheng Wang , Yong Yu , Weinan Zhang

The discovery of patterns that accurately discriminate one class label from another remains a challenging data mining task. Subgroup discovery (SD) is one of the frameworks that enables to elicit such interesting hypotheses from labeled…

Data Structures and Algorithms · Computer Science 2017-12-07 Guillaume Bosc , Jean-François Boulicaut , Chedy Raïssi , Mehdi Kaytoue

Monte Carlo tree search (MCTS) is extremely popular in computer Go which determines each action by enormous simulations in a broad and deep search tree. However, human experts select most actions by pattern analysis and careful evaluation…

Artificial Intelligence · Computer Science 2017-06-14 Jinzhuo Wang , Wenmin Wang , Ronggang Wang , Wen Gao

In this work we study a well-known and challenging problem of Multi-agent Pathfinding, when a set of agents is confined to a graph, each agent is assigned a unique start and goal vertices and the task is to find a set of collision-free…

Artificial Intelligence · Computer Science 2023-07-26 Yelisey Pitanov , Alexey Skrynnik , Anton Andreychuk , Konstantin Yakovlev , Aleksandr Panov

Nowadays, the field of Artificial Intelligence in Computer Games (AI in Games) is going to be more alluring since computer games challenge many aspects of AI with a wide range of problems, particularly general problems. One of these kinds…

One of the most important AI research questions is to trade off computation versus performance since ``perfect rationality" exists in theory but is impossible to achieve in practice. Recently, Monte-Carlo tree search (MCTS) has attracted…

Artificial Intelligence · Computer Science 2022-10-25 Weirui Ye , Pieter Abbeel , Yang Gao

This paper proposes a novel reinforcement learning (RL) algorithm using improved Monte Carlo tree search (IMCTS) formulation for discrete optimum design of truss structures. IMCTS with multiple root nodes includes update process, the best…

Artificial Intelligence · Computer Science 2024-08-08 Fu-Yao Ko , Katsuyuki Suzuki , Kazuo Yonekura

In this work, we consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of infinite-horizon discounted cost Markov Decision Process (MDP). While…

Machine Learning · Statistics 2020-01-14 Devavrat Shah , Qiaomin Xie , Zhi Xu

Monte Carlo Tree Search (MCTS) is an effective test-time compute scaling (TTCS) method for improving the reasoning performance of large language models, but its highly variable execution time leads to severe long-tail latency in practice.…

Artificial Intelligence · Computer Science 2026-04-02 Hongbeen Kim , Juhyun Lee , Sanghyeon Lee , Kwanghoon Choi , Jaehyuk Huh

We study Monte Carlo tree search (MCTS) in zero-sum extensive-form games with perfect information and simultaneous moves. We present a general template of MCTS algorithms for these games, which can be instantiated by various selection…

Computer Science and Game Theory · Computer Science 2013-12-16 Viliam Lisý , Vojtěch Kovařík , Marc Lanctot , Branislav Bošanský

This paper introduces Monte Carlo *-Minimax Search (MCMS), a Monte Carlo search algorithm for turned-based, stochastic, two-player, zero-sum games of perfect information. The algorithm is designed for the class of of densely stochastic…

Computer Science and Game Theory · Computer Science 2013-04-23 Marc Lanctot , Abdallah Saffidine , Joel Veness , Christopher Archibald , Mark H. M. Winands

Recent advances demonstrate that increasing inference-time computation can significantly boost the reasoning capabilities of large language models (LLMs). Although repeated sampling (i.e., generating multiple candidate outputs) is a highly…

Artificial Intelligence · Computer Science 2025-11-10 Yuichi Inoue , Kou Misaki , Yuki Imajuku , So Kuroki , Taishi Nakamura , Takuya Akiba

Effective decision-making and problem-solving in conversational systems require the ability to identify and acquire missing information through targeted questioning. A key challenge lies in efficiently narrowing down a large space of…

Artificial Intelligence · Computer Science 2025-06-03 Harshita Chopra , Chirag Shah