English
Related papers

Related papers: Variance-Aware Prior-Based Tree Policies for Monte…

200 papers

Recent breakthroughs in Artificial Intelligence have shown that the combination of tree-based planning with deep learning can lead to superior performance. We present Adaptive Entropy Tree Search (ANTS) - a novel algorithm combining…

Artificial Intelligence · Computer Science 2023-03-16 Piotr Kozakowski , Mikołaj Pacek , Piotr Miłoś

Due to the large combinatorial problem, current beam orientation optimization algorithms for radiotherapy, such as column generation (CG), are typically heuristic or greedy in nature, leading to suboptimal solutions. We propose a…

Medical Physics · Physics 2020-04-15 Azar Sadeghnejad-Barkousaraie , Gyanendra Bohara , Steve Jiang , Dan Nguyen

A core challenge of Monte Carlo Tree Search (MCTS) is its sample efficiency, which can be improved by grouping state-action pairs and using their aggregate statistics instead of single-node statistics. On the Go Abstractions in Upper…

Artificial Intelligence · Computer Science 2025-10-30 Robin Schmöcker , Alexander Dockhorn , Bodo Rosenhahn

AlphaZero in 2017 was able to master chess and other games without human knowledge by playing millions of games against itself (self-play), with a computation budget running in the tens of millions of dollars. It used a variant of the Monte…

Artificial Intelligence · Computer Science 2025-04-11 Ameya Joshi

The performance of Variational Quantum Algorithms (VQAs) strongly depends on the choice of the parameterized quantum circuit to optimize. One of the biggest challenges in VQAs is designing quantum circuits tailored to the particular…

Quantum Physics · Physics 2026-05-06 Vincenzo Lipardi , Domenica Dibenedetto , Georgios Stamoulis , Mark H. M. Winands

Monte Carlo Tree Search (MCTS) has proven to be capable of solving challenging tasks in domains such as Go, chess and Atari. Previous research has developed parallel versions of MCTS, exploiting today's multiprocessing architectures. These…

Machine Learning · Computer Science 2020-04-01 Karl Kurzer , Christoph Hörtnagl , J. Marius Zöllner

Monte Carlo Tree Search and Monte Carlo Search have good results for many combinatorial problems. In this paper we propose to use Monte Carlo Search to design mathematical expressions that are used as exploration terms for Monte Carlo Tree…

Artificial Intelligence · Computer Science 2024-04-16 Tristan Cazenave

This work presents the first study of using the popular Monte Carlo Tree Search (MCTS) method combined with dedicated heuristics for solving the Weighted Vertex Coloring Problem. Starting with the basic MCTS algorithm, we gradually…

Machine Learning · Computer Science 2022-04-08 Cyril Grelier , Olivier Goudet , Jin-Kao Hao

Monte Carlo Tree Search (MCTS) has recently emerged as a powerful technique for enhancing the reasoning capabilities of LLMs. Techniques such as SFT or DPO have enabled LLMs to distill high-quality behaviors from MCTS, improving their…

Machine Learning · Computer Science 2024-10-10 Xiyao Wang , Linfeng Song , Ye Tian , Dian Yu , Baolin Peng , Haitao Mi , Furong Huang , Dong Yu

Bayesian optimization (BO) is a class of popular methods for expensive black-box optimization, and has been widely applied to many scenarios. However, BO suffers from the curse of dimensionality, and scaling it to high-dimensional problems…

Machine Learning · Computer Science 2022-11-17 Lei Song , Ke Xue , Xiaobin Huang , Chao Qian

In this paper we explore the application of simultaneous move Monte Carlo Tree Search (MCTS) based online framework for tactical maneuvering between two unmanned aircrafts. Compared to other techniques, MCTS enables efficient search over…

Artificial Intelligence · Computer Science 2020-09-21 Kunal Srivastava , Amit Surana

Bayesian optimization (BO) is a popular method for computationally expensive black-box optimization. However, traditional BO methods need to solve new problems from scratch, leading to slow convergence. Recent studies try to extend BO to a…

Machine Learning · Computer Science 2024-12-11 Shukuan Wang , Ke Xue , Lei Song , Xiaobin Huang , Chao Qian

Verification planning is a sequential decision-making problem that specifies a set of verification activities (VA) and correction activities (CA) at different phases of system development. While VAs are used to identify errors and defects,…

Software Engineering · Computer Science 2022-04-05 Peng Xu , Xinwei Deng , Alejandro Salado

Recent advances in reinforcement learning (RL) have significantly enhanced the agentic capabilities of large language models (LLMs). In long-term and multi-turn agent tasks, existing approaches driven solely by outcome rewards often suffer…

Machine Learning · Computer Science 2026-03-19 Yuxiang Ji , Ziyu Ma , Yong Wang , Guanhua Chen , Xiangxiang Chu , Liaoni Wu

In this paper, we propose a policy-guided Monte Carlo Tree Search (MCTS) decoder that achieves near maximum-likelihood decoding (MLD) performance for short block codes. The MCTS decoder searches for test error patterns (TEPs) in the…

Information Theory · Computer Science 2025-11-13 Y. Tian , C. Yue , P. Cheng , G. Pang , B. Vucetic , Y. Li

We introduce a novel, drop-in modification to Monte Carlo Tree Search's (MCTS) decision policy that we call AUPO. Comparisons based on a range of IPPC benchmark problems show that AUPO clearly outperforms MCTS. AUPO is an automatic action…

Artificial Intelligence · Computer Science 2025-10-28 Robin Schmöcker , Alexander Dockhorn , Bodo Rosenhahn

In recent years, state-of-the-art game-playing agents often involve policies that are trained in self-playing processes where Monte Carlo tree search (MCTS) algorithms and trained policies iteratively improve each other. The strongest…

Machine Learning · Computer Science 2019-05-16 Dennis J. N. J. Soemers , Éric Piette , Matthew Stephenson , Cameron Browne

Recent methodologies in LLM self-training mostly rely on LLM generating responses and filtering those with correct output answers as training data. This approach often yields a low-quality fine-tuning training set (e.g., incorrect plans or…

Computation and Language · Computer Science 2024-11-19 Dan Zhang , Sining Zhoubian , Ziniu Hu , Yisong Yue , Yuxiao Dong , Jie Tang

Leveraging the power of a graph neural network (GNN) with message passing, we present a Monte Carlo Tree Search (MCTS) method to solve stochastic orienteering problems with chance constraints. While adhering to an assigned travel budget the…

Robotics · Computer Science 2025-08-19 Marcos Abel Zuzuárregui , Stefano Carpin

Standard approaches for global optimization of non-convex functions, such as branch-and-bound, maintain partition trees to systematically prune the domain. The tree size grows exponentially in the number of dimensions. We propose new…

Artificial Intelligence · Computer Science 2024-02-21 Yaoguang Zhai , Zhizhen Qin , Sicun Gao