English
Related papers

Related papers: Twice Sequential Monte Carlo for Tree Search

200 papers

Monte Carlo Tree Search (MCTS) is particularly adapted to domains where the potential actions can be represented as a tree of sequential decisions. For an effective action selection, MCTS performs many simulations to build a reliable tree…

Artificial Intelligence · Computer Science 2018-09-10 Seydou Ba , Takuya Hiraoka , Takashi Onishi , Toru Nakata , Yoshimasa Tsuruoka

We propose SC-MCTS*: a novel Monte Carlo Tree Search (MCTS) reasoning algorithm for Large Language Models (LLMs), significantly improves both reasoning accuracy and speed. Our motivation comes from: 1. Previous MCTS LLM reasoning works…

Computation and Language · Computer Science 2024-12-30 Zitian Gao , Boye Niu , Xuzheng He , Haotian Xu , Hongzhang Liu , Aiwei Liu , Xuming Hu , Lijie Wen

It is common practice to use large computational resources to train neural networks, as is known from many examples, such as reinforcement learning applications. However, while massively parallel computing is often used for training models,…

Artificial Intelligence · Computer Science 2021-04-07 Xiufeng Yang , Tanuj Kr Aasawat , Kazuki Yoshizoe

We propose a novel Parallel Monte Carlo tree search with Batched Simulations (PMBS) algorithm for accelerating long-horizon, episodic robotic planning tasks. Monte Carlo tree search (MCTS) is an effective heuristic search algorithm for…

Robotics · Computer Science 2022-07-15 Baichuan Huang , Abdeslam Boularias , Jingjin Yu

Symbolic regression aims to discover concise, interpretable mathematical expressions that satisfy desired objectives, such as fitting data, posing a highly combinatorial optimization problem. While genetic programming has been the dominant…

Machine Learning · Computer Science 2025-09-25 Zhengyao Huang , Daniel Zhengyu Huang , Tiannan Xiao , Dina Ma , Zhenyu Ming , Hao Shi , Yuanhui Wen

Monte Carlo Tree Search (MCTS) algorithms have achieved great success on many challenging benchmarks (e.g., Computer Go). However, they generally require a large number of rollouts, making their applications costly. Furthermore, it is also…

Machine Learning · Computer Science 2020-02-27 Anji Liu , Jianshu Chen , Mingze Yu , Yu Zhai , Xuewen Zhou , Ji Liu

Augmenting the multi-step reasoning abilities of Large Language Models (LLMs) has been a persistent challenge. Recently, verification has shown promise in improving solution consistency by evaluating generated outputs. However, current…

Machine Learning · Computer Science 2025-03-04 Shengyu Feng , Xiang Kong , Shuang Ma , Aonan Zhang , Dong Yin , Chong Wang , Ruoming Pang , Yiming Yang

We propose a novel class of Sequential Monte Carlo (SMC) algorithms, appropriate for inference in probabilistic graphical models. This class of algorithms adopts a divide-and-conquer approach based upon an auxiliary tree-structured…

Despite its groundbreaking success in Go and computer games, Monte Carlo Tree Search (MCTS) is computationally expensive as it requires a substantial number of rollouts to construct the search tree, which calls for effective…

Machine Learning · Computer Science 2020-10-06 Anji Liu , Yitao Liang , Ji Liu , Guy Van den Broeck , Jianshu Chen

This paper proposes a novel reinforcement learning (RL) algorithm using improved Monte Carlo tree search (IMCTS) formulation for discrete optimum design of truss structures. IMCTS with multiple root nodes includes update process, the best…

Artificial Intelligence · Computer Science 2024-08-08 Fu-Yao Ko , Katsuyuki Suzuki , Kazuo Yonekura

A novel method called mixed variable system Monte Carlo tree search (MVSMCTS) formulation is presented for optimization problems considering various types of variables with single and mixed continuous-discrete system. This method utilizes a…

Optimization and Control · Mathematics 2024-10-31 Fu-Yao Ko , Katsuyuki Suzuki , Kazuo Yonekura

Monte-Carlo Tree Search (MCTS) is a class of methods for solving complex decision-making problems through the synergy of Monte-Carlo planning and Reinforcement Learning (RL). The highly combinatorial nature of the problems commonly…

Artificial Intelligence · Computer Science 2022-02-16 Tuan Dam , Carlo D'Eramo , Jan Peters , Joni Pajarinen

We consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of finite-horizon Markov decision process. We propose a dynamic sampling tree policy that…

Artificial Intelligence · Computer Science 2023-05-09 Gongbo Zhang , Yijie Peng , Yilong Xu

To solve the problem of lateral and logitudinal joint decision-making of multi-vehicle cooperative driving for connected and automated vehicles (CAVs), this paper proposes a Monte Carlo tree search (MCTS) method with parallel update for…

Multiagent Systems · Computer Science 2025-08-07 Ye Han , Lijun Zhang , Dejian Meng , Zhuang Zhang , Xingyu Hu , Songyu Weng

Recent advancements in large language models (LLMs) have shown remarkable potential in automating machine learning tasks. However, existing LLM-based agents often struggle with low-diversity and suboptimal code generation. While recent work…

Computation and Language · Computer Science 2026-01-26 Zujie Liang , Feng Wei , Wujiang Xu , Lin Chen , Yuxi Qian , Xinhui Wu

Bayesian Decision Trees (DTs) are generally considered a more advanced and accurate model than a regular Decision Tree (DT) because they can handle complex and uncertain data. Existing work on Bayesian DTs uses Markov Chain Monte Carlo…

Machine Learning · Computer Science 2023-05-31 Efthyvoulos Drousiotis , Alexander M. Phillips , Paul G. Spirakis , Simon Maskell

Despite their outstanding capabilities, large language models (LLMs) are prone to hallucination and producing factually incorrect information. This challenge has spurred efforts in attributed text generation, which prompts LLMs to generate…

Computation and Language · Computer Science 2025-06-23 Junyi Li , Hwee Tou Ng

This paper proposes a novel multiple-input multiple-output (MIMO) symbol detector that incorporates a deep reinforcement learning (DRL) agent into the Monte Carlo tree search (MCTS) detection algorithm. We first describe how the MCTS…

Signal Processing · Electrical Eng. & Systems 2021-02-02 Tz-Wei Mo , Ronald Y. Chang , Te-Yi Kan

The single-track railway train timetabling problem (TTP) is an important and complex problem. This article proposes an integrated Monte Carlo Tree Search (MCTS) computing framework that combines heuristic methods, unsupervised learning…

Machine Learning · Computer Science 2023-11-03 Feiyu Yang

Monte Carlo Tree Search (MCTS) has been proposed as a transformative approach to join-order optimization in database query processing, with recent frameworks such as AlphaJoin and HyperQO claiming to outperform traditional methods. However,…