中文
相关论文

相关论文: Accelerating Monte-Carlo Tree Search with Optimize…

200 篇论文

This paper introduces COR-MCTS (Conservation of Resources - Monte Carlo Tree Search), a novel tactical decision-making approach for automated driving focusing on maneuver planning over extended horizons. Traditional decision-making…

机器人学 · 计算机科学 2025-04-23 Karim Essalmi , Fernando Garrido , Fawzi Nashashibi

Monte Carlo Tree Search (MCTS) is particularly adapted to domains where the potential actions can be represented as a tree of sequential decisions. For an effective action selection, MCTS performs many simulations to build a reliable tree…

人工智能 · 计算机科学 2018-09-10 Seydou Ba , Takuya Hiraoka , Takashi Onishi , Toru Nakata , Yoshimasa Tsuruoka

Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The MCTS's popularity is based on its extraordinary results in the challenging two-player based game Go, a game considered much harder than…

神经与进化计算 · 计算机科学 2021-12-21 Edgar Galván , Gavin Simpson

Tree search-based methods have made significant progress in enhancing the code generation capabilities of large language models. However, due to the difficulty in effectively evaluating intermediate algorithmic steps and the inability to…

人工智能 · 计算机科学 2025-12-18 Yuanyuan Lin , Xiangyu Ouyang , Teng Zhang , Kaixin Sui

One weakness of Monte Carlo Tree Search (MCTS) is its sample efficiency which can be addressed by building and using state and/or action abstractions in parallel to the tree search such that information can be shared among nodes of the same…

人工智能 · 计算机科学 2025-10-29 Robin Schmöcker , Alexander Dockhorn , Bodo Rosenhahn

Monte Carlo Tree Search (MCTS) algorithms perform simulation-based search to improve policies online. During search, the simulation policy is adapted to explore the most promising lines of play. MCTS has been used by state-of-the-art…

机器学习 · 计算机科学 2019-04-09 Thomas Anthony , Robert Nishihara , Philipp Moritz , Tim Salimans , John Schulman

The key to Black-Box Optimization is to efficiently search through input regions with potentially widely-varying numerical properties, to achieve low-regret descent and fast progress toward the optima. Monte Carlo Tree Search (MCTS) methods…

机器学习 · 计算机科学 2022-11-03 Yaoguang Zhai , Sicun Gao

Planning problems are among the most important and well-studied problems in artificial intelligence. They are most typically solved by tree search algorithms that simulate ahead into the future, evaluate future states, and back-up those…

The AlphaZero/MuZero (A/MZ) family of algorithms has achieved remarkable success across various challenging domains by integrating Monte Carlo Tree Search (MCTS) with learned models. Learned models introduce epistemic uncertainty, which is…

机器学习 · 计算机科学 2026-05-18 Yaniv Oren , Viliam Vadocz , Matthijs T. J. Spaan , Wendelin Böhmer

UCT, a state-of-the art algorithm for Monte Carlo tree sampling (MCTS), is based on UCB, a sampling policy for the Multi-armed Bandit Problem (MAB) that minimizes the accumulated regret. However, MCTS differs from MAB in that only the final…

人工智能 · 计算机科学 2012-07-26 David Tolpin , Solomon Eyal Shimony

We propose a novel Parallel Monte Carlo tree search with Batched Simulations (PMBS) algorithm for accelerating long-horizon, episodic robotic planning tasks. Monte Carlo tree search (MCTS) is an effective heuristic search algorithm for…

机器人学 · 计算机科学 2022-07-15 Baichuan Huang , Abdeslam Boularias , Jingjin Yu

Monte Carlo Tree Search (MCTS) algorithms such as AlphaGo and MuZero have achieved superhuman performance in many challenging tasks. However, the computational complexity of MCTS-based algorithms is influenced by the size of the search…

人工智能 · 计算机科学 2023-10-11 Yangqing Fu , Ming Sun , Buqing Nie , Yue Gao

Monte-Carlo Tree Search (MCTS) is one of the most-widely used methods for planning, and has powered many recent advances in artificial intelligence. In MCTS, one typically performs computations (i.e., simulations) to collect statistics…

人工智能 · 计算机科学 2020-11-20 Eren Sezener , Peter Dayan

In this study, we explore the efficiency of the Monte Carlo Tree Search (MCTS), a prominent decision-making algorithm renowned for its effectiveness in complex decision environments, contingent upon the volume of simulations conducted.…

人工智能 · 计算机科学 2024-03-19 Ye Zhang , Mengran Zhu , Kailin Gui , Jiayue Yu , Yong Hao , Haozhan Sun

UCT, a state-of-the art algorithm for Monte Carlo tree search (MCTS) in games and Markov decision processes, is based on UCB1, a sampling policy for the Multi-armed Bandit problem (MAB) that minimizes the cumulative regret. However, search…

人工智能 · 计算机科学 2012-07-25 David Tolpin , Solomon Eyal Shimony

Effective decision-making and problem-solving in conversational systems require the ability to identify and acquire missing information through targeted questioning. A key challenge lies in efficiently narrowing down a large space of…

人工智能 · 计算机科学 2025-06-03 Harshita Chopra , Chirag Shah

We propose SC-MCTS*: a novel Monte Carlo Tree Search (MCTS) reasoning algorithm for Large Language Models (LLMs), significantly improves both reasoning accuracy and speed. Our motivation comes from: 1. Previous MCTS LLM reasoning works…

计算与语言 · 计算机科学 2024-12-30 Zitian Gao , Boye Niu , Xuzheng He , Haotian Xu , Hongzhang Liu , Aiwei Liu , Xuming Hu , Lijie Wen

Monte-Carlo Tree Search (MCTS) is a search paradigm that first found prominence with its success in the domain of computer Go. Early theoretical work established the soundness and convergence bounds for Upper Confidence bounds applied to…

人工智能 · 计算机科学 2024-06-11 Khoi P. N. Nguyen , Raghuram Ramanujan

Recent methodologies in LLM self-training mostly rely on LLM generating responses and filtering those with correct output answers as training data. This approach often yields a low-quality fine-tuning training set (e.g., incorrect plans or…

计算与语言 · 计算机科学 2024-11-19 Dan Zhang , Sining Zhoubian , Ziniu Hu , Yisong Yue , Yuxiao Dong , Jie Tang

Inference-time search algorithms such as Monte-Carlo Tree Search (MCTS) may seem unnecessary when generating natural language text based on state-of-the-art reinforcement learning such as Proximal Policy Optimization (PPO). In this paper,…

计算与语言 · 计算机科学 2024-04-03 Jiacheng Liu , Andrew Cohen , Ramakanth Pasunuru , Yejin Choi , Hannaneh Hajishirzi , Asli Celikyilmaz