中文
相关论文

相关论文: Provably Efficient Long-Horizon Exploration in Mon…

200 篇论文

Effective decision-making and problem-solving in conversational systems require the ability to identify and acquire missing information through targeted questioning. A key challenge lies in efficiently narrowing down a large space of…

人工智能 · 计算机科学 2025-06-03 Harshita Chopra , Chirag Shah

Bayesian optimization (BO) is a popular method for computationally expensive black-box optimization. However, traditional BO methods need to solve new problems from scratch, leading to slow convergence. Recent studies try to extend BO to a…

机器学习 · 计算机科学 2024-12-11 Shukuan Wang , Ke Xue , Lei Song , Xiaobin Huang , Chao Qian

In large domains, Monte-Carlo tree search (MCTS) is required to estimate the values of the states as efficiently and accurately as possible. However, the standard update rule in backpropagation assumes a stationary distribution for the…

机器学习 · 计算机科学 2020-01-28 Yueqin Li , Nengli Lim

Monte Carlo Tree Search (MCTS) algorithms perform simulation-based search to improve policies online. During search, the simulation policy is adapted to explore the most promising lines of play. MCTS has been used by state-of-the-art…

机器学习 · 计算机科学 2019-04-09 Thomas Anthony , Robert Nishihara , Philipp Moritz , Tim Salimans , John Schulman

Monte-Carlo Tree Search (MCTS) is a widely-used strategy for online planning that combines Monte-Carlo sampling with forward tree search. Its success relies on the Upper Confidence bound for Trees (UCT) algorithm, an extension of the UCB…

人工智能 · 计算机科学 2024-06-05 Tuan Dam , Odalric-Ambrym Maillard , Emilie Kaufmann

High dimensional black-box optimization has broad applications but remains a challenging problem to solve. Given a set of samples $\{\vx_i, y_i\}$, building a global model (like Bayesian Optimization (BO)) suffers from the curse of…

机器学习 · 计算机科学 2022-03-15 Linnan Wang , Rodrigo Fonseca , Yuandong Tian

Monte Carlo Tree Search (MCTS), which leverages Upper Confidence Bound for Trees (UCTs) to balance exploration and exploitation through randomized sampling, is instrumental to solving complex planning problems. However, for multi-agent…

人工智能 · 计算机科学 2025-11-11 Sizhe Tang , Jiayu Chen , Tian Lan

In this paper we explore the application of simultaneous move Monte Carlo Tree Search (MCTS) based online framework for tactical maneuvering between two unmanned aircrafts. Compared to other techniques, MCTS enables efficient search over…

人工智能 · 计算机科学 2020-09-21 Kunal Srivastava , Amit Surana

Urban traffic scenarios often require a high degree of cooperation between traffic participants to ensure safety and efficiency. Observing the behavior of others, humans infer whether or not others are cooperating. This work aims to extend…

人工智能 · 计算机科学 2020-02-04 Karl Kurzer , Florian Engelhorn , J. Marius Zöllner

Few real-world hybrid systems are amenable to formal verification, due to their complexity and black box components. Optimization-based falsification---a methodology of search-based testing that employs stochastic optimization---is…

系统与控制 · 计算机科学 2018-08-14 Zhenya Zhang , Gidon Ernst , Sean Sedwards , Paolo Arcaini , Ichiro Hasuo

We study how to efficiently combine formal methods, Monte Carlo Tree Search (MCTS), and deep learning in order to produce high-quality receding horizon policies in large Markov Decision processes (MDPs). In particular, we use model-checking…

人工智能 · 计算机科学 2023-08-16 Debraj Chakraborty , Damien Busatto-Gaston , Jean-François Raskin , Guillermo A. Pérez

Mobile robots hold great promise in reducing the need for humans to perform jobs such as vacuuming, seeding,harvesting, painting, search and rescue, and inspection. In practice, these tasks must often be done without an exact map of the…

多智能体系统 · 计算机科学 2020-02-12 Phillip Hyatt , Zachary Brock , Marc D. Killpack

Inference-time scaling strategies, particularly Monte Carlo Tree Search (MCTS), have significantly enhanced the reasoning capabilities of Large Language Models (LLMs). However, current approaches remain predominantly stateless, discarding…

人工智能 · 计算机科学 2026-02-05 Hao Lu , Haoyuan Huang , Yulin Zhou , Chen Li , Ningxin Zhu

Monte Carlo Tree Search (MCTS) is an immensely popular search-based framework used for decision making. It is traditionally applied to domains where a perfect simulation model of the environment is available. We study and improve MCTS in…

人工智能 · 计算机科学 2024-05-24 Farnaz Kohankhaki , Kiarash Aghakasiri , Hongming Zhang , Ting-Han Wei , Chao Gao , Martin Müller

The AlphaZero/MuZero (A/MZ) family of algorithms has achieved remarkable success across various challenging domains by integrating Monte Carlo Tree Search (MCTS) with learned models. Learned models introduce epistemic uncertainty, which is…

机器学习 · 计算机科学 2026-05-18 Yaniv Oren , Viliam Vadocz , Matthijs T. J. Spaan , Wendelin Böhmer

This work investigates the Monte Carlo Tree Search (MCTS) method combined with dedicated heuristics for solving the Weighted Vertex Coloring Problem. In addition to the basic MCTS algorithm, we study several MCTS variants where the…

人工智能 · 计算机科学 2025-03-05 Cyril Grelier , Olivier Goudet , Jin-Kao Hao

We introduce an approach aimed at enhancing the reasoning capabilities of Large Language Models (LLMs) through an iterative preference learning process inspired by the successful strategy employed by AlphaZero. Our work leverages Monte…

人工智能 · 计算机科学 2024-06-19 Yuxi Xie , Anirudh Goyal , Wenyue Zheng , Min-Yen Kan , Timothy P. Lillicrap , Kenji Kawaguchi , Michael Shieh

This study investigates the combined use of generative grammar rules and Monte Carlo Tree Search (MCTS) for optimizing truss structures. Our approach accommodates intermediate construction stages characteristic of progressive construction…

计算工程、金融与科学 · 计算机科学 2025-04-03 Gabriel Garayalde , Luca Rosafalco , Matteo Torzoni , Alberto Corigliano

Monte Carlo Tree Search (MCTS) has proven to be capable of solving challenging tasks in domains such as Go, chess and Atari. Previous research has developed parallel versions of MCTS, exploiting today's multiprocessing architectures. These…

机器学习 · 计算机科学 2020-04-01 Karl Kurzer , Christoph Hörtnagl , J. Marius Zöllner

Monte Carlo Tree Search (MCTS) has profoundly influenced reinforcement learning (RL) by integrating planning and learning in tasks requiring long-horizon reasoning, exemplified by the AlphaZero family of algorithms. Central to MCTS is the…

机器学习 · 计算机科学 2026-04-28 Maximilian Weichart