中文
相关论文

相关论文: Static and Dynamic Values of Computation in MCTS

200 篇论文

Monte-Carlo Tree Search (MCTS) methods are drawing great interest after yielding breakthrough results in computer Go. This paper proposes a Bayesian approach to MCTS that is inspired by distributionfree approaches such as UCT [13], yet…

机器学习 · 计算机科学 2012-03-19 Gerald Tesauro , V T Rajan , Richard Segal

Monte Carlo Tree Search (MCTS) is a branch of stochastic modeling that utilizes decision trees for optimization, mostly applied to artificial intelligence (AI) game players. This project imagines a game in which an AI player searches for a…

机器学习 · 计算机科学 2020-12-01 Elana Kozak , Scott Hottovy

Planning problems are among the most important and well-studied problems in artificial intelligence. They are most typically solved by tree search algorithms that simulate ahead into the future, evaluate future states, and back-up those…

A recent theoretical analysis of a Monte-Carlo tree search (MCTS) method properly modified from the ``upper confidence bound applied to trees" (UCT) algorithm established a surprising result, due to a great deal of empirical successes…

最优化与控制 · 数学 2025-02-04 Hyeong Soo Chang

Online planning is crucial for high performance in many complex sequential decision-making tasks. Monte Carlo Tree Search (MCTS) employs a principled mechanism for trading off exploration for exploitation for efficient online planning, and…

人工智能 · 计算机科学 2024-02-08 Kalle Kujanpää , Amin Babadi , Yi Zhao , Juho Kannala , Alexander Ilin , Joni Pajarinen

Monte Carlo tree search (MCTS) is one of the most capable online search algorithms for sequential planning tasks, with significant applications in areas such as resource allocation and transit planning. Despite its strong performance in…

人工智能 · 计算机科学 2024-10-31 Ziyan An , Hendrik Baier , Abhishek Dubey , Ayan Mukhopadhyay , Meiyi Ma

Monte Carlo Tree Search (MCTS), most famously used in game-play artificial intelligence (e.g., the game of Go), is a well-known strategy for constructing approximate solutions to sequential decision problems. Its primary innovation is the…

最优化与控制 · 数学 2017-04-21 Daniel R. Jiang , Lina Al-Kanj , Warren B. Powell

In this paper, we consider the online computation of a strategy that aims at optimizing the expected average reward in a Markov decision process. The strategy is computed with a receding horizon and using Monte Carlo tree search (MCTS). We…

计算机科学与博弈论 · 计算机科学 2020-07-17 Damien Busatto-Gaston , Debraj Chakraborty , Jean-Francois Raskin

Monte Carlo tree search (MCTS) has achieved state-of-the-art results in many domains such as Go and Atari games when combining with deep neural networks (DNNs). When more simulations are executed, MCTS can achieve higher performance but…

人工智能 · 计算机科学 2020-12-16 Li-Cheng Lan , Meng-Yu Tsai , Ti-Rong Wu , I-Chen Wu , Cho-Jui Hsieh

Constrained Markov decision processes (CMDPs), in which the agent optimizes expected payoffs while keeping the expected cost below a given threshold, are the leading framework for safe sequential decision making under stochastic…

人工智能 · 计算机科学 2024-12-19 Martin Kurečka , Václav Nevyhoštěný , Petr Novotný , Vít Unčovský

Inference-time search algorithms such as Monte-Carlo Tree Search (MCTS) may seem unnecessary when generating natural language text based on state-of-the-art reinforcement learning such as Proximal Policy Optimization (PPO). In this paper,…

计算与语言 · 计算机科学 2024-04-03 Jiacheng Liu , Andrew Cohen , Ramakanth Pasunuru , Yejin Choi , Hannaneh Hajishirzi , Asli Celikyilmaz

Monte-Carlo Tree Search (MCTS) is a family of sampling-based search algorithms widely used for online planning in sequential decision-making domains and at the heart of many recent advances in artificial intelligence. Understanding the…

人工智能 · 计算机科学 2025-09-25 Yiyu Qian , Tim Miller , Zheng Qian , Liyuan Zhao

Monte Carlo Tree Search (MCTS) is an immensely popular search-based framework used for decision making. It is traditionally applied to domains where a perfect simulation model of the environment is available. We study and improve MCTS in…

人工智能 · 计算机科学 2024-05-24 Farnaz Kohankhaki , Kiarash Aghakasiri , Hongming Zhang , Ting-Han Wei , Chao Gao , Martin Müller

Taking into account future risk is essential for an autonomously operating robot to find online not only the best but also a safe action to execute. In this paper, we build upon the recently introduced formulation of probabilistic…

人工智能 · 计算机科学 2024-11-12 Andrey Zhitnikov , Vadim Indelman

Online planning under uncertainty remains a critical challenge in robotics and autonomous systems. While tree search techniques are commonly employed to construct partial future trajectories within computational constraints, most existing…

人工智能 · 计算机科学 2024-12-24 Michael Novitsky , Moran Barenboim , Vadim Indelman

We present a new Monte Carlo Tree Search (MCTS) algorithm to solve the stochastic orienteering problem with chance constraints, i.e., a version of the problem where travel costs are random, and one is assigned a bound on the tolerable…

机器人学 · 计算机科学 2024-09-06 Stefano Carpin

The maximum reachability probabilities in a Markov decision process can be computed using value iteration (VI). Recently, simulation-based heuristic extensions of VI have been introduced, such as bounded real-time dynamic programming…

计算机科学中的逻辑 · 计算机科学 2018-09-11 Pranav Ashok , Tomáš Brázdil , Jan Křetínský , Ondřej Slámečka

In recent years, state-of-the-art game-playing agents often involve policies that are trained in self-playing processes where Monte Carlo tree search (MCTS) algorithms and trained policies iteratively improve each other. The strongest…

机器学习 · 计算机科学 2019-05-16 Dennis J. N. J. Soemers , Éric Piette , Matthew Stephenson , Cameron Browne

Making changes to a program to optimize its performance is an unscalable task that relies entirely upon human intuition and experience. In addition, companies operating at large scale are at a stage where no single individual understands…

机器学习 · 计算机科学 2020-05-08 Don M. Dini

Symbolic regression aims to discover concise, interpretable mathematical expressions that satisfy desired objectives, such as fitting data, posing a highly combinatorial optimization problem. While genetic programming has been the dominant…

机器学习 · 计算机科学 2025-09-25 Zhengyao Huang , Daniel Zhengyu Huang , Tiannan Xiao , Dina Ma , Zhenyu Ming , Hao Shi , Yuanhui Wen