English
Related papers

Related papers: Monte Carlo Tree Search Satellite Scheduling Under…

200 papers

We present an extension of Monte Carlo Tree Search (MCTS) that strongly increases its efficiency for trees with asymmetry and/or loops. Asymmetric termination of search trees introduces a type of uncertainty for which the standard upper…

Machine Learning · Statistics 2018-05-24 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

Monte Carlo Tree Search (MCTS) efficiently balances exploration and exploitation in tree search based on count-derived uncertainty. However, these local visit counts ignore a second type of uncertainty induced by the size of the subtree…

Artificial Intelligence · Computer Science 2020-05-21 Thomas M Moerland , Joost Broekens , Aske Plaat , Catholijn M Jonker

Earth Observation Satellite Planning (EOSP) is a difficult optimization problem with considerable practical interest. A set of requested observations must be scheduled on an agile Earth observation satellite while respecting constraints on…

Artificial Intelligence · Computer Science 2025-11-27 Antoine Jacquet , Guillaume Infantes , Emmanuel Benazera , Vincent Baudoui , Jonathan Guerra , Stéphanie Roussel

Mobile robots hold great promise in reducing the need for humans to perform jobs such as vacuuming, seeding,harvesting, painting, search and rescue, and inspection. In practice, these tasks must often be done without an exact map of the…

Multiagent Systems · Computer Science 2020-02-12 Phillip Hyatt , Zachary Brock , Marc D. Killpack

We propose a novel Parallel Monte Carlo tree search with Batched Simulations (PMBS) algorithm for accelerating long-horizon, episodic robotic planning tasks. Monte Carlo tree search (MCTS) is an effective heuristic search algorithm for…

Robotics · Computer Science 2022-07-15 Baichuan Huang , Abdeslam Boularias , Jingjin Yu

Modern SMT solvers, such as Z3, offer user-controllable strategies, enabling users to tailor solving strategies for their unique set of instances, thus dramatically enhancing solver performance for their use case. However, this approach of…

Artificial Intelligence · Computer Science 2024-05-01 Zhengyang Lu , Stefan Siemer , Piyush Jha , Joel Day , Florin Manea , Vijay Ganesh

Monte Carlo Tree Search (MCTS) is a branch of stochastic modeling that utilizes decision trees for optimization, mostly applied to artificial intelligence (AI) game players. This project imagines a game in which an AI player searches for a…

Machine Learning · Computer Science 2020-12-01 Elana Kozak , Scott Hottovy

Online planning is crucial for high performance in many complex sequential decision-making tasks. Monte Carlo Tree Search (MCTS) employs a principled mechanism for trading off exploration for exploitation for efficient online planning, and…

Artificial Intelligence · Computer Science 2024-02-08 Kalle Kujanpää , Amin Babadi , Yi Zhao , Juho Kannala , Alexander Ilin , Joni Pajarinen

Monte Carlo Tree Search (MCTS) has shown its strength for a lot of deterministic and stochastic examples, but literature lacks reports of applications to real world industrial processes. Common reasons for this are that there is no…

Artificial Intelligence · Computer Science 2021-08-05 Dorina Weichert , Felix Horchler , Alexander Kister , Marcus Trost , Johannes Hartung , Stefan Risse

This paper presents an efficient approach to object manipulation planning using Monte Carlo Tree Search (MCTS) to find contact sequences and an efficient ADMM-based trajectory optimization algorithm to evaluate the dynamic feasibility of…

Robotics · Computer Science 2023-03-21 Huaijiang Zhu , Avadesh Meduri , Ludovic Righetti

Monte Carlo tree search (MCTS) has been successful in a variety of domains, but faces challenges with long-horizon exploration when compared to sampling-based motion planning algorithms like Rapidly-Exploring Random Trees. To address these…

Machine Learning · Computer Science 2024-07-09 Liam Schramm , Abdeslam Boularias

The key to Black-Box Optimization is to efficiently search through input regions with potentially widely-varying numerical properties, to achieve low-regret descent and fast progress toward the optima. Monte Carlo Tree Search (MCTS) methods…

Machine Learning · Computer Science 2022-11-03 Yaoguang Zhai , Sicun Gao

Many robotic tasks, such as inverse kinematics, motion planning, and optimal control, can be formulated as optimization problems. Solving these problems involves addressing nonlinear kinematics, complex contact dynamics, long-horizon…

Robotics · Computer Science 2025-09-10 Teng Xue , Yan Zhang , Amirreza Razmjoo , Sylvain Calinon

Standard planners for sequential decision making (including Monte Carlo planning, tree search, dynamic programming, etc.) are constrained by an implicit sequential planning assumption: The order in which a plan is constructed is the same in…

The single-track railway train timetabling problem (TTP) is an important and complex problem. This article proposes an integrated Monte Carlo Tree Search (MCTS) computing framework that combines heuristic methods, unsupervised learning…

Machine Learning · Computer Science 2023-11-03 Feiyu Yang

This paper presents a semi-Markov decision process (SMDP) formulation of the satellite task scheduling problem. This formulation can consider multiple operational objectives simultaneously and plan transitions between distinct functional…

Systems and Control · Electrical Eng. & Systems 2019-10-21 Duncan Eddy , Mykel Kochenderfer

Monte Carlo Tree Search (MCTS) is an effective test-time compute scaling (TTCS) method for improving the reasoning performance of large language models, but its highly variable execution time leads to severe long-tail latency in practice.…

Artificial Intelligence · Computer Science 2026-04-02 Hongbeen Kim , Juhyun Lee , Sanghyeon Lee , Kwanghoon Choi , Jaehyuk Huh

Monte Carlo Tree Search (MCTS) is a best-first sampling method employed in the search for optimal decisions. The effectiveness of MCTS relies on the construction of its statistical tree, with the selection policy playing a crucial role. A…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Edgar Galvan , Fred Valdez Ameneyro

Monte Carlo Tree Search (MCTS) has been proposed as a transformative approach to join-order optimization in database query processing, with recent frameworks such as AlphaJoin and HyperQO claiming to outperform traditional methods. However,…

Monte Carlo Tree Search (MCTS) methods have achieved great success in many Artificial Intelligence (AI) benchmarks. The in-tree operations become a critical performance bottleneck in realizing parallel MCTS on CPUs. In this work, we develop…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-25 Yuan Meng , Rajgopal Kannan , Viktor Prasanna