English
Related papers

Related papers: Split Moves for Monte-Carlo Tree Search

200 papers

Efficient tabletop rearrangement planning seeks to find high-quality solutions while minimizing total cost. However, the task is challenging due to object dependencies and limited buffer space for temporary placements. The complexity…

Robotics · Computer Science 2025-05-27 Jiaming Hu , Jiawei Wang , Henrik I Christensen

We explore how a general AI algorithm can be used for 3D scene understanding to reduce the need for training data. More exactly, we propose a modification of the Monte Carlo Tree Search (MCTS) algorithm to retrieve objects and room layouts…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Shreyas Hampali , Sinisa Stekovic , Sayan Deb Sarkar , Chetan Srinivasa Kumar , Friedrich Fraundorfer , Vincent Lepetit

Monte Carlo Tree Search (MCTS) has emerged as a powerful tool for decision-making in robotics, enabling efficient exploration of large search spaces. However, traditional MCTS methods struggle in environments characterized by high…

Robotics · Computer Science 2025-03-10 Xibai Wang

UCT, a state-of-the art algorithm for Monte Carlo tree search (MCTS) in games and Markov decision processes, is based on UCB, a sampling policy for the Multi-armed Bandit problem (MAB) that minimizes the cumulative regret. However, search…

Artificial Intelligence · Computer Science 2012-07-25 David Tolpin , Solomon Eyal Shimony

Automated agent workflows can enhance the problem-solving ability of large language models (LLMs), but common search strategies rely on stochastic exploration and often traverse implausible branches. This occurs because current pipelines…

Artificial Intelligence · Computer Science 2026-01-21 Qitong Fang , Haotian Li , Xu Wang

Online planning in continuous state, action, and observation spaces remains challenging for autonomous systems. While Monte Carlo Tree Search (MCTS) scales effectively via sampling, most continuous (PO)MDP solvers do not exploit…

Artificial Intelligence · Computer Science 2026-05-19 Idan Lev-Yehudi , Michael Novitsky , Moran Barenboim , Ron Benchetrit , Vadim Indelman

Integrated task and motion planning (TAMP) is desirable for generalized autonomy robots but it is challenging at the same time. TAMP requires the planner to not only search in both the large symbolic task space and the high-dimension motion…

Robotics · Computer Science 2021-10-18 Tianyu Ren , Georgia Chalvatzaki , Jan Peters

Gradient-based methods are often used for policy optimization in deep reinforcement learning, despite being vulnerable to local optima and saddle points. Although gradient-free methods (e.g., genetic algorithms or evolution strategies) help…

Machine Learning · Computer Science 2019-12-24 Xiaobai Ma , Katherine Driggs-Campbell , Zongzhang Zhang , Mykel J. Kochenderfer

The widespread deployment of Machine Learning systems everywhere raises challenges, such as dealing with interactions or competition between multiple learners. In that goal, we study multi-agent sequential decision-making by considering…

Computer Science and Game Theory · Computer Science 2025-10-28 Antoine Scheid , Etienne Boursier , Alain Durmus , Eric Moulines , Michael I. Jordan

Large Language Models (LLM) are increasingly being explored for problem-solving tasks. However, their strategic planning capability is often viewed with skepticism. Recent studies have incorporated the Monte Carlo Tree Search (MCTS)…

Artificial Intelligence · Computer Science 2025-02-05 Bingzheng Gan , Yufan Zhao , Tianyi Zhang , Jing Huang , Yusu Li , Shu Xian Teo , Changwang Zhang , Wei Shi

Symbolic regression aims to discover concise, interpretable mathematical expressions that satisfy desired objectives, such as fitting data, posing a highly combinatorial optimization problem. While genetic programming has been the dominant…

Machine Learning · Computer Science 2025-09-25 Zhengyao Huang , Daniel Zhengyu Huang , Tiannan Xiao , Dina Ma , Zhenyu Ming , Hao Shi , Yuanhui Wen

The UCT algorithm, which combines the UCB algorithm and Monte-Carlo Tree Search (MCTS), is currently the most widely used variant of MCTS. Recently, a number of investigations into applying other bandit algorithms to MCTS have produced…

Artificial Intelligence · Computer Science 2015-05-13 Yun-Ching Liu , Yoshimasa Tsuruoka

Dynamic job shop scheduling, a fundamental combinatorial optimisation problem in various industrial sectors, poses substantial challenges for effective scheduling due to frequent disruptions caused by the arrival of new jobs.…

Artificial Intelligence · Computer Science 2025-09-29 Ruiqi Chen , Yi Mei , Fangfang Zhang , Mengjie Zhang

We present a new Monte Carlo Tree Search (MCTS) algorithm to solve the stochastic orienteering problem with chance constraints, i.e., a version of the problem where travel costs are random, and one is assigned a bound on the tolerable…

Robotics · Computer Science 2024-09-06 Stefano Carpin

Monte-Carlo planning and Reinforcement Learning (RL) are essential to sequential decision making. The recent AlphaGo and AlphaZero algorithms have shown how to successfully combine these two paradigms in order to solve large scale…

Machine Learning · Computer Science 2021-02-17 Tuan Dam , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Cooperative task assignment is an important subject in multi-agent systems with a wide range of applications. These systems are usually designed with massive communication among the agents to minimize the error in pursuit of the general…

The Multi-Agent Pathfinding (MAPF) problem involves finding a set of conflict-free paths for a group of agents confined to a graph. In typical MAPF scenarios, the graph and the agents' starting and ending vertices are known beforehand,…

Artificial Intelligence · Computer Science 2023-12-27 Alexey Skrynnik , Anton Andreychuk , Konstantin Yakovlev , Aleksandr Panov

This study investigates the combined use of generative grammar rules and Monte Carlo Tree Search (MCTS) for optimizing truss structures. Our approach accommodates intermediate construction stages characteristic of progressive construction…

Computational Engineering, Finance, and Science · Computer Science 2025-04-03 Gabriel Garayalde , Luca Rosafalco , Matteo Torzoni , Alberto Corigliano

Planning under social interactions with other agents is an essential problem for autonomous driving. As the actions of the autonomous vehicle in the interactions affect and are also affected by other agents, autonomous vehicles need to…

Robotics · Computer Science 2022-07-11 Chenran Li , Tu Trinh , Letian Wang , Changliu Liu , Masayoshi Tomizuka , Wei Zhan

We present a general algorithm to order moves so as to speedup exact game solvers. It uses online learning of playout policies and Monte Carlo Tree Search. The learned policy and the information in the Monte Carlo tree are used to order…

Artificial Intelligence · Computer Science 2020-01-16 Tristan Cazenave