English
Related papers

Related papers: Towards High Efficient Long-horizon Planning with …

200 papers

Active Inference, grounded in the Free Energy Principle, provides a powerful lens for understanding how agents balance exploration and goal-directed behavior in uncertain environments. Here, we propose a new planning framework, that…

Artificial Intelligence · Computer Science 2025-01-27 Mawaba Pascal Dao , Adrian M. Peter

Recent advancements in large language models (LLMs) have shown remarkable potential in automating machine learning tasks. However, existing LLM-based agents often struggle with low-diversity and suboptimal code generation. While recent work…

Computation and Language · Computer Science 2026-01-26 Zujie Liang , Feng Wei , Wujiang Xu , Lin Chen , Yuxi Qian , Xinhui Wu

Long-horizon planning in realistic environments requires the ability to reason over sequential tasks in high-dimensional state spaces with complex dynamics. Classical motion planning algorithms, such as rapidly-exploring random trees, are…

Robotics · Computer Science 2020-10-14 Brian Ichter , Pierre Sermanet , Corey Lynch

Monte-Carlo Tree Search (MCTS) methods, such as Upper Confidence Bound applied to Trees (UCT), are instrumental to automated planning techniques. However, UCT can be slow to explore an optimal action when it initially appears inferior to…

Artificial Intelligence · Computer Science 2024-04-12 Michael Painter , Mohamed Baioumy , Nick Hawes , Bruno Lacerda

Sequential decision making problems, such as structured prediction, robotic control, and game playing, require a combination of planning policies and generalisation of those plans. In this paper, we present Expert Iteration (ExIt), a novel…

Artificial Intelligence · Computer Science 2024-10-25 Thomas Anthony , Zheng Tian , David Barber

We present TransZero, a model-based reinforcement learning algorithm that removes the sequential bottleneck in Monte Carlo Tree Search (MCTS). Unlike MuZero, which constructs its search tree step by step using a recurrent dynamics model,…

Machine Learning · Computer Science 2025-09-16 Emil Malmsten , Wendelin Böhmer

Large Language Models (LLMs) have empowered autonomous agents to handle complex web navigation tasks. While recent studies integrate tree search to enhance long-horizon reasoning, applying these algorithms in web navigation faces two…

Artificial Intelligence · Computer Science 2026-02-17 Weiming Zhang , Jihong Wang , Jiamu Zhou , Qingyao Li , Xinbei Ma , Congmin Zheng , Xingyu Lou , Weiwen Liu , Zhuosheng Zhang , Jun Wang , Yong Yu , Weinan Zhang

We present a self-improving, Neural Tree Expansion (NTE) method for multi-robot online planning in non-cooperative environments, where each robot attempts to maximize its cumulative reward while interacting with other self-interested…

Robotics · Computer Science 2021-07-12 Benjamin Riviere , Wolfgang Hoenig , Matthew Anderson , Soon-Jo Chung

Inference-time scaling strategies, particularly Monte Carlo Tree Search (MCTS), have significantly enhanced the reasoning capabilities of Large Language Models (LLMs). However, current approaches remain predominantly stateless, discarding…

Artificial Intelligence · Computer Science 2026-02-05 Hao Lu , Haoyuan Huang , Yulin Zhou , Chen Li , Ningxin Zhu

Recent breakthroughs in Artificial Intelligence have shown that the combination of tree-based planning with deep learning can lead to superior performance. We present Adaptive Entropy Tree Search (ANTS) - a novel algorithm combining…

Artificial Intelligence · Computer Science 2023-03-16 Piotr Kozakowski , Mikołaj Pacek , Piotr Miłoś

Monte Carlo tree search (MCTS) is one of the most capable online search algorithms for sequential planning tasks, with significant applications in areas such as resource allocation and transit planning. Despite its strong performance in…

Artificial Intelligence · Computer Science 2024-10-31 Ziyan An , Hendrik Baier , Abhishek Dubey , Ayan Mukhopadhyay , Meiyi Ma

Popular Monte-Carlo tree search (MCTS) algorithms for online planning, such as epsilon-greedy tree search and UCT, aim at rapidly identifying a reasonably good action, but provide rather poor worst-case guarantees on performance improvement…

Artificial Intelligence · Computer Science 2013-09-27 Zohar Feldman , Carmel Domshlak

Automated algorithm discovery in scientific computing faces fundamental challenges: vast design spaces with expensive evaluations, domain-specific physical constraints requiring expert knowledge, and the necessity for interpretable…

Artificial Intelligence · Computer Science 2025-11-18 He Wang , Liang Zeng

Monte Carlo Tree Search (MCTS) has proven highly effective in solving complex planning tasks by balancing exploration and exploitation using Upper Confidence Bound for Trees (UCT). However, existing work have not considered MCTS-based…

Artificial Intelligence · Computer Science 2025-02-04 Zuyuan Zhang , Tian Lan

This paper investigates the optimal signal detection problem with a particular interest in large-scale multiple-input multiple-output (MIMO) systems. The problem is NP-hard and can be solved optimally by searching the shortest path on the…

Machine Learning · Computer Science 2022-03-22 Le He , Ke He , Lisheng Fan , Xianfu Lei , Arumugam Nallanathan , George K. Karagiannidis

Monte Carlo Tree Search (MCTS) algorithms such as AlphaGo and MuZero have achieved superhuman performance in many challenging tasks. However, the computational complexity of MCTS-based algorithms is influenced by the size of the search…

Artificial Intelligence · Computer Science 2023-10-11 Yangqing Fu , Ming Sun , Buqing Nie , Yue Gao

We consider task and motion planning in complex dynamic environments for problems expressed in terms of a set of Linear Temporal Logic (LTL) constraints, and a reward function. We propose a methodology based on reinforcement learning that…

Robotics · Computer Science 2017-03-24 Chris Paxton , Vasumathi Raman , Gregory D. Hager , Marin Kobilarov

Real-time planning under uncertainty is critical for robots operating in complex dynamic environments. Consider, for example, an autonomous robot vehicle driving in dense, unregulated urban traffic of cars, motorcycles, buses, etc. The…

Robotics · Computer Science 2022-08-10 Panpan Cai , David Hsu

Today's automated vehicles lack the ability to cooperate implicitly with others. This work presents a Monte Carlo Tree Search (MCTS) based approach for decentralized cooperative planning using macro-actions for automated vehicles in…

Artificial Intelligence · Computer Science 2020-02-04 Karl Kurzer , Chenyang Zhou , J. Marius Zöllner

Planning problems are among the most important and well-studied problems in artificial intelligence. They are most typically solved by tree search algorithms that simulate ahead into the future, evaluate future states, and back-up those…

Artificial Intelligence · Computer Science 2018-07-18 Arthur Guez , Théophane Weber , Ioannis Antonoglou , Karen Simonyan , Oriol Vinyals , Daan Wierstra , Rémi Munos , David Silver