English
Related papers

Related papers: Plan-MCTS: Plan Exploration for Action Exploitatio…

200 papers

Large Language Model (LLM) web agents often struggle with long-horizon web navigation and web task completion in new websites, producing inefficient action sequences unless fine-tuned on environment-specific data. We show that…

The problem of relocating a set of objects to designated areas amidst movable obstacles can be framed as a Geometric Task and Motion Planning (G-TAMP) problem, a subclass of task and motion planning (TAMP). Traditional approaches to G-TAMP…

Robotics · Computer Science 2025-06-10 Dongryung Lee , Sejune Joo , Kimin Lee , Beomjoon Kim

In response to the lack of trust in Artificial Intelligence (AI) for sequential planning, we design a Computational Tree Logic-guided large language model (LLM)-based natural language explanation framework designed for the Monte Carlo Tree…

Artificial Intelligence · Computer Science 2025-05-02 Ziyan An , Xia Wang , Hendrik Baier , Zirong Chen , Abhishek Dubey , Taylor T. Johnson , Jonathan Sprinkle , Ayan Mukhopadhyay , Meiyi Ma

Planning problems are among the most important and well-studied problems in artificial intelligence. They are most typically solved by tree search algorithms that simulate ahead into the future, evaluate future states, and back-up those…

Artificial Intelligence · Computer Science 2018-07-18 Arthur Guez , Théophane Weber , Ioannis Antonoglou , Karen Simonyan , Oriol Vinyals , Daan Wierstra , Rémi Munos , David Silver

We introduce a novel approach to the executable semantic object rearrangement problem. In this challenge, a robot seeks to create an actionable plan that rearranges objects within a scene according to a pattern dictated by a natural…

Large Language Models (LLMs) have achieved significant advances in reasoning tasks. A key approach is tree-based search with verifiers, which expand candidate reasoning paths and use reward models to guide pruning and selection. Although…

Artificial Intelligence · Computer Science 2025-10-01 Yingqian Cui , Zhenwei Dai , Pengfei He , Bing He , Hui Liu , Xianfeng Tang , Jingying Zeng , Suhang Wang , Yue Xing , Jiliang Tang , Benoit Dumoulin

Automated agent workflows can enhance the problem-solving ability of large language models (LLMs), but common search strategies rely on stochastic exploration and often traverse implausible branches. This occurs because current pipelines…

Artificial Intelligence · Computer Science 2026-01-21 Qitong Fang , Haotian Li , Xu Wang

Large language models (LLMs) have been successfully adapted for interactive decision-making tasks like web navigation. While achieving decent performance, previous methods implicitly assume a forward-only execution mode for the model, where…

Computation and Language · Computer Science 2024-02-22 Kaixin Ma , Hongming Zhang , Hongwei Wang , Xiaoman Pan , Wenhao Yu , Dong Yu

Language agents based on large language models (LLMs) have demonstrated great promise in automating web-based tasks. Recent work has shown that incorporating advanced planning algorithms, e.g., tree search, is advantageous over reactive…

Artificial Intelligence · Computer Science 2025-04-02 Yu Gu , Kai Zhang , Yuting Ning , Boyuan Zheng , Boyu Gou , Tianci Xue , Cheng Chang , Sanjari Srivastava , Yanan Xie , Peng Qi , Huan Sun , Yu Su

While researchers have made significant progress in enabling large language models (LLMs) to perform multi-step planning, LLMs struggle to ensure that those plans align with high-level user intent and satisfy symbolic constraints,…

Machine Learning · Computer Science 2026-05-14 Kamel Alrashedy , Vriksha Srihari , Zulfiqar Zaidi , Ridam Srivastava , Pradyumna Tambwekar , Matthew Gombolay

Tree-search decoding is an effective form of test-time scaling for large language models (LLMs), but real-world deployment imposes a fixed per-query token budget that varies across settings. Existing tree-search policies are largely…

Computation and Language · Computer Science 2026-02-11 Sora Miyamoto , Daisuke Oba , Naoaki Okazaki

Long-horizon planning in realistic environments requires the ability to reason over sequential tasks in high-dimensional state spaces with complex dynamics. Classical motion planning algorithms, such as rapidly-exploring random trees, are…

Robotics · Computer Science 2020-10-14 Brian Ichter , Pierre Sermanet , Corey Lynch

Recent advancements in Large Language Models (LLMs) have sparked a revolution across many research fields. In robotics, the integration of common-sense knowledge from LLMs into task and motion planning has drastically advanced the field by…

Robotics · Computer Science 2025-04-02 Yuchen Liu , Luigi Palmieri , Sebastian Koch , Ilche Georgievski , Marco Aiello

There emerges a promising trend of using large language models (LLMs) to generate code-like plans for complex inference tasks such as visual reasoning. This paradigm, known as LLM-based planning, provides flexibility in problem solving and…

Computation and Language · Computer Science 2023-08-22 Pengbo Hu , Ji Qi , Xingyu Li , Hong Li , Xinqi Wang , Bing Quan , Ruiyu Wang , Yi Zhou

Test-time scaling (TTS) enhances the performance of large language models (LLMs) by allocating additional compute resources during inference. However, existing research primarily investigates TTS in single-stage tasks; while many real-world…

Artificial Intelligence · Computer Science 2025-10-23 Fali Wang , Hui Liu , Zhenwei Dai , Jingying Zeng , Zhiwei Zhang , Zongyu Wu , Chen Luo , Zhen Li , Xianfeng Tang , Qi He , Suhang Wang

Real-time planning under uncertainty is critical for robots operating in complex dynamic environments. Consider, for example, an autonomous robot vehicle driving in dense, unregulated urban traffic of cars, motorcycles, buses, etc. The…

Robotics · Computer Science 2022-08-10 Panpan Cai , David Hsu

Efficient exploration is a well known problem in deep reinforcement learning and this problem is exacerbated in multi-agent reinforcement learning due the intrinsic complexities of such algorithms. There are several approaches to…

Artificial Intelligence · Computer Science 2025-07-11 Ashish Kumar

Large language model (LLM) agents are becoming competent at straightforward web tasks, such as opening an item page or submitting a form, but still struggle with objectives that require long horizon navigation, large scale information…

Artificial Intelligence · Computer Science 2025-10-09 Jingbo Yang , Bairu Hou , Wei Wei , Shiyu Chang , Yujia Bao

Probabilistic search algorithms, such as Monte Carlo Tree Search (MCTS), have proven very effective in solving sequential decision-making tasks under uncertainty. However, interpreting asymmetric search trees that incorporate bandit-based…

Human-Computer Interaction · Computer Science 2026-05-21 Siqi Lu , Mirsaleh Bahavarnia , Hiba Baroud , Yixuan Zhang , Hemant Purohit , Ayan Mukhopadhyay

The rapid expansion of modern wide-area networks (WANs) has made traffic engineering (TE) increasingly challenging, as traditional solvers struggle to keep pace. Although existing offline ML-driven approaches accelerate TE optimization with…

Networking and Internet Architecture · Computer Science 2026-02-03 Xinyu Yuan , Yan Qiao , Zonghui Wang , Meng Li , Wenzhi Chen