English
Related papers

Related papers: LLM-GROP: Visually Grounded Robot Task and Motion …

200 papers

Task and Motion Planning (TAMP) algorithms can generate plans that combine logic and motion aspects for robots. However, these plans are sensitive to interference and control errors. To make TAMP more applicable in real-world, we propose…

Robotics · Computer Science 2024-03-12 Tao Lin , Chengfei Yue , Ziran Liu , Xibin Cao

Long-horizon task and motion planning (TAMP) is notoriously difficult to solve, let alone optimally, due to the tight coupling between the interleaved (discrete) task and (continuous) motion planning phases, where each phase on its own is…

Robotics · Computer Science 2024-04-11 Kai Gao , Zihe Ye , Duo Zhang , Baichuan Huang , Jingjin Yu

Current robots are capable of computing plans to accomplish complex tasks. However, real-world environments are inherently open and dynamic, and unforeseen situations frequently arise during plan execution, such as jamming doors and fallen…

We present a task-and-motion planning (TAMP) algorithm robust against a human operator's cooperative or adversarial interventions. Interventions often invalidate the current plan and require replanning on the fly. Replanning can be…

Robotics · Computer Science 2021-03-29 Shen Li , Daehyung Park , Yoonchang Sung , Julie A. Shah , Nicholas Roy

Performing complex manipulation tasks in dynamic environments requires efficient Task and Motion Planning (TAMP) approaches that combine high-level symbolic plans with low-level motion control. Advances in Large Language Models (LLMs), such…

Robotics · Computer Science 2025-10-02 Muhayy Ud Din , Jan Rosell , Waseem Akram , Isiah Zaplana , Maximo A Roa , Irfan Hussain

Large Language Models (LLMs) have demonstrated remarkable planning abilities across various domains, including robotics manipulation and navigation. While recent efforts in robotics have leveraged LLMs both for high-level and low-level…

Robotics · Computer Science 2025-08-26 Harsh Singh , Rocktim Jyoti Das , Mingfei Han , Preslav Nakov , Ivan Laptev

While modern policy optimization methods can do complex manipulation from sensory data, they struggle on problems with extended time horizons and multiple sub-goals. On the other hand, task and motion planning (TAMP) methods scale to long…

Robotics · Computer Science 2021-12-08 Michael James McDonald , Dylan Hadfield-Menell

Integrated task and motion planning (TAMP) is desirable for generalized autonomy robots but it is challenging at the same time. TAMP requires the planner to not only search in both the large symbolic task space and the high-dimension motion…

Robotics · Computer Science 2021-10-18 Tianyu Ren , Georgia Chalvatzaki , Jan Peters

Conventional Task and Motion Planning (TAMP) approaches rely on manually crafted interfaces connecting symbolic task planning with continuous motion generation. These domain-specific and labor-intensive modules are limited in addressing…

Robotics · Computer Science 2024-08-22 Shu Wang , Muzhi Han , Ziyuan Jiao , Zeyu Zhang , Ying Nian Wu , Song-Chun Zhu , Hangxin Liu

With the rapid advancement of artificial intelligence, there is an increasing demand for intelligent robots capable of assisting humans in daily tasks and performing complex operations. Such robots not only require task planning…

Robotics · Computer Science 2025-05-01 Huihui Guo , Huilong Pi , Yunchuan Qin , Zhuo Tang , Kenli Li

Robotic planning problems in hybrid state and action spaces can be solved by integrated task and motion planners (TAMP) that handle the complex interaction between motion-level decisions and task-level plan feasibility. TAMP approaches rely…

Robotics · Computer Science 2021-07-19 Tom Silver , Rohan Chitnis , Joshua Tenenbaum , Leslie Pack Kaelbling , Tomas Lozano-Perez

Visual robot navigation within large-scale, semi-structured environments deals with various challenges such as computation intensive path planning algorithms or insufficient knowledge about traversable spaces. Moreover, many…

Robotics · Computer Science 2018-03-12 Fabian Blöchliger , Marius Fehr , Marcin Dymczyk , Thomas Schneider , Roland Siegwart

Imitation learning from human demonstrations can teach robots complex manipulation skills, but is time-consuming and labor intensive. In contrast, Task and Motion Planning (TAMP) systems are automated and excel at solving long-horizon…

Robotics · Computer Science 2023-10-25 Ajay Mandlekar , Caelan Garrett , Danfei Xu , Dieter Fox

Enabling humanoid robots to perform autonomously loco-manipulation in unstructured environments is crucial and highly challenging for achieving embodied intelligence. This involves robots being able to plan their actions and behaviors in…

Robotics · Computer Science 2024-08-16 Jin Wang , Arturo Laurenzi , Nikos Tsagarakis

In the pursuit of fully autonomous robotic systems capable of taking over tasks traditionally performed by humans, the complexity of open-world environments poses a considerable challenge. Addressing this imperative, this study contributes…

We introduce a new method that extracts knowledge from a large language model (LLM) to produce object-level plans, which describe high-level changes to object state, and uses them to bootstrap task and motion planning (TAMP). Existing work…

Robotics · Computer Science 2025-03-24 David Paulius , Alejandro Agostini , Benedict Quartey , George Konidaris

This paper addresses the problem of multi-robot coordination for complex manipulation task sequences. We present a vision-driven task-and-motion planning (TAMP) framework for a real dual-agent platform that integrates task decomposition and…

Robotics · Computer Science 2026-04-22 Abdelaziz Shaarawy , Cansu Erdogan , Rustam Stolkin , Alireza Rastegarpanah

Task and motion planning is a well-established approach for solving long-horizon robot planning problems. However, traditional methods assume that each task-level robot action, or skill, can be reduced to kinematic motion planning. We…

Robotics · Computer Science 2026-01-21 Benned Hedegaard , Yichen Wei , Ahmed Jaafar , Stefanie Tellex , George Konidaris , Naman Shah

Despite great strides in language-guided manipulation, existing work has been constrained to table-top settings. Table-tops allow for perfect and consistent camera angles, properties are that do not hold in mobile manipulation. Task plans…

Robotics · Computer Science 2023-11-08 Priyam Parashar , Vidhi Jain , Xiaohan Zhang , Jay Vakil , Sam Powers , Yonatan Bisk , Chris Paxton

In this study, we are interested in imbuing robots with the capability of physically-grounded task planning. Recent advancements have shown that large language models (LLMs) possess extensive knowledge useful in robotic tasks, especially in…

Robotics · Computer Science 2023-12-27 Yingdong Hu , Fanqi Lin , Tong Zhang , Li Yi , Yang Gao