English
Related papers

Related papers: Object-Centric Task and Motion Planning in Dynamic…

200 papers

Robotic planning problems in hybrid state and action spaces can be solved by integrated task and motion planners (TAMP) that handle the complex interaction between motion-level decisions and task-level plan feasibility. TAMP approaches rely…

Robotics · Computer Science 2021-07-19 Tom Silver , Rohan Chitnis , Joshua Tenenbaum , Leslie Pack Kaelbling , Tomas Lozano-Perez

In this paper, we propose a deep convolutional recurrent neural network that predicts action sequences for task and motion planning (TAMP) from an initial scene image. Typical TAMP problems are formalized by combining reasoning on a…

Machine Learning · Computer Science 2020-06-11 Danny Driess , Jung-Su Ha , Marc Toussaint

We present a learning-enabled Task and Motion Planning (TAMP) algorithm for solving mobile manipulation problems in environments with many articulated and movable obstacles. Our idea is to bias the search procedure of a traditional TAMP…

Robotics · Computer Science 2023-05-23 Zhutian Yang , Caelan Reed Garrett , Tomás Lozano-Pérez , Leslie Kaelbling , Dieter Fox

For effective human-robot interaction, robots need to understand, plan, and execute complex, long-horizon tasks described by natural language. Recent advances in large language models (LLMs) have shown promise for translating natural…

Robotics · Computer Science 2024-03-25 Yongchao Chen , Jacob Arkin , Charles Dawson , Yang Zhang , Nicholas Roy , Chuchu Fan

Integrated task and motion planning (TAMP) has proven to be a valuable approach to generalizable long-horizon robotic manipulation and navigation problems. However, the typical TAMP problem formulation assumes full observability and…

In this paper, we propose using deep neural architectures (i.e., vision transformers and ResNet) as heuristics for sequential decision-making in robotic manipulation problems. This formulation enables predicting the subset of objects that…

Robotics · Computer Science 2023-08-02 Hongyou Zhou , Ingmar Schubert , Marc Toussaint , Ozgur S. Oguz

A robot deployed in a home over long stretches of time faces a true lifelong learning problem. As it seeks to provide assistance to its users, the robot should leverage any accumulated experience to improve its own knowledge and…

Robotics · Computer Science 2023-11-07 Jorge Mendez-Mendez , Leslie Pack Kaelbling , Tomás Lozano-Pérez

Robotic manipulation in complex, constrained spaces is vital for widespread applications but challenging, particularly when navigating narrow passages with elongated objects. Existing planning methods often fail in these low-clearance…

Robotics · Computer Science 2025-11-10 Zihao Li , Yiming Zhu , Zhe Zhong , Qinyuan Ren , Yijiang Huang

Planning long-horizon robot manipulation requires making discrete decisions about which objects to interact with and continuous decisions about how to interact with them. A robot planner must select grasps, placements, and motions that are…

Task and motion planning (TAMP) frameworks address long and complex planning problems by integrating high-level task planners with low-level motion planners. However, existing TAMP methods rely heavily on the manual design of planning…

Robotics · Computer Science 2025-09-09 Jinbang Huang , Allen Tao , Rozilyn Marco , Miroslav Bogdanovic , Jonathan Kelly , Florian Shkurti

Adapting to unforeseen novelties in open-world environments remains a major challenge for autonomous systems. While hybrid planning and reinforcement learning (RL) approaches show promise, they often suffer from sample inefficiency, slow…

Robotics · Computer Science 2026-01-27 Pierrick Lorang

Mobile robots are often tasked with repeatedly navigating through an environment whose traversability changes over time. These changes may exhibit some hidden structure, which can be learned. Many studies consider reactive algorithms for…

Robotics · Computer Science 2020-12-07 Florence Tsang , Tristan Walker , Ryan A. MacDonald , Armin Sadeghi , Stephen L. Smith

We present an integrated Task-Motion Planning (TMP) framework for navigation in large-scale environment. Autonomous robots operating in real world complex scenarios require planning in the discrete (task) space and the continuous (motion)…

Robotics · Computer Science 2019-10-28 Antony Thomas , Fulvio Mastrogiovanni , Marco Baglietto

Task and motion planning (TAMP) for robotics manipulation necessitates long-horizon reasoning involving versatile actions and skills. While deterministic actions can be crafted by sampling or optimizing with certain constraints, planning…

Robotics · Computer Science 2025-10-17 Gaoyuan Liu , Joris de Winter , Yuri Durodie , Denis Steckelmacher , Ann Nowe , Bram Vanderborght

In this paper, we introduce a multi-robot system that integrates mapping, localization, and task and motion planning (TAMP) enabled by 3D scene graphs to execute complex instructions expressed in natural language. Our system builds a shared…

We present an efficient task and motion replanning approach for sequential multi-object manipulation in dynamic environments. Conventional Task And Motion Planning (TAMP) solvers experience an exponential increase in planning time as the…

Robotics · Computer Science 2026-05-20 Yan Zhang , Teng Xue , Amirreza Razmjoo , Sylvain Calinon

Imitation learning is a powerful tool for training robot manipulation policies, allowing them to learn from expert demonstrations without manual programming or trial-and-error. However, common methods of data collection, such as human…

Robotics · Computer Science 2023-10-18 Murtaza Dalal , Ajay Mandlekar , Caelan Garrett , Ankur Handa , Ruslan Salakhutdinov , Dieter Fox

We consider manipulation problems in constrained and cluttered settings, which require several regrasps at unknown locations. We propose to inform an optimization-based task and motion planning (TAMP) solver with possible regrasp areas and…

Robotics · Computer Science 2025-07-17 Svetlana Levit , Marc Toussaint

While modern policy optimization methods can do complex manipulation from sensory data, they struggle on problems with extended time horizons and multiple sub-goals. On the other hand, task and motion planning (TAMP) methods scale to long…

Robotics · Computer Science 2021-12-08 Michael James McDonald , Dylan Hadfield-Menell

Planning for sequential robotics tasks often requires integrated symbolic and geometric reasoning. TAMP algorithms typically solve these problems by performing a tree search over high-level task sequences while checking for kinematic and…