English
Related papers

Related papers: LLM-GROP: Visually Grounded Robot Task and Motion …

200 papers

We address multi-robot geometric task-and-motion planning (MR-GTAMP) problems in synchronous, monotone setups. The goal of the MR-GTAMP problem is to move objects with multiple robots to goal regions in the presence of other movable…

Cooking tasks remain a challenging problem for robotics due to their complexity. Videos of people cooking are a valuable source of information for such task, but introduces a lot of variability in terms of how to translate this data to a…

Robotics · Computer Science 2025-03-28 Ryunosuke Takebayashi , Vitor Hideyo Isume , Takuya Kiyokawa , Weiwei Wan , Kensuke Harada

This study proposes a hierarchically integrated framework for safe task and motion planning (TAMP) of bipedal locomotion in a partially observable environment with dynamic obstacles and uneven terrain. The high-level task planner employs…

Systems and Control · Electrical Eng. & Systems 2023-03-09 Abdulaziz Shamsah , Zhaoyuan Gu , Jonas Warnke , Seth Hutchinson , Ye Zhao

We address multi-robot geometric task-and-motion planning (MR-GTAMP) problems in synchronous, monotone setups. The goal of the MR-GTAMP problem is to move objects with multiple robots to goal regions in the presence of other movable…

Robotics · Computer Science 2022-10-18 Hejia Zhang , Shao-Hung Chan , Jie Zhong , Jiaoyang Li , Sven Koenig , Stefanos Nikolaidis

Integrated task and motion planning (TAMP) has proven to be a valuable approach to generalizable long-horizon robotic manipulation and navigation problems. However, the typical TAMP problem formulation assumes full observability and…

Robot planning in partially observable environments, where not all objects are known or visible, is a challenging problem, as it requires reasoning under uncertainty through partially observable Markov decision processes. During the…

Mobile robots are often tasked with repeatedly navigating through an environment whose traversability changes over time. These changes may exhibit some hidden structure, which can be learned. Many studies consider reactive algorithms for…

Robotics · Computer Science 2020-12-07 Florence Tsang , Tristan Walker , Ryan A. MacDonald , Armin Sadeghi , Stephen L. Smith

A robot deployed in a home over long stretches of time faces a true lifelong learning problem. As it seeks to provide assistance to its users, the robot should leverage any accumulated experience to improve its own knowledge and…

Robotics · Computer Science 2023-11-07 Jorge Mendez-Mendez , Leslie Pack Kaelbling , Tomás Lozano-Pérez

We present an integrated Task-Motion Planning (TMP) framework for navigation in large-scale environment. Autonomous robots operating in real world complex scenarios require planning in the discrete (task) space and the continuous (motion)…

Robotics · Computer Science 2019-10-28 Antony Thomas , Fulvio Mastrogiovanni , Marco Baglietto

Vision Language Models (VLMs) play a crucial role in robotic manipulation by enabling robots to understand and interpret the visual properties of objects and their surroundings, allowing them to perform manipulation based on this multimodal…

Robotics · Computer Science 2025-05-21 Nurhan Bulus Guran , Hanchi Ren , Jingjing Deng , Xianghua Xie

Object manipulation for rearrangement into a specific goal state is a significant task for collaborative robots. Accurately determining object placement is a key challenge, as misalignment can increase task complexity and the risk of…

Robotics · Computer Science 2025-03-06 Guanqun Cao , Ryan Mckenna , Erich Graf , John Oyekan

It is crucial to efficiently execute instructions such as "Find an apple and a banana" or "Get ready for a field trip," which require searching for multiple objects or understanding context-dependent commands. This study addresses the…

Advancements in large language models (LLMs) have demonstrated their potential in facilitating high-level reasoning, logical reasoning and robotics planning. Recently, LLMs have also been able to generate reward functions for low-level…

Robotics · Computer Science 2024-02-21 Marta Skreta , Zihan Zhou , Jia Lin Yuan , Kourosh Darvish , Alán Aspuru-Guzik , Animesh Garg

Task and motion planning is one of the key problems in robotics today. It is often formulated as a discrete task allocation problem combined with continuous motion planning. Many existing approaches to TAMP involve explicit descriptions of…

Robotics · Computer Science 2023-09-28 Jimmy Envall , Roi Poranne , Stelian Coros

Integrating robotic systems in architectural and construction processes is of core interest to increase the efficiency of the building industry. Automated planning for such systems enables design analysis tools and facilitates faster design…

Robotics · Computer Science 2021-06-07 Valentin N. Hartmann , Ozgur S. Oguz , Danny Driess , Marc Toussaint , Achim Menges

Sequential decision-making and motion planning for robotic manipulation induce combinatorial complexity. For long-horizon tasks, especially when the environment comprises many objects that can be interacted with, planning efficiency becomes…

Robotics · Computer Science 2022-03-08 Cornelius V. Braun , Joaquim Ortiz-Haro , Marc Toussaint , Ozgur S. Oguz

The problem of relocating a set of objects to designated areas amidst movable obstacles can be framed as a Geometric Task and Motion Planning (G-TAMP) problem, a subclass of task and motion planning (TAMP). Traditional approaches to G-TAMP…

Robotics · Computer Science 2025-06-10 Dongryung Lee , Sejune Joo , Kimin Lee , Beomjoon Kim

Using large language models (LLMs) to solve complex robotics problems requires understanding their planning capabilities. Yet while we know that LLMs can plan on some problems, the extent to which these planning capabilities cover the space…

Robotics · Computer Science 2025-10-02 Jorge Mendez-Mendez

We present an integrated Task-Motion Planning (TMP) framework for navigation in large-scale environments. Of late, TMP for manipulation has attracted significant interest resulting in a proliferation of different approaches. In contrast,…

Robotics · Computer Science 2021-11-05 Antony Thomas , Fulvio Mastrogiovanni , Marco Baglietto

Large language models (LLMs) have gained increasing popularity in robotic task planning due to their exceptional abilities in text analytics and generation, as well as their broad knowledge of the world. However, they fall short in decoding…

Robotics · Computer Science 2024-08-01 Aoran Mei , Guo-Niu Zhu , Huaxiang Zhang , Zhongxue Gan