English
Related papers

Related papers: AutoTAMP: Autoregressive Task and Motion Planning …

200 papers

Robotic agents must master common sense and long-term sequential decisions to solve daily tasks through natural language instruction. The developments in Large Language Models (LLMs) in natural language processing have inspired efforts to…

Robotics · Computer Science 2024-09-16 Yaran Chen , Wenbo Cui , Yuanwen Chen , Mining Tan , Xinyao Zhang , Dongbin Zhao , He Wang

In this work, we introduce SMART-LLM, an innovative framework designed for embodied multi-robot task planning. SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models (LLMs), harnesses the power of LLMs to convert…

Robotics · Computer Science 2024-03-26 Shyam Sundar Kannan , Vishnunandan L. N. Venkatesh , Byung-Cheol Min

We have a vision of a day when autonomous robots can collaborate with humans as assistants in performing complex tasks in the physical world. This vision includes that the robots will have the ability to communicate with their human…

Robotics · Computer Science 2025-09-22 Peter Lindes , Kaoutar Skiker

Tool use is a hallmark of advanced intelligence, exemplified in both animal behavior and robotic capabilities. This paper investigates the feasibility of imbuing robots with the ability to creatively use tools in tasks that involve implicit…

Robotics · Computer Science 2023-10-23 Mengdi Xu , Peide Huang , Wenhao Yu , Shiqi Liu , Xilun Zhang , Yaru Niu , Tingnan Zhang , Fei Xia , Jie Tan , Ding Zhao

This paper presents a novel approach to enhance autonomous robotic manipulation using the Large Language Model (LLM) for logical inference, converting high-level language commands into sequences of executable motion functions. The proposed…

Robotics · Computer Science 2023-08-30 Haokun Liu , Yaonan Zhu , Kenji Kato , Izumi Kondo , Tadayoshi Aoyama , Yasuhisa Hasegawa

We present a task-and-motion planning (TAMP) algorithm robust against a human operator's cooperative or adversarial interventions. Interventions often invalidate the current plan and require replanning on the fly. Replanning can be…

Robotics · Computer Science 2021-03-29 Shen Li , Daehyung Park , Yoonchang Sung , Julie A. Shah , Nicholas Roy

The ability of Language Models (LMs) to understand natural language makes them a powerful tool for parsing human instructions into task plans for autonomous robots. Unlike traditional planning methods that rely on domain-specific knowledge…

Recent large language models (LLMs) are promising for making decisions in grounded environments. However, LLMs frequently fail in complex decision-making tasks due to the misalignment between the pre-trained knowledge in LLMs and the actual…

Computation and Language · Computer Science 2023-10-27 Siqi Ouyang , Lei Li

This study proposes a hierarchically integrated framework for safe task and motion planning (TAMP) of bipedal locomotion in a partially observable environment with dynamic obstacles and uneven terrain. The high-level task planner employs…

Systems and Control · Electrical Eng. & Systems 2023-03-09 Abdulaziz Shamsah , Zhaoyuan Gu , Jonas Warnke , Seth Hutchinson , Ye Zhao

Autonomous navigation guided by natural language instructions is essential for improving human-robot interaction and enabling complex operations in dynamic environments. While large language models (LLMs) are not inherently designed for…

Robotics · Computer Science 2024-12-04 Pranav Doma , Aliasghar Arab , Xuesu Xiao

We introduce a new method that extracts knowledge from a large language model (LLM) to produce object-level plans, which describe high-level changes to object state, and uses them to bootstrap task and motion planning (TAMP). Existing work…

Robotics · Computer Science 2025-03-24 David Paulius , Alejandro Agostini , Benedict Quartey , George Konidaris

Conventional Task and Motion Planning (TAMP) approaches rely on manually crafted interfaces connecting symbolic task planning with continuous motion generation. These domain-specific and labor-intensive modules are limited in addressing…

Robotics · Computer Science 2024-08-22 Shu Wang , Muzhi Han , Ziyuan Jiao , Zeyu Zhang , Ying Nian Wu , Song-Chun Zhu , Hangxin Liu

Pre-trained large language models (LLMs) show promise for robotic task planning but often struggle to guarantee correctness in long-horizon problems. Task and motion planning (TAMP) addresses this by grounding symbolic plans in low-level…

Robotics · Computer Science 2026-02-13 Jinbang Huang , Yixin Xiao , Zhanguang Zhang , Mark Coates , Jianye Hao , Yingxue Zhang

Bimanual robotic manipulation provides significant versatility, but also presents an inherent challenge due to the complexity involved in the spatial and temporal coordination between two hands. Existing works predominantly focus on…

Robotics · Computer Science 2025-03-24 Kun Chu , Xufeng Zhao , Cornelius Weber , Stefan Wermter

This study introduces intelligent frameworks that use Large Language Models (LLMs) to improve task scheduling for construction robots. The LLM is fed with key data about the desired task, such as agent action abilities, and the desired end…

Robotics · Computer Science 2026-05-18 Swayamjit Saha , Subhabrata Das , Haonan Duan , Xiao-Yang Liu

Enabling robotic agents to perform complex long-horizon tasks has been a long-standing goal in robotics and artificial intelligence (AI). Despite the potential shown by large language models (LLMs), their planning capabilities remain…

Robotics · Computer Science 2024-07-16 Guanqi Chen , Lei Yang , Ruixing Jia , Zhe Hu , Yizhou Chen , Wei Zhang , Wenping Wang , Jia Pan

We address the problem of applying Task and Motion Planning (TAMP) in real world environments. TAMP combines symbolic and geometric reasoning to produce sequential manipulation plans, typically specified as joint-space trajectories, which…

Robotics · Computer Science 2020-05-06 Toki Migimatsu , Jeannette Bohg

Using large language models (LLMs) to solve complex robotics problems requires understanding their planning capabilities. Yet while we know that LLMs can plan on some problems, the extent to which these planning capabilities cover the space…

Robotics · Computer Science 2025-10-02 Jorge Mendez-Mendez

Robotic navigation in complex environments remains a critical research challenge. Traditional navigation methods focus on optimal trajectory generation within fixed free workspace, therefore struggling in environments lacking viable paths…

Robotics · Computer Science 2026-01-01 Kangjie Zhou , Yao Mu , Haoyang Song , Yi Zeng , Pengying Wu , Han Gao , Chang Liu

With the rapid advancement of artificial intelligence, there is an increasing demand for intelligent robots capable of assisting humans in daily tasks and performing complex operations. Such robots not only require task planning…

Robotics · Computer Science 2025-05-01 Huihui Guo , Huilong Pi , Yunchuan Qin , Zhuo Tang , Kenli Li