English
Related papers

Related papers: PLATO: Planning with LLMs and Affordances for Tool…

200 papers

Language models (LMs) have demonstrated their capability in possessing commonsense knowledge of the physical world, a crucial aspect of performing tasks in everyday life. However, it remains unclear **whether LMs have the capacity to…

Artificial Intelligence · Computer Science 2023-07-18 Bill Yuchen Lin , Chengsong Huang , Qian Liu , Wenda Gu , Sam Sommerer , Xiang Ren

Recent advancements in large language models (LLMs) have enabled LLM-based agents to successfully tackle interactive planning tasks. However, despite their successes, existing approaches often suffer from planning hallucinations and require…

Computation and Language · Computer Science 2025-09-11 Weimin Xiong , Yifan Song , Qingxiu Dong , Bingchan Zhao , Feifan Song , Xun Wang , Sujian Li

Learning a perception and reasoning module for robotic assistants to plan steps to perform complex tasks based on natural language instructions often requires large free-form language annotations, especially for short high-level…

Robotics · Computer Science 2024-12-24 Taewoong Kim , Byeonghwi Kim , Jonghyun Choi

Large Language Models (LLMs) have gained popularity in task planning for long-horizon manipulation tasks. To enhance the validity of LLM-generated plans, visual demonstrations and online videos have been widely employed to guide the…

Robotics · Computer Science 2025-03-12 Kejia Chen , Zheng Shen , Yue Zhang , Lingyun Chen , Fan Wu , Zhenshan Bing , Sami Haddadin , Alois Knoll

For effective human-robot interaction, robots need to understand, plan, and execute complex, long-horizon tasks described by natural language. Recent advances in large language models (LLMs) have shown promise for translating natural…

Robotics · Computer Science 2024-03-25 Yongchao Chen , Jacob Arkin , Charles Dawson , Yang Zhang , Nicholas Roy , Chuchu Fan

In modern industry, dynamic environments and the complexity of modular and reconfigurable resources require automated planning of process sequences. Capability-based planning approaches address this by automatically generating plans from…

Artificial Intelligence · Computer Science 2026-05-28 Luis Miguel Vieira da Silva , Nicolas König , Felix Gehlhoff

Task planning systems have been developed to help robots use human knowledge (about actions) to complete long-horizon tasks. Most of them have been developed for "closed worlds" while assuming the robot is provided with complete world…

Robotics · Computer Science 2023-10-09 Yan Ding , Xiaohan Zhang , Saeid Amiri , Nieqing Cao , Hao Yang , Andy Kaminski , Chad Esselink , Shiqi Zhang

Contact is at the core of robotic manipulation. At times, it is desired (e.g. manipulation and grasping), and at times, it is harmful (e.g. when avoiding obstacles). However, traditional path planning algorithms focus solely on…

Robotics · Computer Science 2023-09-01 Amber Xie , Youngwoon Lee , Pieter Abbeel , Stephen James

Artificial intelligence is transforming precision agriculture, offering farmers new tools to streamline their daily operations. While these technological advances promise increased efficiency, they often introduce additional complexity and…

Robotics · Computer Science 2025-09-15 Marcos Abel Zuzuárregui , Mustafa Melih Toslak , Stefano Carpin

We propose a novel approach to multi-robot collaboration that harnesses the power of pre-trained large language models (LLMs) for both high-level communication and low-level path planning. Robots are equipped with LLMs to discuss and…

Robotics · Computer Science 2023-07-11 Zhao Mandi , Shreeya Jain , Shuran Song

Large Language Models (LLMs) present a promising frontier in robotic task planning by leveraging extensive human knowledge. Nevertheless, the current literature often overlooks the critical aspects of robots' adaptability and error…

Robotics · Computer Science 2024-11-27 Sthithpragya Gupta , Kunpeng Yao , Loïc Niederhauser , Aude Billard

Enabling humanoid robots to perform long-horizon mobile manipulation planning in real-world environments based on embodied perception and comprehension abilities has been a longstanding challenge. With the recent rise of large language…

Robotics · Computer Science 2025-03-12 Fangyuan Wang , Shipeng Lyu , Peng Zhou , Anqing Duan , Guodong Guo , David Navarro-Alarcon

The integration of Large Language Models (LLMs) into robotics has unlocked unprecedented capabilities in high-level task planning. However, most current systems operate in an open-loop fashion, where LLMs act as one-shot planners, rendering…

Robotics · Computer Science 2025-12-30 Anjali R. Menon , Rohit K. Sharma , Priya Singh , Chengyu Wang , Aurora M. Ferreira , Mateja Novak

The advent of Large Language Models (LLMs) has significantly transformed tasks across Software Engineering. In the context of Business Process Management, LLMs are now being explored as tools to derive process models directly from textual…

Software Engineering · Computer Science 2026-05-01 Pedro-Aarón Hernández-Ávalos , Luciano García-Bañuelos

Strategic planning is critical for multi-step reasoning, yet compact Large Language Models (LLMs) often lack the capacity to formulate global strategies, leading to error propagation in long-horizon tasks. Our analysis reveals that LLMs…

Computation and Language · Computer Science 2026-04-15 Haoyu Zheng , Yun Zhu , Yuqian Yuan , Bo Yuan , Wenqiao Zhang , Siliang Tang , Jun Xiao

Existing autonomous robot navigation systems allow robots to move from one point to another in a collision-free manner. However, when facing new environments, these systems generally require re-tuning by expert roboticists with a good…

Robotics · Computer Science 2020-07-17 Xuesu Xiao , Bo Liu , Garrett Warnell , Jonathan Fink , Peter Stone

The impressive capabilities of Large Language Models (LLMs) have led to various efforts to enable robots to be controlled through natural language instructions, opening exciting possibilities for human-robot interaction The goal is for the…

Robotics · Computer Science 2024-03-19 Seif Ismail , Antonio Arbues , Ryan Cotterell , René Zurbrügg , Carmen Amo Alonso

One of the challenges in robotics is to enable robotic units with the reasoning capability that would be robust enough to execute complex tasks in dynamic environments. Recent advances in LLMs have positioned them as go-to tools for simple…

Robotics · Computer Science 2024-02-09 Jiaqiang Ye Zhu , Carla Gomez Cano , David Vazquez Bermudez , Michal Drozdzal

In domains requiring intelligent agents to emulate plausible human-like behaviour, such as formative simulations, traditional techniques like behaviour trees encounter significant challenges. Large Language Models (LLMs), despite not always…

Artificial Intelligence · Computer Science 2025-01-20 Israel Puerta-Merino , Jordi Sabater-Mir

The ability of Language Models (LMs) to understand natural language makes them a powerful tool for parsing human instructions into task plans for autonomous robots. Unlike traditional planning methods that rely on domain-specific knowledge…