English
Related papers

Related papers: Planning with Vision-Language Models and a Use Cas…

200 papers

The Planning Domain Definition Language (PDDL) is the state-of-the-art language for specifying planning problems in artificial intelligence research. Writing and maintaining these planning problems, however, can be time-consuming and error…

Human-Computer Interaction · Computer Science 2020-08-26 Volker Strobel , Alexandra Kirsch

Pre-trained large language models (LLMs) show promise for robotic task planning but often struggle to guarantee correctness in long-horizon problems. Task and motion planning (TAMP) addresses this by grounding symbolic plans in low-level…

Robotics · Computer Science 2026-02-13 Jinbang Huang , Yixin Xiao , Zhanguang Zhang , Mark Coates , Jianye Hao , Yingxue Zhang

Long-horizon task planning for heterogeneous multi-robot systems is essential for deploying collaborative teams in real-world environments; yet, it remains challenging due to the large volume of perceptual information, much of which is…

Robotics · Computer Science 2026-03-11 Piyush Gupta , Sangjae Bae , Jiachen Li , David Isele

While robots can learn models to solve many manipulation tasks from raw visual input, they cannot usually use these models to solve new problems. On the other hand, symbolic planning methods such as STRIPS have long been able to solve new…

Robotics · Computer Science 2020-03-10 Kei Kase , Chris Paxton , Hammad Mazhar , Tetsuya Ogata , Dieter Fox

Large Language Models have been found to create plans that are neither executable nor verifiable in grounded environments. An emerging line of work demonstrates success in using the LLM as a formalizer to generate a formal representation of…

Computation and Language · Computer Science 2025-06-03 Cassie Huang , Li Zhang

Large Language Models (LLMs) and Visual Language Models (VLMs) are attracting increasing interest due to their improving performance and applications across various domains and tasks. However, LLMs and VLMs can produce erroneous results,…

Artificial Intelligence · Computer Science 2024-12-31 Michele Brienza , Francesco Argenziano , Vincenzo Suriani , Domenico D. Bloisi , Daniele Nardi

We study the usage of language models (LMs) for planning over world models specified in the Planning Domain Definition Language (PDDL). We prompt LMs to generate Python programs that serve as generalised policies for solving PDDL problems…

Artificial Intelligence · Computer Science 2025-08-27 Dillon Z. Chen , Johannes Zenn , Tristan Cinquin , Sheila A. McIlraith

Integration of VLM reasoning with symbolic planning has proven to be a promising approach to real-world robot task planning. Existing work like UniDomain effectively learns symbolic manipulation domains from real-world demonstrations,…

Robotics · Computer Science 2026-02-10 Haoming Ye , Yunxiao Xiao , Cewu Lu , Panpan Cai

The inherent probabilistic nature of Large Language Models (LLMs) introduces an element of unpredictability, raising concerns about potential discrepancies in their output. This paper introduces an innovative approach aims to generate…

Robotics · Computer Science 2024-02-23 Md Sadman Sakib , Yu Sun

Motivated by the substantial achievements observed in Large Language Models (LLMs) in the field of natural language processing, recent research has commenced investigations into the application of LLMs for complex, long-horizon sequential…

Robotics · Computer Science 2023-08-29 Zhehua Zhou , Jiayang Song , Kunpeng Yao , Zhan Shu , Lei Ma

Large Language Models (LLMs) have demonstrated remarkable ability in long-horizon Task and Motion Planning (TAMP) by translating clear and straightforward natural language problems into formal specifications such as the Planning Domain…

Robotics · Computer Science 2024-10-30 Weihang Guo , Zachary Kingston , Lydia E. Kavraki

This paper presents a SysML profile that enables the direct integration of planning semantics based on the Planning Domain Definition Language (PDDL) into system models. Reusable stereotypes are defined for key PDDL concepts such as types,…

Artificial Intelligence · Computer Science 2025-06-10 Hamied Nabizada , Tom Jeleniewski , Lasse Beers , Maximilian Weigand , Felix Gehlhoff , Alexander Fay

Symbolic reasoning systems have been used in cognitive architectures to provide inference and planning capabilities. However, defining domains and problems has proven difficult and prone to errors. Moreover, Large Language Models (LLMs)…

Large language models (LLMs) have demonstrated that large-scale pretraining enables systems to adapt rapidly to new problems with little supervision in the language domain. This success, however, has not translated as effectively to the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Pablo Acuaviva , Aram Davtyan , Mariam Hassan , Sebastian Stapf , Ahmad Rahimi , Alexandre Alahi , Paolo Favaro

Domain generalizability is a crucial aspect of a deep learning model since it determines the capability of the model to perform well on data from unseen domains. However, research on the domain generalizability of deep learning models for…

Computation and Language · Computer Science 2025-07-25 Juhwan Choi , Junehyoung Kwon , JungMin Yun , Seunguk Yu , YoungBin Kim

Task planning, the problem of sequencing actions to reach a goal from an initial state, is a core capability requirement for autonomous robotic systems. Whether large language models (LLMs) can serve as viable planners alongside classical…

Artificial Intelligence · Computer Science 2026-03-09 Kai Göbel , Pierrick Lorang , Patrik Zips , Tobias Glück

Generating an abstraction of a dynamic domain that aligns with a given purpose remains a significant challenge given that the choice of such an abstraction can impact an agent's ability to plan, reason, and provide explanations effectively.…

Artificial Intelligence · Computer Science 2025-10-24 Bita Banihashemi , Megh Patel , Yves Lespérance

Automated planning using a symbolic planning language, such as PDDL, is a general approach to producing optimal plans to achieve a stated goal. However, creating suitable machine understandable descriptions of the planning domain, problem,…

Artificial Intelligence · Computer Science 2025-10-10 Owen Burns , Dana Hughes , Katia Sycara

Recent works have explored using language models for planning problems. One approach examines translating natural language descriptions of planning tasks into structured planning languages, such as the planning domain definition language…

Computation and Language · Computer Science 2025-11-12 Max Zuo , Francisco Piedrahita Velez , Xiaochen Li , Michael L. Littman , Stephen H. Bach

Recent advancements in Generative AI, particularly in Large Language Models (LLMs) and Large Vision-Language Models (LVLMs), offer new possibilities for integrating cognitive planning into robotic systems. In this work, we present a novel…

Robotics · Computer Science 2024-11-06 Arjun P S , Andrew Melnik , Gora Chand Nandi