English
Related papers

Related papers: ProgPrompt: Generating Situated Robot Task Plans u…

200 papers

We introduce Action-GPT, a plug-and-play framework for incorporating Large Language Models (LLMs) into text-based action generation models. Action phrases in current motion capture datasets contain minimal and to-the-point information. By…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Sai Shashank Kalakonda , Shubh Maheshwari , Ravi Kiran Sarvadevabhatla

In robotics, the use of Large Language Models (LLMs) is becoming prevalent, especially for understanding human commands. In particular, LLMs are utilized as domain-agnostic task planners for high-level human commands. LLMs are capable of…

Robotics · Computer Science 2024-04-08 Gawon Choi , Hyemin Ahn

Large Language Models (LLMs) have the potential to revolutionize automated traceability by overcoming the challenges faced by previous methods and introducing new possibilities. However, the optimal utilization of LLMs for automated…

Software Engineering · Computer Science 2023-08-02 Alberto D. Rodriguez , Katherine R. Dearstyne , Jane Cleland-Huang

We demonstrate experimental results with LLMs that address robotics task planning problems. Recently, LLMs have been applied in robotics task planning, particularly using a code generation approach that converts complex high-level…

Robotics · Computer Science 2024-04-09 Yusuke Mikami , Andrew Melnik , Jun Miura , Ville Hautamäki

Developing domain models is one of the few remaining places that require manual human labor in AI planning. Thus, in order to make planning more accessible, it is desirable to automate the process of domain model generation. To this end, we…

Computation and Language · Computer Science 2024-05-14 James Oswald , Kavitha Srinivas , Harsha Kokel , Junkyu Lee , Michael Katz , Shirin Sohrabi

Large Language Models (LLMs) present a promising frontier in robotic task planning by leveraging extensive human knowledge. Nevertheless, the current literature often overlooks the critical aspects of robots' adaptability and error…

Robotics · Computer Science 2024-11-27 Sthithpragya Gupta , Kunpeng Yao , Loïc Niederhauser , Aude Billard

Recent years have witnessed a growing interest in automating labor-intensive and complex activities, i.e., those consisting of multiple atomic tasks, by deploying robots in dynamic and unpredictable environments such as industrial and…

Robotics · Computer Science 2025-09-22 Francesco Argenziano , Elena Umili , Francesco Leotta , Daniele Nardi

Pre-trained language models (PLM) have marked a huge leap in neural dialogue modeling. While PLMs are pre-trained on large-scale text corpora, they are usually fine-tuned on scarce dialogue data with specific domain knowledge and dialogue…

Computation and Language · Computer Science 2021-12-14 Xiaodong Gu , Kang Min Yoo , Sang-Woo Lee

Successful application of large language models (LLMs) to robotic planning and execution may pave the way to automate numerous real-world tasks. Promising recent research has been conducted showing that the knowledge contained in LLMs can…

Robotics · Computer Science 2024-07-23 Ateeq Sharfuddin , Travis Breaux

Large Language Models (LLMs) have shown remarkable performance in various basic natural language tasks. For completing the complex task, we still need a plan for the task to guide LLMs to generate the specific solutions step by step. LLMs…

Computation and Language · Computer Science 2023-12-14 Yiduo Guo , Yaobo Liang , Chenfei Wu , Wenshan Wu , Dongyan Zhao , Nan Duan

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long…

Computation and Language · Computer Science 2025-04-21 Teng Wang , Zhenqi He , Wing-Yin Yu , Xiaojin Fu , Xiongwei Han

Large Language Models (LLMs) are nowadays extensively used for various types of software engineering tasks, primarily code generation. Previous research has shown how suitable prompt engineering could help developers in improving their code…

The remarkable success of pretrained language models has motivated the study of what kinds of knowledge these models learn during pretraining. Reformulating tasks as fill-in-the-blanks problems (e.g., cloze tests) is a natural approach for…

Computation and Language · Computer Science 2020-11-10 Taylor Shin , Yasaman Razeghi , Robert L. Logan , Eric Wallace , Sameer Singh

The use of Large Language Models (LLMs) for generating Behavior Trees (BTs) has recently gained attention in the robotics community, yet remains in its early stages of development. In this paper, we propose a novel framework that leverages…

Robotics · Computer Science 2025-01-13 Naoki Wake , Atsushi Kanehira , Jun Takamatsu , Kazuhiro Sasabuchi , Katsushi Ikeuchi

To combat climate change, individuals are encouraged to adopt sustainable habits, in particular, with their household, optimizing their electrical consumption. Conversational agents, such as Smart Home Assistants, hold promise as effective…

Human-Computer Interaction · Computer Science 2025-05-06 Mathyas Giudici , Alessandro Sironi , Ismaele Villa , Samuele Scherini , Franca Garzotto

Mobile robot path planning in complex environments remains a significant challenge, especially in achieving efficient, safe and robust paths. The traditional path planning techniques like DRL models typically trained for a given…

Robotics · Computer Science 2025-01-28 Muhammad Taha Tariq , Congqing Wang , Yasir Hussain

Video procedure planning, i.e., planning a sequence of action steps given the video frames of start and goal states, is an essential ability for embodied AI. Recent works utilize Large Language Models (LLMs) to generate enriched action step…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Dejie Yang , Zijing Zhao , Yang Liu

Planning is an important capability of artificial agents that perform long-horizon tasks in real-world environments. In this work, we explore the use of pre-trained language models (PLMs) to reason about plan sequences from text…

Computation and Language · Computer Science 2023-03-17 Anthony Z. Liu , Lajanugen Logeswaran , Sungryull Sohn , Honglak Lee

Collecting large amounts of real-world interaction data to train general robotic policies is often prohibitively expensive, thus motivating the use of simulation data. However, existing methods for data generation have generally focused on…

Machine Learning · Computer Science 2024-01-23 Lirui Wang , Yiyang Ling , Zhecheng Yuan , Mohit Shridhar , Chen Bao , Yuzhe Qin , Bailin Wang , Huazhe Xu , Xiaolong Wang

Pre-trained large language models (LLMs) show promise for robotic task planning but often struggle to guarantee correctness in long-horizon problems. Task and motion planning (TAMP) addresses this by grounding symbolic plans in low-level…

Robotics · Computer Science 2026-02-13 Jinbang Huang , Yixin Xiao , Zhanguang Zhang , Mark Coates , Jianye Hao , Yingxue Zhang