English
Related papers

Related papers: ProgPrompt: Generating Situated Robot Task Plans u…

200 papers

Recent large language models (LLMs) are capable of planning robot actions. In this paper, we explore how LLMs can be used for planning actions with tasks involving situational human-robot interaction (HRI). A key problem of applying LLMs in…

Robotics · Computer Science 2025-04-03 Kazuhiro Sasabuchi , Naoki Wake , Atsushi Kanehira , Jun Takamatsu , Katsushi Ikeuchi

Large and small language models have been widely used for robotic task planning. At the same time, vision-language models (VLMs) have successfully tackled problems such as image captioning, scene understanding, and visual question…

Robotics · Computer Science 2026-03-09 Cristiano Battistini , Riccardo Andrea Izzo , Gianluca Bardaro , Matteo Matteucci

Conditional graphic layout generation, which automatically maps user constraints to high-quality layouts, has attracted widespread attention today. Although recent works have achieved promising performance, the lack of versatility and data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Jiawei Lin , Jiaqi Guo , Shizhao Sun , Zijiang James Yang , Jian-Guang Lou , Dongmei Zhang

Large language models (LLMs) have undergone significant expansion and have been increasingly integrated across various domains. Notably, in the realm of robot task planning, LLMs harness their advanced reasoning and language comprehension…

While large language models (LLMs) are successful in completing various language processing tasks, they easily fail to interact with the physical world by generating control sequences properly. We find that the main reason is that LLMs are…

Artificial Intelligence · Computer Science 2024-04-18 Guangran Cheng , Chuheng Zhang , Wenzhe Cai , Li Zhao , Changyin Sun , Jiang Bian

Large language models (LLMs) have shown remarkable performance on many different Natural Language Processing (NLP) tasks. Prompt engineering plays a key role in adding more to the already existing abilities of LLMs to achieve significant…

Computation and Language · Computer Science 2024-07-25 Shubham Vatsal , Harsh Dubey

Prompt engineering has emerged as a powerful technique for guiding large language models (LLMs) toward desired responses, significantly enhancing their performance across diverse tasks. Beyond their role as static predictors, LLMs…

Machine Learning · Computer Science 2025-03-27 Ryumei Nakada , Wenlong Ji , Tianxi Cai , James Zou , Linjun Zhang

Programming a robotic is a complex task, as it demands the user to have a good command of specific programming languages and awareness of the robot's physical constraints. We propose a framework that simplifies robot deployment by allowing…

Human-Computer Interaction · Computer Science 2024-07-18 Cathy Mengying Fang , Krzysztof Zieliński , Pattie Maes , Joe Paradiso , Bruce Blumberg , Mikkel Baun Kjærgaard

Large Language Models (LLMs) possess extensive foundational knowledge and moderate reasoning abilities, making them suitable for general task planning in open-world scenarios. However, it is challenging to ground a LLM-generated plan to be…

Artificial Intelligence · Computer Science 2024-06-06 Xinrui Lin , Yangfan Wu , Huanyu Yang , Yu Zhang , Yanyong Zhang , Jianmin Ji

Layered architectures have been widely used in robot systems. The majority of them implement planning and execution functions in separate layers. However, there still lacks a straightforward way to transit high-level tasks in the planning…

Robotics · Computer Science 2023-10-03 Yue Cao , C. S. George Lee

This paper presents the development of an AI-powered workflow that uses Large Language Models (LLMs) to assist in drafting schematic architectural floor plans from natural language prompts. The proposed system interprets textual input to…

Artificial Intelligence · Computer Science 2025-09-03 Jayakrishna Duggempudi , Lu Gao , Ahmed Senouci , Zhe Han , Yunpeng Zhang

Long-horizon task planning is essential for the development of intelligent assistive and service robots. In this work, we investigate the applicability of a smaller class of large language models (LLMs), specifically GPT-2, in robotic task…

Robotics · Computer Science 2023-05-16 Georgia Chalvatzaki , Ali Younes , Daljeet Nandha , An Le , Leonardo F. R. Ribeiro , Iryna Gurevych

We present a novel framework that integrates Large Language Models (LLMs) with automated planning and formal verification to streamline the creation and use of Markov Decision Processes (MDP). Our system leverages LLMs to extract structured…

Robotics · Computer Science 2026-01-12 Enrico Saccon , Davide De Martini , Matteo Saveriano , Edoardo Lamon , Luigi Palopoli , Marco Roveri

Large Language Models (LLMs) are revolutionizing the field of computing education with their powerful code-generating capabilities. Traditional pedagogical practices have focused on code writing tasks, but there is now a shift in importance…

Human-Computer Interaction · Computer Science 2023-11-13 Paul Denny , Juho Leinonen , James Prather , Andrew Luxton-Reilly , Thezyrie Amarouche , Brett A. Becker , Brent N. Reeves

This study introduces intelligent frameworks that use Large Language Models (LLMs) to improve task scheduling for construction robots. The LLM is fed with key data about the desired task, such as agent action abilities, and the desired end…

Robotics · Computer Science 2026-05-18 Swayamjit Saha , Subhabrata Das , Haonan Duan , Xiao-Yang Liu

Large Language Models (LLMs) have been shown to act like planners that can decompose high-level instructions into a sequence of executable instructions. However, current LLM-based planners are only able to operate with a fixed set of…

Robotics · Computer Science 2023-10-25 Meenal Parakh , Alisha Fong , Anthony Simeonov , Tao Chen , Abhishek Gupta , Pulkit Agrawal

Large language models (LLMs) achieve impressive results over various tasks, and ever-expanding public repositories contain an abundance of pre-trained models. Therefore, identifying the best-performing LLM for a given task is a significant…

Computation and Language · Computer Science 2025-11-13 Idan Kashani , Avi Mendelson , Yaniv Nemcovsky

Robotic agents must master common sense and long-term sequential decisions to solve daily tasks through natural language instruction. The developments in Large Language Models (LLMs) in natural language processing have inspired efforts to…

Robotics · Computer Science 2024-09-16 Yaran Chen , Wenbo Cui , Yuanwen Chen , Mining Tan , Xinyao Zhang , Dongbin Zhao , He Wang

Large Language Models (LLMs) have revolutionized human-AI interaction by enabling intuitive task execution through natural language prompts. Despite their potential, designing effective prompts remains a significant challenge, as small…

Software Engineering · Computer Science 2025-04-08 Yuetian Mao , Junjie He , Chunyang Chen

Prompt-learning has become a new paradigm in modern natural language processing, which directly adapts pre-trained language models (PLMs) to $cloze$-style prediction, autoregressive modeling, or sequence to sequence generation, resulting in…

Computation and Language · Computer Science 2021-11-04 Ning Ding , Shengding Hu , Weilin Zhao , Yulin Chen , Zhiyuan Liu , Hai-Tao Zheng , Maosong Sun