English
Related papers

Related papers: Multimodal Contextualized Plan Prediction for Embo…

200 papers

Accomplishing household tasks requires to plan step-by-step actions considering the consequences of previous actions. However, the state-of-the-art embodied agents often make mistakes in navigating the environment and interacting with…

Robotics · Computer Science 2024-03-14 Byeonghwi Kim , Jinyeon Kim , Yuyeong Kim , Cheolhong Min , Jonghyun Choi

Large Language Models (LLMs) exhibit remarkable capabilities in the hierarchical decomposition of complex tasks through semantic reasoning. However, their application in embodied systems faces challenges in ensuring reliable execution of…

Robotics · Computer Science 2025-03-04 Mingcong Lei , Ge Wang , Yiming Zhao , Zhixin Mai , Qing Zhao , Yao Guo , Zhen Li , Shuguang Cui , Yatong Han , Jinke Ren

This paper addresses task planning problems for language-instructed robot teams. Tasks are expressed in natural language (NL), requiring the robots to apply their capabilities at various locations and semantic objects. Several recent works…

Robotics · Computer Science 2024-11-22 Jun Wang , Guocheng He , Yiannis Kantaros

Recent advances in large language models (LLMs) have enabled the automatic generation of executable code for task planning and control in embodied agents such as robots, demonstrating the potential of LLM-based embodied intelligence.…

Artificial Intelligence · Computer Science 2025-10-27 Sanghyun Ahn , Wonje Choi , Junyong Lee , Jinwoo Park , Honguk Woo

Uncertainties in the real world mean that is impossible for system designers to anticipate and explicitly design for all scenarios that a robot might encounter. Thus, robots designed like this are fragile and fail outside of…

Robotics · Computer Science 2023-10-02 Ricardo Cannizzaro , Jonathan Routley , Lars Kunze

A robot deployed in a home over long stretches of time faces a true lifelong learning problem. As it seeks to provide assistance to its users, the robot should leverage any accumulated experience to improve its own knowledge and…

Robotics · Computer Science 2023-11-07 Jorge Mendez-Mendez , Leslie Pack Kaelbling , Tomás Lozano-Pérez

Over the last decade, the use of robots in production and daily life has increased. With increasingly complex tasks and interaction in different environments including humans, robots are required a higher level of autonomy for efficient…

Robotics · Computer Science 2023-01-19 Daniele Meli , Hirenkumar Nakawala , Paolo Fiorini

We want a multi-robot team to complete complex tasks in minimum time where the locations of task-relevant objects are not known. Effective task completion requires reasoning over long horizons about the likely locations of task-relevant…

Robotics · Computer Science 2026-03-24 Abhish Khanal , Abhishek Paudel , Hung Pham , Gregory J. Stein

This work addresses the problem of multi-robot coordination under unknown robot transition models, ensuring that tasks specified by Time Window Temporal Logic are satisfied with user-defined probability thresholds. We present a bi-level…

Robotics · Computer Science 2025-02-17 Xiaoshan Lin , Roberto Tron

Robot task planning decomposes human instructions into executable action sequences that enable robots to complete a series of complex tasks. Although recent large language model (LLM)-based task planners achieve amazing performance, they…

Robotics · Computer Science 2026-05-12 Chenxi Jiang , Chuhao Zhou , Jianfei Yang

We propose a novel planning technique for satisfying tasks specified in temporal logic in partially revealed environments. We define high-level actions derived from the environment and the given task itself, and estimate how each action…

Combining symbolic and geometric reasoning in multi-agent systems is a challenging task that involves planning, scheduling, and synchronization problems. Existing works overlooked the variability of task duration and geometric feasibility…

Robot planning is the process of selecting a sequence of actions that optimize for a task specific objective. The optimal solutions to such tasks are heavily influenced by the implicit structure in the environment, i.e. the configuration of…

We consider a sequential task and motion planning (tamp) setting in which a robot is assigned continuous-space rearrangement-style tasks one-at-a-time in an environment that persists between each. Lacking advance knowledge of future tasks,…

Robotics · Computer Science 2024-07-19 Roshan Dhakal , Duc M. Nguyen , Tom Silver , Xuesu Xiao , Gregory J. Stein

This paper addresses planning problems for mobile robots. We consider missions that require accomplishing multiple high-level sub-tasks, expressed in natural language (NL), in a temporal and logical order. To formally define the mission, we…

Robotics · Computer Science 2025-09-18 Jun Wang , Jiaming Tong , Kaiyuan Tan , Yevgeniy Vorobeychik , Yiannis Kantaros

Code completion is one of the most useful features in the Integrated Development Environments (IDEs), which can accelerate software development by suggesting the next probable token based on the contextual code in real-time. Recent studies…

Software Engineering · Computer Science 2021-01-01 Fang Liu , Ge Li , Yunfei Zhao , Zhi Jin

World models have emerged as a pivotal component in robot manipulation planning, enabling agents to predict future environmental states and reason about the consequences of actions before execution. While video-generation models are…

Robotics · Computer Science 2025-12-10 Wenjiang Xu , Cindy Wang , Rui Fang , Mingkang Zhang , Lusong Li , Jing Xu , Jiayuan Gu , Zecui Zeng , Rui Chen

Traditional AI-planning methods for task planning in robotics require a symbolically encoded domain description. While powerful in well-defined scenarios, as well as human-interpretable, setting this up requires substantial effort.…

Robotics · Computer Science 2025-02-21 Shijia Li , Tomas Kulvicius , Minija Tamosiunaite , Florentin Wörgötter

Recent advancements in large language models (LLMs) have shown significant promise in various domains, especially robotics. However, most prior LLM-based work in robotic applications either directly predicts waypoints or applies LLMs within…

Robotics · Computer Science 2025-10-01 Yue Meng , Fei Chen , Yongchao Chen , Chuchu Fan

Large Language Models (LLMs) present a promising frontier in robotic task planning by leveraging extensive human knowledge. Nevertheless, the current literature often overlooks the critical aspects of robots' adaptability and error…

Robotics · Computer Science 2024-11-27 Sthithpragya Gupta , Kunpeng Yao , Loïc Niederhauser , Aude Billard