English
Related papers

Related papers: AutoTAMP: Autoregressive Task and Motion Planning …

200 papers

Automated machine learning (AutoML) is a collection of techniques designed to automate the machine learning development process. While traditional AutoML approaches have been successfully applied in several critical steps of model…

Machine Learning · Computer Science 2024-12-30 Zekang Yang , Wang Zeng , Sheng Jin , Chen Qian , Ping Luo , Wentao Liu

A robot in a human-centric environment needs to account for the human's intent and future motion in its task and motion planning to ensure safe and effective operation. This requires symbolic reasoning about probable future actions and the…

Robotics · Computer Science 2023-11-01 Moritz A. Graule , Volkan Isler

Planning is a crucial task for agents in task oriented dialogs (TODs). Human agents typically resolve user issues by following predefined workflows, decomposing workflow steps into actionable items, and performing actions by executing APIs…

Computation and Language · Computer Science 2024-06-06 Shamik Roy , Sailik Sengupta , Daniele Bonadiman , Saab Mansour , Arshit Gupta

Vision-Language Models (VLMs) demonstrate remarkable potential in robotic manipulation, yet challenges persist in executing complex fine manipulation tasks with high speed and precision. While excelling at high-level planning, existing VLM…

Robotics · Computer Science 2025-03-10 Qingxuan Jia , Guoqin Tang , Zeyuan Huang , Zixuan Hao , Ning Ji , Shihang , Yin , Gang Chen

Planning represents a fundamental capability of intelligent agents, requiring comprehensive environmental understanding, rigorous logical reasoning, and effective sequential decision-making. While Large Language Models (LLMs) have…

Artificial Intelligence · Computer Science 2025-05-27 Pengfei Cao , Tianyi Men , Wencan Liu , Jingwen Zhang , Xuzhao Li , Xixun Lin , Dianbo Sui , Yanan Cao , Kang Liu , Jun Zhao

Recent advancements in Large Language Models (LLMs) have shown significant progress in understanding complex natural language. One important application of LLM is LLM-based AI Agent, which leverages the ability of LLM as well as external…

Computation and Language · Computer Science 2024-07-19 Zelong Li , Shuyuan Xu , Kai Mei , Wenyue Hua , Balaji Rama , Om Raheja , Hao Wang , He Zhu , Yongfeng Zhang

Large Language Models (LLMs) enable intelligent multi-robot collaboration but face fundamental trade-offs: open-loop methods that compile tasks into formal representations for external executors produce sound plans but lack adaptability in…

Artificial Intelligence · Computer Science 2026-03-10 Shaobin Ling , Yun Wang , Chenyou Fan , Tin Lun Lam , Junjie Hu

Urban transportation systems encounter diverse challenges across multiple tasks, such as traffic forecasting, electric vehicle (EV) charging demand prediction, and taxi dispatch. Existing approaches suffer from two key limitations:…

Computation and Language · Computer Science 2025-08-21 Jiaming Leng , Yunying Bi , Chuan Qin , Bing Yin , Yanyong Zhang , Chao Wang

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

By combining classical planning methods with large language models (LLMs), recent research such as LLM+P has enabled agents to plan for general tasks given in natural language. However, scaling these methods to general-purpose service…

Robotics · Computer Science 2025-08-05 Krish Agarwal , Yuqian Jiang , Jiaheng Hu , Bo Liu , Peter Stone

The impressive capabilities of Large Language Models (LLMs) have led to various efforts to enable robots to be controlled through natural language instructions, opening exciting possibilities for human-robot interaction The goal is for the…

Robotics · Computer Science 2024-03-19 Seif Ismail , Antonio Arbues , Ryan Cotterell , René Zurbrügg , Carmen Amo Alonso

This paper proposes a new reactive temporal logic planning algorithm for multiple robots that operate in environments with unknown geometry modeled using occupancy grid maps. The robots are equipped with individual sensors that allow them…

Robotics · Computer Science 2020-12-16 Yiannis Kantaros , Matthew Malencia , George J. Pappas

Recent advancements in reasoning abilities of Large Language Models (LLM) has promoted their usage in problems that require high-level planning for robots and artificial agents. However, current techniques that utilize LLMs for such…

Artificial Intelligence · Computer Science 2023-10-17 Yash Shukla , Wenchang Gao , Vasanth Sarathy , Alvaro Velasquez , Robert Wright , Jivko Sinapov

To facilitate the wider adoption of robotics, accessible programming tools are required for non-experts. Observational learning enables intuitive human skills transfer through hands-on demonstrations, but relying solely on visual input can…

Robotics · Computer Science 2025-07-29 Elena Merlo , Marta Lagomarsino , Arash Ajoudani

This paper studies close-loop task planning, which refers to the process of generating a sequence of skills (a plan) to accomplish a specific goal while adapting the plan based on real-time observations. Recently, prompting Large Language…

Computation and Language · Computer Science 2024-07-25 Mengkang Hu , Yao Mu , Xinmiao Yu , Mingyu Ding , Shiguang Wu , Wenqi Shao , Qiguang Chen , Bin Wang , Yu Qiao , Ping Luo

Large language models (LLMs) present intriguing opportunities to enhance user interaction with traditional algorithms and tools in real-world applications. An advanced planning system (APS) is a sophisticated software that leverages…

Artificial Intelligence · Computer Science 2025-07-25 Timothy Tin Long Yu , Mahdi Mostajabdaveh , Jabo Serge Byusa , Rindra Ramamonjison , Giuseppe Carenini , Kun Mao , Zirui Zhou , Yong Zhang

While large language models (LLMs) demonstrate remarkable success in multilingual translation, their internal core translation mechanisms, even at the fundamental word level, remain insufficiently understood. To address this critical gap,…

Computation and Language · Computer Science 2026-01-16 Hongbin Zhang , Kehai Chen , Xuefeng Bai , Xiucheng Li , Yang Xiang , Min Zhang

Travel planning is a complex task that involves generating a sequence of actions related to visiting places subject to constraints and maximizing some user satisfaction criteria. Traditional approaches rely on problem formulation in a given…

Artificial Intelligence · Computer Science 2024-06-17 Tomas de la Rosa , Sriram Gopalakrishnan , Alberto Pozanco , Zhen Zeng , Daniel Borrajo

Large Language Models (LLMs) have been shown to be capable of performing high-level planning for long-horizon robotics tasks, yet existing methods require access to a pre-defined skill library (e.g. picking, placing, pulling, pushing,…

Machine Learning · Computer Science 2024-05-03 Murtaza Dalal , Tarun Chiruvolu , Devendra Chaplot , Ruslan Salakhutdinov

Imitation learning from human demonstrations can teach robots complex manipulation skills, but is time-consuming and labor intensive. In contrast, Task and Motion Planning (TAMP) systems are automated and excel at solving long-horizon…

Robotics · Computer Science 2023-10-25 Ajay Mandlekar , Caelan Garrett , Danfei Xu , Dieter Fox