English
Related papers

Related papers: Conditional Multi-Stage Failure Recovery for Embod…

200 papers

Reinforcement learning (RL) systems have countless applications, from energy-grid management to protein design. However, such real-world scenarios are often extremely difficult, combinatorial in nature, and require complex coordination…

The performance of large language model (LLM) agents depends critically on the execution harness, the system layer that orchestrates tool use, context management, and state persistence. Yet this same architectural centrality makes the…

Cryptography and Security · Computer Science 2026-05-12 Xixun Lin , Yang Liu , Yancheng Chen , Yongxuan Wu , Yucheng Ning , Yilong Liu , Nan Sun , Shun Zhang , Bin Chong , Chuan Zhou , Yanan Cao

Large language models (LLMs) have transformed the development of embodied intelligence. By providing a few contextual demonstrations, developers can utilize the extensive internal knowledge of LLMs to effortlessly translate complex tasks…

Artificial Intelligence · Computer Science 2024-08-07 Aishan Liu , Yuguang Zhou , Xianglong Liu , Tianyuan Zhang , Siyuan Liang , Jiakai Wang , Yanjun Pu , Tianlin Li , Junqi Zhang , Wenbo Zhou , Qing Guo , Dacheng Tao

In embodied artificial intelligence, enabling heterogeneous robot teams to execute long-horizon tasks from high-level instructions remains a critical challenge. While large language models (LLMs) show promise in instruction parsing and…

Robotics · Computer Science 2026-03-06 Haishan Zeng , Mengna Wang , Peng Li

Embodied long-horizon manipulation requires robotic systems to process multimodal inputs-such as vision and natural language-and translate them into executable actions. However, existing learning-based approaches often depend on large,…

Large Language Model (LLM) agentic systems are software systems powered by LLMs that autonomously reason, plan, and execute multi-step workflows to achieve human goals, rather than merely executing predefined steps. During execution, these…

Software Engineering · Computer Science 2025-08-12 Jingwen Zhou , Jieshan Chen , Qinghua Lu , Dehai Zhao , Liming Zhu

Effective incident management in large-scale IT systems relies on troubleshooting guides (TSGs), but their manual execution is slow and error-prone. While recent advances in LLMs offer promise for automating incident management tasks,…

Artificial Intelligence · Computer Science 2026-04-22 Jiayi Mao , Liqun Li , Yanjie Gao , Zegang Peng , Shilin He , Chaoyun Zhang , Si Qin , Samia Khalid , Qingwei Lin , Saravan Rajmohan , Sitaram Lanka , Dongmei Zhang

Large Language Models are being increasingly deployed as the decision-making core of autonomous agents capable of effecting change in external environments. Yet, in conversational benchmarks, which simulate real-world customer-centric issue…

Computation and Language · Computer Science 2026-04-29 Amir Saeidi , Venkatesh Mishra , Souradeep Mukhopadhyay , Gaowen Liu , Ali Payani , Jayanth Srinivasa , Chitta Baral

In this work, we introduce a novel approach that equips LLM agents with introspection, enhancing consistency and adaptability in solving complex tasks. Our approach prompts LLM agents to decompose a given task into manageable subtasks…

Artificial Intelligence · Computer Science 2024-06-24 Haoyu Wang , Tao Li , Zhiwei Deng , Dan Roth , Yang Li

Large language model (LLM) agents frequently fail on multi-step tasks involving reasoning, tool use, and environment interaction. While such failures are typically logged or retried heuristically, they contain structured signals about where…

Machine Learning · Computer Science 2026-05-26 Akash Bonagiri , Devang Borkar , Gerard Janno Anderias , Setareh Rafatirad , Houman Homayoun

Prompting strategies affect LLM reasoning performance, but their role in chart-based QA remains underexplored. We present a systematic evaluation of four widely used prompting paradigms (Zero-Shot, Few-Shot, Zero-Shot Chain-of-Thought, and…

Computation and Language · Computer Science 2026-03-25 Ruthuparna Naikar , Ying Zhu

Foundation models trained on web-scale data have revolutionized robotics, but their application to low-level control remains largely limited to behavioral cloning. Drawing inspiration from the success of the reinforcement learning stage in…

Machine Learning · Computer Science 2025-09-19 Seyed Kamyar Seyed Ghasemipour , Ayzaan Wahid , Jonathan Tompson , Pannag Sanketi , Igor Mordatch

Multi-agent systems powered by large language models (LLMs) are transforming enterprise automation, yet systematic evaluation methodologies for assessing tool-use reliability remain underdeveloped. We introduce a comprehensive diagnostic…

Artificial Intelligence · Computer Science 2026-01-26 Donghao Huang , Gauri Malwe , Zhaoxia Wang

Embodied instruction following (EIF) requires agents to understand and execute complex natural language commands within interactive 3D environments. Despite recent advances, existing methods often fail in long-horizon planning and handling…

Robotics · Computer Science 2026-05-26 Xicheng Gong , Guozheng Sun , Peiran Xu , Yadong Mu

Large language model-based multi-agent systems have shown great abilities across various tasks due to the collaboration of expert agents, each focusing on a specific domain. However, the impact of clumsy or even malicious agents--those who…

Artificial Intelligence · Computer Science 2025-05-30 Jen-tse Huang , Jiaxu Zhou , Tailin Jin , Xuhui Zhou , Zixi Chen , Wenxuan Wang , Youliang Yuan , Michael R. Lyu , Maarten Sap

The field of Embodied AI is witnessing a rapid evolution toward general-purpose robotic systems, fueled by high-fidelity simulation and large-scale data collection. However, this scaling capability remains severely bottlenecked by a…

Artificial Intelligence · Computer Science 2026-01-30 Zixing Lei , Genjia Liu , Yuanshuo Zhang , Qipeng Liu , Chuan Wen , Shanghang Zhang , Wenzhao Lian , Siheng Chen

LLM agents often fail in closed-world embodied environments because actions must satisfy strict preconditions -- such as location, inventory, and container states -- and failure feedback is sparse. We identify two structurally coupled…

Artificial Intelligence · Computer Science 2026-03-19 Zhenhang Yuan , Shenghai Yuan , Lihua Xie

Leveraging Multi-modal Large Language Models (MLLMs) to create embodied agents offers a promising avenue for tackling real-world tasks. While language-centric embodied agents have garnered substantial attention, MLLM-based embodied agents…

Unsupervised zero-shot reinforcement learning (RL) has emerged as a powerful paradigm for pretraining behavioral foundation models (BFMs), enabling agents to solve a wide range of downstream tasks specified via reward functions in a…

Long-horizon embodied agents increasingly delegate navigation, search, approach, and manipulation to specialist executors. As these executors become stronger, the main bottleneck shifts from local skill execution to maintaining a coherent…

Robotics · Computer Science 2026-05-20 Shuhan Guo , Kun Zhang , Haifei Liu , Xingyu Gao , Yongqi Zhang , Yaqing Wang , Quanming Yao