English
Related papers

Related papers: CookBench: A Long-Horizon Embodied Planning Benchm…

200 papers

Leveraging Multi-modal Large Language Models (MLLMs) to create embodied agents offers a promising avenue for tackling real-world tasks. While language-centric embodied agents have garnered substantial attention, MLLM-based embodied agents…

Embodied AI benchmarks have advanced navigation, manipulation, and reasoning, but most target complex humanoid agents or large-scale simulations that are far from real-world deployment. In contrast, mobile cleaning robots with dual mode…

Robotics · Computer Science 2025-08-08 Wenbo Li , Guanting Chen , Tao Zhao , Jiyao Wang , Tianxin Hu , Yuwen Liao , Weixiang Guo , Shenghai Yuan

The realization of Artificial General Intelligence (AGI) necessitates Embodied AI agents capable of robust spatial perception, effective task planning, and adaptive execution in physical environments. However, current large language models…

AI agents today are mostly siloed - they either retrieve and reason over vast amount of digital information and knowledge obtained online; or interact with the physical world through embodied perception, planning and action - but rarely…

Artificial Intelligence · Computer Science 2025-07-31 Yining Hong , Rui Sun , Bingxuan Li , Xingcheng Yao , Maxine Wu , Alexander Chien , Da Yin , Ying Nian Wu , Zhecan James Wang , Kai-Wei Chang

Embodied AI is a crucial frontier in robotics, capable of planning and executing action sequences for robots to accomplish long-horizon tasks in physical environments. In this work, we introduce EmbodiedGPT, an end-to-end multi-modal…

Robotics · Computer Science 2023-09-15 Yao Mu , Qinglong Zhang , Mengkang Hu , Wenhai Wang , Mingyu Ding , Jun Jin , Bin Wang , Jifeng Dai , Yu Qiao , Ping Luo

Embodied artificial intelligence emphasizes the role of an agent's body in generating human-like behaviors. The recent efforts on EmbodiedAI pay a lot of attention to building up machine learning models to possess perceiving, planning, and…

Artificial Intelligence · Computer Science 2024-10-15 Chen Gao , Baining Zhao , Weichen Zhang , Jinzhu Mao , Jun Zhang , Zhiheng Zheng , Fanhang Man , Jianjie Fang , Zile Zhou , Jinqiang Cui , Xinlei Chen , Yong Li

Embodied long-horizon manipulation requires robotic systems to process multimodal inputs-such as vision and natural language-and translate them into executable actions. However, existing learning-based approaches often depend on large,…

Recent advancements in Large Language Models (LLMs) have spurred numerous attempts to apply these technologies to embodied tasks, particularly focusing on high-level task planning and task decomposition. To further explore this area, we…

The field of Embodied AI is witnessing a rapid evolution toward general-purpose robotic systems, fueled by high-fidelity simulation and large-scale data collection. However, this scaling capability remains severely bottlenecked by a…

Artificial Intelligence · Computer Science 2026-01-30 Zixing Lei , Genjia Liu , Yuanshuo Zhang , Qipeng Liu , Chuan Wen , Shanghang Zhang , Wenzhao Lian , Siheng Chen

This study focuses on Embodied Complex-Question Answering task, which means the embodied robot need to understand human questions with intricate structures and abstract semantics. The core of this task lies in making appropriate plans based…

Robotics · Computer Science 2025-04-02 Ning Lan , Baoshan Ou , Xuemei Xie , Guangming Shi

Large vision-language models have recently demonstrated impressive performance in planning and control tasks, driving interest in their application to real-world robotics. However, deploying these models for reasoning in embodied contexts…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Karmesh Yadav , Yusuf Ali , Gunshi Gupta , Yarin Gal , Zsolt Kira

We present Mini-BEHAVIOR, a novel benchmark for embodied AI that challenges agents to use reasoning and decision-making skills to solve complex activities that resemble everyday human challenges. The Mini-BEHAVIOR environment is a fast,…

Artificial Intelligence · Computer Science 2023-12-29 Emily Jin , Jiaheng Hu , Zhuoyi Huang , Ruohan Zhang , Jiajun Wu , Li Fei-Fei , Roberto Martín-Martín

Long-term memory is fundamental for personalized agents capable of accumulating knowledge, reasoning over user experiences, and adapting across time. However, existing memory benchmarks primarily target declarative memory, specifically…

Recent advances in AI-assisted programming have empowered agents to execute complex workflows via command-line interfaces, however, existing benchmarks are limited by short task horizons, data contamination from GitHub scraping, and a lack…

We aim to evaluate Large Language Models (LLMs) for embodied decision making. While a significant body of work has been leveraging LLMs for decision making in embodied environments, we still lack a systematic understanding of their…

Recent progress in embodied AI has produced a growing ecosystem of robot policies, foundation models, and modular runtimes. However, current evaluation remains dominated by task success metrics such as completion rate or manipulation…

Robotics · Computer Science 2026-04-14 Xue Qin , Simin Luan , John See , Cong Yang , Zhijun Li

Robotic manipulation policies often degrade over extended horizons, yet existing benchmarks provide limited insight into why such failures occur. Most prior benchmarks are either simulation-based or report aggregate success, making it…

Robotics · Computer Science 2026-04-21 Xueyao Chen , Jingkai Jia , Tong Yang , Yibo Fu , Wei Li , Wenqiang Zhang

Embodied decision-making enables agents to translate high-level goals into executable actions through continuous interactions within the physical world, forming a cornerstone of general-purpose embodied intelligence. Large language models…

Artificial Intelligence · Computer Science 2025-10-15 Zixing Lei , Sheng Yin , Yichen Xiong , Yuanzhuo Ding , Wenhao Huang , Yuxi Wei , Qingyao Xu , Yiming Li , Weixin Li , Yunhong Wang , Siheng Chen

Embodied planning requires agents to make coherent multi-step decisions based on dynamic visual observations and natural language goals. While recent vision-language models (VLMs) excel at static perception tasks, they struggle with the…

Artificial Intelligence · Computer Science 2025-07-15 Di Wu , Jiaxin Fan , Junzhe Zang , Guanbo Wang , Wei Yin , Wenhao Li , Bo Jin

Building robots that can perceive, reason, and act in dynamic, unstructured environments remains a core challenge. Recent embodied systems often adopt a dual-system paradigm, where System 2 handles high-level reasoning while System 1…

‹ Prev 1 2 3 10 Next ›