English
Related papers

Related papers: BEDI: A Comprehensive Benchmark for Evaluating Emb…

200 papers

Aerial navigation is a fundamental yet underexplored capability in embodied intelligence, enabling agents to operate in large-scale, unstructured environments where traditional navigation paradigms fall short. However, most existing…

Robotics · Computer Science 2025-08-25 Jianqiang Xiao , Yuexuan Sun , Yixin Shao , Boxi Gan , Rongqiang Liu , Yanjing Wu , Weili Guan , Xiang Deng

The development of LLM-based autonomous agents for end-to-end software development represents a significant paradigm shift in software engineering. However, the scientific evaluation of these systems is hampered by significant challenges,…

Software Engineering · Computer Science 2025-11-07 Zhengran Zeng , Yixin Li , Rui Xie , Wei Ye , Shikun Zhang

Recent advances in multimodal large language models (MLLMs) have opened new opportunities for embodied intelligence, enabling multimodal understanding, reasoning, and interaction, as well as continuous spatial decision-making. Nevertheless,…

Embodied agents capable of complex physical skills can improve productivity, elevate life quality, and reshape human-machine collaboration. We aim at autonomous training of embodied agents for various tasks involving mainly large foundation…

Robotics · Computer Science 2024-02-14 Sizhe Yang , Qian Luo , Anumpam Pani , Yanchao Yang

We present Mini-BEHAVIOR, a novel benchmark for embodied AI that challenges agents to use reasoning and decision-making skills to solve complex activities that resemble everyday human challenges. The Mini-BEHAVIOR environment is a fast,…

Artificial Intelligence · Computer Science 2023-12-29 Emily Jin , Jiaheng Hu , Zhuoyi Huang , Ruohan Zhang , Jiajun Wu , Li Fei-Fei , Roberto Martín-Martín

Developing agents capable of navigating to a target location based on language instructions and visual information, known as vision-language navigation (VLN), has attracted widespread interest. Most research has focused on ground-based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Xiangyu Wang , Donglin Yang , Ziqin Wang , Hohin Kwan , Jinyu Chen , Wenjun Wu , Hongsheng Li , Yue Liao , Si Liu

Embodied agents can identify and report safety hazards in the home environments. Accurately evaluating their capabilities in home safety inspection tasks is curcial, but existing benchmarks suffer from two key limitations. First, they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Siyuan Gao , Jiashu Yao , Haoyu Wen , Yuhang Guo , Zeming Liu , Heyan Huang

Natural language guided embodied task completion is a challenging problem since it requires understanding natural language instructions, aligning them with egocentric visual observations, and choosing appropriate actions to execute in the…

Computation and Language · Computer Science 2022-05-20 Hyounghun Kim , Aishwarya Padmakumar , Di Jin , Mohit Bansal , Dilek Hakkani-Tur

With the advantage of high mobility, Unmanned Aerial Vehicles (UAVs) are used to fuel numerous important applications in computer vision, delivering more efficiency and convenience than surveillance cameras with fixed camera angle, scale…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Dawei Du , Yuankai Qi , Hongyang Yu , Yifan Yang , Kaiwen Duan , Guorong Li , Weigang Zhang , Qingming Huang , Qi Tian

We describe a framework for research and evaluation in Embodied AI. Our proposal is based on a canonical task: Rearrangement. A standard task can focus the development of new techniques and serve as a source of trained models that can be…

With an increase in the capabilities of generative language models, a growing interest in embodied AI has followed. This contribution introduces RAI - a framework for creating embodied Multi Agent Systems for robotics. The proposed…

Despite advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), their integration into language-grounded, human-like embodied agents remains incomplete, hindering complex real-life task performance in physical…

Computation and Language · Computer Science 2024-08-20 Zhili Cheng , Zhitong Wang , Jinyi Hu , Shengding Hu , An Liu , Yuge Tu , Pengkai Li , Lei Shi , Zhiyuan Liu , Maosong Sun

Embodied AI requires agents to understand goals, plan actions, and execute tasks in simulated environments. We present a comprehensive evaluation of Large Language Models (LLMs) on the VirtualHome benchmark using the Embodied Agent…

Artificial Intelligence · Computer Science 2026-02-04 Jiaqi Xu , Tao Huang , Kai Zhang

Unmanned aerial vehicular network (UAVN) is envisioned to provide flexible connectivity, wide-area coverage, and low-latency services in dynamic environments. From an agentic artificial intelligence (Agentic AI) perspective, UAVNs naturally…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Xin Tang , Xiaohuan Li , Qian Chen , Binhan Liao , Yaqi Zhang , Jianxin Chen , Changyuan Zhao , Junchuan Fan , Junxi Tian

In cloud manufacturing, unmanned aerial vehicles (UAVs) can support both product collection and mobile edge computing (MEC). This joint operation forms a hybrid scheduling problem, where physical logistics decisions are coupled with…

Artificial Intelligence · Computer Science 2026-05-14 Hanwen Zhang , Dusit Niyato , Wei Zhang , Xin Lou , Malcolm Yoke Hean Low

Despite remarkable progress in Vision-Language Navigation (VLN), existing benchmarks remain confined to fixed, small-scale datasets with naive physical simulation. These shortcomings limit the insight that the benchmarks provide into…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Sihao Lin , Zerui Li , Xunyi Zhao , Gengze Zhou , Liuyi Wang , Rong Wei , Rui Tang , Juncheng Li , Hanqing Wang , Jiangmiao Pang , Anton van den Hengel , Jiajun Liu , Qi Wu

The enhancement of generalization in robots by large vision-language models (LVLMs) is increasingly evident. Therefore, the embodied cognitive abilities of LVLMs based on egocentric videos are of great interest. However, current datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ronghao Dang , Yuqian Yuan , Wenqi Zhang , Yifei Xin , Boqiang Zhang , Long Li , Liuyi Wang , Qinyang Zeng , Xin Li , Lidong Bing

We propose a maturity-based framework for certifying embodied AI systems through explicit measurement mechanisms. We argue that certifiable embodied AI requires structured assessment frameworks, quantitative scoring mechanisms, and methods…

Artificial Intelligence · Computer Science 2026-01-09 Michael C. Darling , Alan H. Hesu , Michael A. Mardikes , Brian C. McGuigan , Reed M. Milewicz

Scientific embodied agents play a crucial role in modern laboratories by automating complex experimental workflows. Compared to typical household environments, laboratory settings impose significantly higher demands on perception of…

Embodied navigation requires an agent to map language and visual observations to a stream of spatial actions that drive a real robot through environments it has never seen. The dominant approach has been to scale vision-language-action…