English
Related papers

Related papers: Beyond Isolation: A Unified Benchmark for General-…

200 papers

Embodied agents are expected to perform object navigation in dynamic, open-world environments. However, existing approaches typically rely on static trajectories and a fixed set of object categories during training, overlooking the…

Robotics · Computer Science 2026-04-07 Ming-Ming Yu , Fei Zhu , Wenzhuo Liu , Yirong Yang , Qunbo Wang , Wenjun Wu , Jing Liu

Existing navigation methods are primarily designed for specific robot embodiments, limiting their generalizability across diverse robot platforms. In this paper, we introduce X-Nav, a novel framework for end-to-end cross-embodiment…

Robotics · Computer Science 2025-11-27 Haitong Wang , Aaron Hao Tan , Angus Fung , Goldie Nejat

Benchmarks are paramount for gauging progress in the domain of Mobile GUI Agents. In practical scenarios, users frequently fail to articulate precise directives containing full task details at the onset, and their expressions are typically…

Embodied AI development significantly lags behind large foundation models due to three critical challenges: (1) lack of systematic understanding of core capabilities needed for Embodied AI, making research lack clear objectives; (2) absence…

Collaboration is a cornerstone of society. In the real world, human teammates make use of multi-sensory data to tackle challenging tasks in ever-changing environments. It is essential for embodied agents collaborating in visually-rich…

Artificial Intelligence · Computer Science 2024-12-09 Qian Long , Zhi Li , Ran Gong , Ying Nian Wu , Demetri Terzopoulos , Xiaofeng Gao

Topological mapping offers a compact and robust representation for navigation, but progress in the field is hindered by the lack of standardized evaluation metrics, datasets, and protocols. Existing systems are assessed using different…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jiaming Wang , Diwen Liu , Jizhuo Chen , Harold Soh

Tabular Foundation Models have recently established the state of the art in supervised tabular learning, by leveraging pretraining to learn generalizable representations of numerical and categorical structured data. However, they lack…

The rise of embodied AI has greatly improved the possibility of general mobile agent systems. At present, many evaluation platforms with rich scenes, high visual fidelity and various application scenarios have been developed. In this paper,…

Robotics · Computer Science 2024-10-30 Haoran Li , Shasha Liu , Mingjun Ma , Guangzheng Hu , Yaran Chen , Dongbin Zhao

Developing autonomous home robots controlled by natural language has long been a pursuit of humanity. While advancements in large language models (LLMs) and embodied intelligence make this goal closer, several challenges persist: the lack…

Robotics · Computer Science 2025-05-16 Dongping Li , Tielong Cai , Tianci Tang , Wenhao Chai , Katherine Rose Driggs-Campbell , Gaoang Wang

Multimodal learning has gained attention for its capacity to integrate information from different modalities. However, it is often hindered by the multimodal imbalance problem, where certain modality dominates while others remain…

Machine Learning · Computer Science 2025-06-16 Shaoxuan Xu , Menglu Cui , Chengxiang Huang , Hongfa Wang , Di Hu

Recent advances in large multimodal models have enabled new opportunities in embodied AI, particularly in robotic manipulation. These models have shown strong potential in generalization and reasoning, but achieving reliable and responsible…

Robotics · Computer Science 2025-12-05 Lei Zhang , Ju Dong , Kaixin Bai , Minheng Ni , Zoltan-Csaba Marton , Zhaopeng Chen , Jianwei Zhang

Learning motion tracking from rich human motion data is a foundational task for achieving general control in humanoid robots, enabling them to perform diverse behaviors. However, discrepancies in morphology and dynamics between humans and…

Robotics · Computer Science 2026-03-02 Yuhan Li , Peiyuan Zhi , Yunshen Wang , Tengyu Liu , Sixu Yan , Wenyu Liu , Xinggang Wang , Baoxiong Jia , Siyuan Huang

The pursuit of general-purpose robotics has yielded impressive foundation models, yet simulation-based benchmarking remains a bottleneck due to rapid performance saturation and a lack of true generalization testing. Existing benchmarks…

A major challenge to deploying robots widely is navigation in human-populated environments, commonly referred to as social robot navigation. While the field of social navigation has advanced tremendously in recent years, the fair evaluation…

Vision-and-Language Navigation (VLN) has been studied mainly in either discrete or continuous settings, with little attention to dynamic, crowded environments. We present HA-VLN 2.0, a unified benchmark introducing explicit social-awareness…

Artificial Intelligence · Computer Science 2025-10-13 Yifei Dong , Fengyi Wu , Qi He , Zhi-Qi Cheng , Heng Li , Minghan Li , Zebang Cheng , Yuxuan Zhou , Jingdong Sun , Qi Dai , Alexander G Hauptmann

The integration of Large Language Models (LLMs) with specialized tools presents new opportunities for intelligent automation systems. However, orchestrating multiple LLM-driven agents to tackle complex tasks remains challenging due to…

Artificial Intelligence · Computer Science 2025-03-27 Pengfei Du

General-purposed embodied agents are designed to understand the users' natural instructions or intentions and act precisely to complete universal tasks. Recently, methods based on foundation models especially Vision-Language-Action models…

The integration of visual understanding and generation into unified multimodal models represents a significant stride toward general-purpose AI. However, a fundamental question remains unanswered by existing benchmarks: does this…

High-fidelity motion tracking serves as the ultimate litmus test for generalizable, human-level motor skills. However, current policies often hit a "generality barrier": as motion libraries scale in diversity, tracking fidelity inevitably…

Recent protocols and metrics for training and evaluating autonomous robot navigation through crowds are inconsistent due to diversified definitions of "social behavior". This makes it difficult, if not impossible, to effectively compare…

Robotics · Computer Science 2022-11-29 Junxian Wang , Wesley P. Chan , Pamela Carreno-Medrano , Akansel Cosgun , Elizabeth Croft