English
Related papers

Related papers: Beyond Isolation: A Unified Benchmark for General-…

200 papers

Traditional fixed test sets fall short in evaluating open-ended capabilities of foundation models. To address this, we propose ONEBench(OpeN-Ended Benchmarking), a new testing paradigm that consolidates individual evaluation datasets into a…

Machine Learning · Computer Science 2025-06-18 Adhiraj Ghosh , Sebastian Dziadzio , Ameya Prabhu , Vishaal Udandarao , Samuel Albanie , Matthias Bethge

Machine learning on graphs has made substantial progress across domains such as molecular property prediction and chip design. Yet benchmarking practices remain fragmented, often relying on narrow, task-specific datasets and inconsistent…

Human-robot collaboration, in which the robot intelligently assists the human with the upcoming task, is an appealing objective. To achieve this goal, the agent needs to be equipped with a fundamental collaborative navigation ability, where…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Changhao Li , Xinyu Sun , Peihao Chen , Jugang Fan , Zixu Wang , Yanxia Liu , Jinhui Zhu , Chuang Gan , Mingkui Tan

In this paper, we introduce OSUniverse: a benchmark of complex, multimodal desktop-oriented tasks for advanced GUI-navigation AI agents that focuses on ease of use, extensibility, comprehensive coverage of test cases, and automated…

Artificial Intelligence · Computer Science 2025-05-07 Mariya Davydova , Daniel Jeffries , Patrick Barker , Arturo Márquez Flores , Sinéad Ryan

The emergence of Large Language Models (LLMs) has illuminated the potential for a general-purpose user simulator. However, existing benchmarks remain constrained to isolated scenarios, narrow action spaces, or synthetic data, failing to…

Computation and Language · Computer Science 2026-05-22 Jiawei Chen , Ruoxi Xu , Boxi Cao , Ruotong Pan , Yunfei Zhang , Yifei Hu , Yong Du , Tingting Gao , Yaojie Lu , Yingfei Sun , Xianpei Han , Le Sun , Xiangyu Wu , Hongyu Lin

Instruction-following navigation is a key step toward embodied intelligence. Prior benchmarks mainly focus on semantic understanding but overlook systematically evaluating navigation agents' spatial perception and reasoning capabilities. In…

Despite the growing popularity of Multimodal Domain Generalization (MMDG) for enhancing model robustness, it remains unclear whether reported performance gains reflect genuine algorithmic progress or are artifacts of inconsistent evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Hao Dong , Hongzhao Li , Shupan Li , Muhammad Haris Khan , Eleni Chatzi , Olga Fink

In this paper, we propose a real-world benchmark for studying robotic learning in the context of functional manipulation: a robot needs to accomplish complex long-horizon behaviors by composing individual manipulation skills in functionally…

Robotics · Computer Science 2024-09-04 Jianlan Luo , Charles Xu , Fangchen Liu , Liam Tan , Zipeng Lin , Jeffrey Wu , Pieter Abbeel , Sergey Levine

The realization of Artificial General Intelligence (AGI) necessitates Embodied AI agents capable of robust spatial perception, effective task planning, and adaptive execution in physical environments. However, current large language models…

While Visual Large Language Models (VLLMs) show great promise as embodied agents, they continue to face substantial challenges in spatial reasoning. Existing embodied benchmarks largely focus on passive, static household environments and…

Robotics · Computer Science 2025-11-24 Yifan Li , Lichi Li , Anh Dao , Xinyu Zhou , Yicheng Qiao , Zheda Mai , Daeun Lee , Zichen Chen , Zhen Tan , Mohit Bansal , Yu Kong

Embodied navigation (EN) advances traditional navigation by enabling robots to perform complex egocentric tasks through sensing, social, and motion intelligence. In contrast to classic methodologies that rely on explicit localization and…

Robotics · Computer Science 2025-08-22 Chaoran Xiong , Yulong Huang , Fangwen Yu , Changhao Chen , Yue Wang , Songpengchen Xia , Ling Pei

Generalizing local navigation policies across diverse robot morphologies is a critical challenge. Progress is often hindered by the need for costly and embodiment-specific data, the tight coupling of planning and control, and the…

Robotics · Computer Science 2025-10-24 Kai Yang , Tianlin Zhang , Zhengbo Wang , Zedong Chu , Xiaolong Wu , Yang Cai , Mu Xu

Generalizing language-conditioned robotic policies to new tasks remains a significant challenge, hampered by the lack of suitable simulation benchmarks. In this paper, we address this gap by introducing GemBench, a novel benchmark to assess…

Robotics · Computer Science 2025-03-04 Ricardo Garcia , Shizhe Chen , Cordelia Schmid

Vision-and-Language Navigation (VLN) empowers agents to associate time-sequenced visual observations with corresponding instructions to make sequential decisions. However, generalization remains a persistent challenge, particularly when…

Robotics · Computer Science 2025-02-27 Zerui Li , Gengze Zhou , Haodong Hong , Yanyan Shao , Wenqi Lyu , Yanyuan Qiao , Qi Wu

Imitation learning benchmarks often lack sufficient variation between training and evaluation, limiting meaningful generalisation assessment. We introduce Labyrinth, a benchmarking environment designed to test generalisation with precise…

Machine Learning · Computer Science 2025-09-30 Nathan Gavenski , Odinaldo Rodrigues

Vision-Language-Action (VLA) models have emerged as a generalist robotic agent. However, existing VLAs are hindered by excessive parameter scales, prohibitive pre-training requirements, and limited applicability to diverse embodiments. To…

Recent advances in robotics and large language models (LLMs) have sparked growing interest in human-robot collaboration and embodied intelligence. To enable the broader deployment of robots in human-populated environments, socially-aware…

Robotics · Computer Science 2025-03-14 Weizheng Wang , Ike Obi , Byung-Cheol Min

Using intelligent systems to perceive psychological and social behaviors, that is, the underlying affective, cognitive, and pathological states that are manifested through observable behaviors and social interactions, remains a challenge…

Artificial Intelligence · Computer Science 2026-02-13 Keane Ong , Wei Dai , Carol Li , Dewei Feng , Hengzhi Li , Jingyao Wu , Jiaee Cheong , Rui Mao , Gianmarco Mengaldo , Erik Cambria , Paul Pu Liang

Building embodied agents capable of accomplishing arbitrary tasks is a core objective towards achieving embodied artificial general intelligence (E-AGI). While recent work has advanced such general robot policies, their training and…

Robotics · Computer Science 2025-07-30 Liu Dai , Haina Wang , Weikang Wan , Hao Su

Language-guided navigation is a cornerstone of embodied AI, enabling agents to interpret language instructions and navigate complex environments. However, expert-provided instructions are limited in quantity, while synthesized annotations…

Artificial Intelligence · Computer Science 2025-08-11 Zongtao He , Liuyi Wang , Lu Chen , Chengju Liu , Qijun Chen