English
Related papers

Related papers: RoboWM-Bench: A Benchmark for Evaluating World Mod…

200 papers

While video-generation-based embodied world models have gained increasing attention, their reliance on large-scale embodied interaction data remains a key bottleneck. The scarcity, difficulty of collection, and high dimensionality of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Hao Li , Qiao Sun

The development of generalist robot manipulation policies has seen significant progress, driven by large-scale demonstration data across diverse environments. However, the high cost and inefficiency of collecting real-world demonstrations…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Tao Tang , Likui Zhang , Youpeng Wen , Kaidong Zhang , Jia-Wang Bian , xia zhou , Tianyi Yan , Kun Zhan , Peng Jia , Hefeng Wu , Liang Lin , Xiaodan Liang

Vision-Language-Action (VLA) models empower robots to understand and execute tasks described by natural language instructions. However, a key challenge lies in their ability to generalize beyond the specific environments and conditions they…

A world model is an AI system that simulates how an environment evolves under actions, enabling planning through imagined futures rather than reactive perception. Current world models, however, suffer from visual conflation: the mistaken…

Artificial Intelligence · Computer Science 2026-01-23 Zhikang Chen , Tingting Zhu

Embodied world models have emerged as a promising paradigm in robotics, most of which leverage large-scale Internet videos or pretrained video generation models to enrich visual and motion priors. However, they still face key challenges: a…

Robotics · Computer Science 2026-02-04 Yixiang Chen , Peiyan Li , Jiabing Yang , Keji He , Xiangnan Wu , Yuan Xu , Kai Wang , Jing Liu , Nianfeng Liu , Yan Huang , Liang Wang

Developing autonomous home robots controlled by natural language has long been a pursuit of humanity. While advancements in large language models (LLMs) and embodied intelligence make this goal closer, several challenges persist: the lack…

Robotics · Computer Science 2025-05-16 Dongping Li , Tielong Cai , Tianci Tang , Wenhao Chai , Katherine Rose Driggs-Campbell , Gaoang Wang

Current vision-based robotics simulation benchmarks have significantly advanced robotic manipulation research. However, robotics is fundamentally a real-world problem, and evaluation for real-world applications has lagged behind in…

Robotics · Computer Science 2025-08-18 Xuning Yang , Clemens Eppner , Jonathan Tremblay , Dieter Fox , Stan Birchfield , Fabio Ramos

World models are widely explored in embodied intelligence, yet they typically predict distinct evolutions of the world and the ego within a single stream, where the world captures persistent instruction-agnostic scene regularities and the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Zuyao Lin , Jianhui Zhang , Peidong Jia , Xiaoguang Zhao , Shanghang Zhang , Xingyu Chen

World Action Models (WAMs) have recently emerged as a promising paradigm for robotic manipulation by jointly predicting future visual observations and future actions. However, current WAMs typically execute a fixed number of predicted…

Robotics · Computer Science 2026-05-12 Rui Wang , Yue Zhang , Jiehong Lin , Kuncheng Luo , Jianan Wang , Zhongrui Wang , Xiaojuan Qi

Video generation has advanced rapidly, improving evaluation methods, yet assessing video's motion remains a major challenge. Specifically, there are two key issues: 1) current motion metrics do not fully align with human perceptions; 2) the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Xinran Ling , Chen Zhu , Meiqi Wu , Hangyu Li , Xiaokun Feng , Cundian Yang , Aiming Hao , Jiashu Zhu , Jiahong Wu , Xiangxiang Chu

While large vision-language models (VLMs) are increasingly adopted as the perceptual backbone for embodied agents, existing benchmarks often rely on question-answering or multiple-choice formats. These protocols allow models to exploit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Haozhe Shan , Xiancong Ren , Han Dong , Haoyuan Shi , Yingji Zhang , Jiayu Hu , Yi Zhang , Yong Dai , Bin Shen , Lizhen Qu , Zenglin Xu , Xiaozhu Ju

The rapid progress in embodied artificial intelligence has highlighted the necessity for more advanced and integrated models that can perceive, interpret, and predict environmental dynamics. In this context, World Models (WMs) have been…

This paper introduces Amazon Robotic Manipulation Benchmark (ARMBench), a large-scale, object-centric benchmark dataset for robotic manipulation in the context of a warehouse. Automation of operations in modern warehouses requires a robotic…

Robotics · Computer Science 2023-03-30 Chaitanya Mitash , Fan Wang , Shiyang Lu , Vikedo Terhuja , Tyler Garaas , Felipe Polido , Manikantan Nambi

Humanoid robots hold great promise in assisting humans in diverse environments and tasks, due to their flexibility and adaptability leveraging human-like morphology. However, research in humanoid robots is often bottlenecked by the costly…

Robotics · Computer Science 2024-06-21 Carmelo Sferrazza , Dun-Ming Huang , Xingyu Lin , Youngwoon Lee , Pieter Abbeel

Evaluation of robotic manipulation systems has largely relied on fixed benchmarks authored by a small number of experts, where task instances, constraints, and success criteria are predefined and difficult to extend. This paradigm limits…

Robotics · Computer Science 2026-04-08 Yi Ru Wang , Carter Ung , Evan Gubarev , Christopher Tan , Siddhartha Srinivasa , Dieter Fox

Video generation models have emerged as high-fidelity models of the physical world, capable of synthesizing high-quality videos capturing fine-grained interactions between agents and their environments conditioned on multi-modal user…

Multimodal Large Language Models (MLLMs) show promising results as decision-making engines for embodied agents operating in complex, physical environments. However, existing benchmarks often prioritize high-level planning or spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Dayong Liu , Chao Xu , Weihong Chen , Suyu Zhang , Juncheng Wang , Jiankang Deng , Baigui Sun , Yang Liu

Video generation models have rapidly progressed, positioning themselves as video world models capable of supporting decision-making applications like robotics and autonomous driving. However, current benchmarks fail to rigorously evaluate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Dacheng Li , Yunhao Fang , Yukang Chen , Shuo Yang , Shiyi Cao , Justin Wong , Michael Luo , Xiaolong Wang , Hongxu Yin , Joseph E. Gonzalez , Ion Stoica , Song Han , Yao Lu

Driven by the rapid evolution of Vision-Action and Vision-Language-Action models, imitation learning has significantly advanced robotic manipulation capabilities. However, evaluation methodologies have lagged behind, hindering the…

Robotics · Computer Science 2026-01-27 Mengyuan Liu , Juyi Sheng , Peiming Li , Ziyi Wang , Tianming Xu , Tiantian Xu , Hong Liu

Action-conditioned world models are increasingly used as scalable simulators for robot learning, yet current evaluations provide limited evidence that their predictions are reliable under the actions they condition on. Existing benchmarks…

Artificial Intelligence · Computer Science 2026-05-29 Tianzhuo Yang , Zihan Shen , Zirui Mi , Zhaoyi Zhang , Jiayi Zhou , Jiaming Ji , Juntao Dai , Jiawei Chen , Boyuan Chen , Yaodong Yang