English
Related papers

Related papers: WorldMark: A Unified Benchmark Suite for Interacti…

200 papers

We introduce the WorldScore benchmark, the first unified benchmark for world generation. We decompose world generation into a sequence of next-scene generation tasks with explicit camera trajectory-based layout specifications, enabling…

Graphics · Computer Science 2025-12-02 Haoyi Duan , Hong-Xing Yu , Sirui Chen , Li Fei-Fei , Jiajun Wu

While world models have emerged as a cornerstone of embodied intelligence by enabling agents to reason about environmental dynamics through action-conditioned prediction, their evaluation remains fragmented. Current evaluation of embodied…

Achieving Artificial General Intelligence (AGI) requires agents that learn and interact adaptively, with interactive world models providing scalable environments for perception, reasoning, and action. Yet current research still lacks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jianjie Fang , Yingshan Lei , Qin Wan , Ziyou Wang , Yuchao Huang , Yongyan Xu , Baining Zhao , Weichen Zhang , Chen Gao , Xinlei Chen , Yong Li

Interactive world models are advancing rapidly, yet existing benchmarks cover only part of the required competencies, leaving no unified standard for systematic evaluation. To fill this gap, we introduce WBench, a comprehensive multi-turn…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Kaining Ying , Hengrui Hu , Siyu Ren , Jiamu Li , Fengjiao Chen , Ziwen Wang , Xuezhi Cao , Xunliang Cai , Henghui Ding

Recent advances in creative AI have enabled the synthesis of high-fidelity images and videos conditioned on language instructions. Building on these developments, text-to-video diffusion models have evolved into embodied world models (EWMs)…

Robotics · Computer Science 2025-05-20 Hu Yue , Siyuan Huang , Yue Liao , Shengcong Chen , Pengfei Zhou , Liliang Chen , Maoqing Yao , Guanghui Ren

Video--based world models have emerged along two dominant paradigms: video generation and 3D reconstruction. However, existing evaluation benchmarks either focus narrowly on visual fidelity and text--video alignment for generative models,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Meiqi Wu , Zhixin Cai , Fufangchen Zhao , Xiaokun Feng , Rujing Dang , Bingze Song , Ruitian Tian , Jiashu Zhu , Jiachen Lei , Hao Dou , Jing Tang , Lei Sun , Jiahong Wu , Xiangxiang Chu , Zeming Liu , Kaiqi Huang

Video generation models have rapidly progressed, positioning themselves as video world models capable of supporting decision-making applications like robotics and autonomous driving. However, current benchmarks fail to rigorously evaluate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Dacheng Li , Yunhao Fang , Yukang Chen , Shuo Yang , Shiyi Cao , Justin Wong , Michael Luo , Xiaolong Wang , Hongxu Yin , Joseph E. Gonzalez , Ion Stoica , Song Han , Yao Lu

World Generation Models are emerging as a cornerstone of next-generation multimodal intelligence systems. Unlike traditional 2D visual generation, World Models aim to construct realistic, dynamic, and physically consistent 3D/4D worlds from…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yiting Lu , Wei Luo , Peiyan Tu , Haoran Li , Hanxin Zhu , Zihao Yu , Xingrui Wang , Xinyi Chen , Xinge Peng , Xin Li , Zhibo Chen

World models - generative models that simulate environment dynamics conditioned on past observations and actions - are gaining prominence in planning, simulation, and embodied AI. However, evaluating their rollouts remains a fundamental…

Today's driving world models can generate remarkably realistic dash-cam videos, yet no single model excels universally. Some generate photorealistic textures but violate basic physics; others maintain geometric consistency but fail when…

Video generation models, as one form of world models, have emerged as one of the most exciting frontiers in AI, promising agents the ability to imagine the future by modeling the temporal evolution of complex scenes. In autonomous driving,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yang Zhou , Hao Shao , Letian Wang , Zhuofan Zong , Hongsheng Li , Steven L. Waslander

Video generation models are increasingly used as world simulators for tasks like driving and robotic manipulation. What matters in these settings is not whether a single video looks right, but whether the model's output changes when its…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Kunlin Cai , Rui Song , Jinghuai Zhang , Kaiyuan Zhang , Pranav Bodapati , Alicia Yu , Fnu Suya , Mohammad Rostami , Jiaqi Ma , Yuan Tian

We introduce Matrix-Game, an interactive world foundation model for controllable game world generation. Matrix-Game is trained using a two-stage pipeline that first performs large-scale unlabeled pretraining for environment understanding,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yifan Zhang , Chunli Peng , Boyang Wang , Puyi Wang , Qingcheng Zhu , Fei Kang , Biao Jiang , Zedong Gao , Eric Li , Yang Liu , Yahui Zhou

World models aim to understand, remember, and predict dynamic visual environments, yet a unified benchmark for evaluating their fundamental abilities remains lacking. To address this gap, we introduce MIND, the first open-domain closed-loop…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yixuan Ye , Xuanyu Lu , Yuxin Jiang , Yuchao Gu , Rui Zhao , Qiwei Liang , Jiachun Pan , Fengda Zhang , Weijia Wu , Alex Jinpeng Wang

Generative world models (WMs) can now simulate worlds with striking visual realism, which naturally raises the question of whether they can endow embodied agents with predictive perception for decision making. Progress on this question has…

We introduce WorldSense, the first benchmark to assess the multi-modal video understanding, that simultaneously encompasses visual, audio, and text inputs. In contrast to existing benchmarks, our WorldSense has several features:…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jack Hong , Shilin Yan , Jiayin Cai , Xiaolong Jiang , Yao Hu , Weidi Xie

Recent advances in generative foundational models, often termed "world models," have propelled interest in applying them to critical tasks like robotic planning and autonomous system training. For reliable deployment, these models must…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Rishi Upadhyay , Howard Zhang , Jim Solomon , Ayush Agrawal , Pranay Boreddy , Shruti Satya Narayana , Yunhao Ba , Alex Wong , Celso M de Melo , Achuta Kadambi

Video generation has advanced rapidly, improving evaluation methods, yet assessing video's motion remains a major challenge. Specifically, there are two key issues: 1) current motion metrics do not fully align with human perceptions; 2) the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Xinran Ling , Chen Zhu , Meiqi Wu , Hangyu Li , Xiaokun Feng , Cundian Yang , Aiming Hao , Jiashu Zhu , Jiahong Wu , Xiangxiang Chu

World models play a crucial role in understanding and predicting the dynamics of the world, which is essential for video generation. However, existing world models are confined to specific scenarios such as gaming or driving, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Xiaofeng Wang , Zheng Zhu , Guan Huang , Boyuan Wang , Xinze Chen , Jiwen Lu

World models have emerged as a central paradigm for embodied intelligence, enabling agents to predict action-conditioned future and reason about environmental dynamics. However, existing embodied world model benchmarks are still largely…

‹ Prev 1 2 3 10 Next ›