English
Related papers

Related papers: LiveWorld: Simulating Out-of-Sight Dynamics in Gen…

200 papers

World models have recently gained prominence for action-conditioned visual prediction in complex environments. However, relying on only a few recent observations causes them to lose long-term context. Consequently, within a few steps, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Nedko Savov , Naser Kazemi , Deheng Zhang , Danda Pani Paudel , Xi Wang , Luc Van Gool

The field of 4D world modeling - aiming to jointly capture spatial geometry and temporal dynamics - has witnessed remarkable progress in recent years, driven by advances in large-scale generative models and multimodal learning. However, the…

Recent advancements in video generation have witnessed significant progress, especially with the rapid advancement of diffusion models. Despite this, their deficiencies in physical cognition have gradually received widespread attention -…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Minghui Lin , Xiang Wang , Yishan Wang , Shu Wang , Fengqi Dai , Pengxiang Ding , Cunxiang Wang , Zhengrong Zuo , Nong Sang , Siteng Huang , Donglin Wang

Embodied navigation in open, dynamic environments demands accurate foresight of how the world will evolve and how actions will unfold over time. We propose AstraNav-World, an end-to-end world model that jointly reasons about future visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jintao Chen , Junjun Hu , Haochen Bai , Minghua Luo , Xinda Xue , Botao Ren , Chengyu Bai , Shichao Xie , Ziyi Chen , Fei Liu , Zedong Chu , Xiaolong Wu , Mu Xu , Shanghang Zhang

This paper presents WorldPlay, a streaming video diffusion model that enables real-time, interactive world modeling with long-term geometric consistency, resolving the trade-off between speed and memory that limits current methods.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Wenqiang Sun , Haiyu Zhang , Haoyuan Wang , Junta Wu , Zehan Wang , Zhenwei Wang , Yunhong Wang , Jun Zhang , Tengfei Wang , Chunchao Guo

World models aim to learn action-controlled future prediction and have proven essential for the development of intelligent agents. However, most existing world models rely heavily on substantial action-labeled data and costly training,…

Artificial Intelligence · Computer Science 2025-06-03 Shenyuan Gao , Siyuan Zhou , Yilun Du , Jun Zhang , Chuang Gan

Recent advancements in video generation have substantially improved visual quality and temporal coherence, making these models increasingly appealing for applications such as autonomous driving, particularly in the context of driving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Chun-Peng Chang , Chen-Yu Wang , Julian Schmidt , Holger Caesar , Alain Pagani

World models play a crucial role in understanding and predicting the dynamics of the world, which is essential for video generation. However, existing world models are confined to specific scenarios such as gaming or driving, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Xiaofeng Wang , Zheng Zhu , Guan Huang , Boyuan Wang , Xinze Chen , Jiwen Lu

Video generation models have emerged as high-fidelity models of the physical world, capable of synthesizing high-quality videos capturing fine-grained interactions between agents and their environments conditioned on multi-modal user…

Building world models with spatial consistency and real-time interactivity remains a fundamental challenge in computer vision. Current video generation paradigms often struggle with a lack of spatial persistence and insufficient visual…

Learning predictive world models from visual observations is a core problem in embodied AI, with applications to model-based reinforcement learning and robotic planning. Existing latent world models typically generate future states with…

Machine Learning · Computer Science 2026-05-12 Qixin Xiao , Maani Ghaffari

World Generation Models are emerging as a cornerstone of next-generation multimodal intelligence systems. Unlike traditional 2D visual generation, World Models aim to construct realistic, dynamic, and physically consistent 3D/4D worlds from…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yiting Lu , Wei Luo , Peiyan Tu , Haoran Li , Hanxin Zhu , Zihao Yu , Xingrui Wang , Xinyi Chen , Xinge Peng , Xin Li , Zhibo Chen

World models have become a central paradigm for learning predictive simulators that support generation, planning, and decision-making. Yet, despite rapid progress in industry-scale interactive video generation, the broader research…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Siqiao Huang , Partha Kaushik , Michael Chen , Hengkai Pan , Kaiwen Geng , Omar Chehab , Fernando Moreno-Pino , Max Simchowitz

World simulators can provide safe and scalable environments for training Physical AI systems before real-world deployment. Large video generation models are emerging as a promising basis for such simulators because they can generate diverse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Pu Zhao , Juyi Lin , Timothy Rupprecht , Arash Akbari , Chence Yang , Rahul Chowdhury , Elaheh Motamedi , Arman Akbari , Yumei He , Chen Wang , Geng Yuan , Weiwei Chen , Yanzhi Wang

World modeling is a crucial task for enabling intelligent agents to effectively interact with humans and operate in dynamic environments. In this work, we propose MineWorld, a real-time interactive world model on Minecraft, an open-ended…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Junliang Guo , Yang Ye , Tianyu He , Haoyu Wu , Yushu Jiang , Tim Pearce , Jiang Bian

We present a data-driven approach for 4D space-time visualization of dynamic events from videos captured by hand-held multiple cameras. Key to our approach is the use of self-supervised neural networks specific to the scene to compose…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Aayush Bansal , Minh Vo , Yaser Sheikh , Deva Ramanan , Srinivasa Narasimhan

Embodied world models aim to predict and interact with the physical world through visual observations and actions. However, existing models struggle to accurately translate low-level actions (e.g., joint positions) into precise robotic…

Robotics · Computer Science 2026-04-01 Taiyi Su , Jian Zhu , Yaxuan Li , Chong Ma , Jianjun Zhang , Zitai Huang , Hanli Wang , Yi Xu

Scalable and reliable evaluation is increasingly critical in the end-to-end era of autonomous driving, where vision--language--action (VLA) policies directly map raw sensor streams to driving actions. Yet, current evaluation pipelines still…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Chaoda Zheng , Sean Li , Jinhao Deng , Zhennan Wang , Shijia Chen , Liqiang Xiao , Ziheng Chi , Hongbin Lin , Kangjie Chen , Boyang Wang , Yu Zhang , Xianming Liu

We present LingBot-World, an open-sourced world simulator stemming from video generation. Positioned as a top-tier world model, LingBot-World offers the following features. (1) It maintains high fidelity and robust dynamics in a broad…

Generative world models are reshaping embodied AI, enabling agents to synthesize realistic 4D driving environments that look convincing but often fail physically or behaviorally. Despite rapid progress, the field still lacks a unified way…