English
Related papers

Related papers: stable-worldmodel: A Platform for Reproducible Wor…

200 papers

The remarkable recent advances in object-centric generative world models raise a few questions. First, while many of the recent achievements are indispensable for making a general and versatile world model, it is quite unclear how these…

Machine Learning · Computer Science 2020-10-06 Zhixuan Lin , Yi-Fu Wu , Skand Peri , Bofeng Fu , Jindong Jiang , Sungjin Ahn

World models - learned internal simulators of environment dynamics - are rapidly becoming foundational to autonomous decision-making in robotics, autonomous vehicles, and agentic AI. By predicting future states in compressed latent spaces,…

Cryptography and Security · Computer Science 2026-04-08 Manoj Parmar

World model-based policy evaluation is a practical proxy for testing real-world robot control by rolling out candidate actions in action-conditioned video diffusion models. As these models increasingly adopt latent diffusion modeling (LDM),…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Nilaksh , Saurav Jha , Artem Zholus , Sarath Chandar

Sensor-driven systems are increasingly ubiquitous: they provide both data and information that can facilitate real-time decision-making and autonomous actuation, as well as enabling informed policy choices by service providers and…

Software Engineering · Computer Science 2019-02-07 Muffy Calder , Simon Dobson , Michael Fisher , Julie McCann

Remote sensing world models aim to both explain observed changes and forecast plausible futures, two tasks that share spatiotemporal priors. Existing methods, however, typically address them separately, limiting cross-task transfer. We…

Artificial Intelligence · Computer Science 2026-03-17 Linrui Xu , Zhongan Wang , Fei Shen , Gang Xu , Huiping Zhuang , Ming Li , Haifeng Li

Reinforcement Learning (RL) has made significant strides in complex tasks but struggles in multi-task settings with different embodiments. World model methods offer scalability by learning a simulation of the environment but often rely on…

Machine Learning · Computer Science 2025-02-25 Ignat Georgiev , Varun Giridhar , Nicklas Hansen , Animesh Garg

Embodied action planning is a core challenge in robotics, requiring models to generate precise actions from visual observations and language instructions. While video generation world models are promising, their reliance on pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yangcheng Yu , Xin Jin , Yu Shang , Xin Zhang , Haisheng Su , Wei Wu , Yong Li

The field of 4D world modeling - aiming to jointly capture spatial geometry and temporal dynamics - has witnessed remarkable progress in recent years, driven by advances in large-scale generative models and multimodal learning. However, the…

Action-conditioned robot world models generate future video frames of the manipulated scene given a robot action sequence, offering a promising alternative for simulating tasks that are difficult to model with traditional physics engines.…

Robotics · Computer Science 2026-03-27 Jai Bardhan , Patrik Drozdik , Josef Sivic , Vladimir Petrik

Embodied AI requires agents that perceive, act, and anticipate how actions reshape future world states. World models serve as internal simulators that capture environment dynamics, enabling forward and counterfactual rollouts to support…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xinqing Li , Xin He , Le Zhang , Min Wu , Xiaoli Li , Yun Liu

Deploying learned control policies in real-world environments poses a fundamental challenge. When system dynamics change unexpectedly, performance degrades until models are retrained on new data. We introduce Reflexive World Models (RWM), a…

Machine Learning · Computer Science 2025-05-22 Carlos Stein Brito , Daniel McNamee

Advancing research in fields such as Simultaneous Localization and Mapping (SLAM) and autonomous navigation critically depends on the availability of reliable and reproducible multimodal datasets. While several influential datasets have…

Training robot policies within a learned world model is trending due to the inefficiency of real-world interactions. The established image-based world models and policies have shown prior success, but lack robust geometric information that…

Robotics · Computer Science 2025-09-18 Guanxing Lu , Baoxiong Jia , Puhao Li , Yixin Chen , Ziwei Wang , Yansong Tang , Siyuan Huang

Current world models lack a unified and controlled setting for systematic evaluation, making it difficult to assess whether they truly capture the underlying rules that govern environment dynamics. In this work, we address this open…

Machine Learning · Computer Science 2025-12-01 Xinyi Li , Zaishuo Xia , Weyl Lu , Chenjie Hao , Yubei Chen

Large Language Models (LLMs) can serve as world models to enhance agent decision-making in digital environments by simulating future states and predicting action outcomes, potentially eliminating costly trial-and-error exploration. However,…

Computation and Language · Computer Science 2026-03-10 Kai Mei , Jiang Guo , Shuaichen Chang , Mingwen Dong , Dongkyu Lee , Xing Niu , Jiarong Jiang

The concept of world models has garnered significant attention due to advancements in multimodal large language models such as GPT-4 and video generation models such as Sora, which are central to the pursuit of artificial general…

What if a world simulation model could render not an imagined environment but a city that actually exists? Prior generative world models synthesize visually plausible yet artificial environments by imagining all content. We present Seoul…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Junyoung Seo , Hyunwook Choi , Minkyung Kwon , Jinhyeok Choi , Siyoon Jin , Gayoung Lee , Junho Kim , JoungBin Lee , Geonmo Gu , Dongyoon Han , Sangdoo Yun , Seungryong Kim , Jin-Hwa Kim

Foundation models and self-supervised learning (SSL) have become central to modern AI, yet research in this area remains hindered by complex codebases, redundant re-implementations, and the heavy engineering burden of scaling experiments.…

Software Engineering · Computer Science 2025-11-26 Randall Balestriero , Hugues Van Assel , Sami BuGhanem , Lucas Maes

Learning predictive world models from raw visual observations is a central challenge in reinforcement learning (RL), especially for robotics and continuous control. Conventional model-based RL frameworks directly condition future…

Robotics · Computer Science 2026-03-13 Jseen Zhang , Gabriel Adineera , Jinzhou Tan , Jinoh Kim