English
Related papers

Related papers: World Action Verifier: Self-Improving World Models…

200 papers

Various world model frameworks are being developed today based on autoregressive frameworks that rely on discrete representations of actions and observations, and these frameworks are succeeding in constructing interactive generative models…

Machine Learning · Computer Science 2025-03-14 Kohei Hayashi , Masanori Koyama , Julian Jorge Andrade Guerreiro

Generative world models (WMs) can now simulate worlds with striking visual realism, which naturally raises the question of whether they can endow embodied agents with predictive perception for decision making. Progress on this question has…

World models enable agents to plan by imagining future states, but existing approaches operate from a single viewpoint, typically egocentric, even when other perspectives would make planning easier; navigation, for instance, benefits from a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Rishabh Sharma , Gijs Hogervorst , Wayne E. Mackey , David J. Heeger , Stefano Martiniani

Action-conditioned video prediction models (often referred to as world models) have shown strong potential for robotics applications, but existing approaches are often slow and struggle to capture physically consistent interactions over…

We propose X-WAM, a Unified 4D World Model that unifies real-time robotic action execution and high-fidelity 4D world synthesis (video + 3D reconstruction) in a single framework, addressing the critical limitations of prior unified world…

Robotics · Computer Science 2026-05-08 Jun Guo , Qiwei Li , Peiyan Li , Zilong Chen , Nan Sun , Yifei Su , Heyun Wang , Yuan Zhang , Xinghang Li , Huaping Liu

The rapid progress in embodied artificial intelligence has highlighted the necessity for more advanced and integrated models that can perceive, interpret, and predict environmental dynamics. In this context, World Models (WMs) have been…

Robotic manipulation requires anticipating how the environment evolves in response to actions, yet most existing systems lack this predictive capability, often resulting in errors and inefficiency. While Vision-Language Models (VLMs)…

Robotics · Computer Science 2026-02-12 Songen Gu , Yunuo Cai , Tianyu Wang , Simo Wu , Yanwei Fu

World action models (WAMs) have emerged as a promising direction for robot policy learning, as they can leverage powerful video backbones to model the future states. However, existing approaches often rely on separate action modules, or use…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Haoyu Zhen , Zixian Gao , Qiao Sun , Yilin Zhao , Yuncong Yang , Yilun Du , Pengsheng Guo , Tsun-Hsuan Wang , Yi-Ling Qiao , Chuang Gan

State-of-the-art Vision-Language-Action (VLA) models excel at semantic generalization but struggle to generalize to unseen physical motions in novel environments. We introduce DreamZero, a World Action Model (WAM) built upon a pretrained…

Safe offline reinforcement learning aims to learn policies that maximize cumulative rewards while adhering to safety constraints, using only offline data for training. A key challenge is balancing safety and performance, particularly when…

Machine Learning · Computer Science 2024-12-13 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

Differentiable simulators represent an environment's dynamics as a differentiable function. Within robotics and autonomous driving, this property is used in Analytic Policy Gradients (APG), which relies on backpropagating through the…

Artificial Intelligence · Computer Science 2025-11-14 Asen Nachkov , Danda Pani Paudel , Jan-Nico Zaech , Davide Scaramuzza , Luc Van Gool

In recent years, Model-based Multi-Agent Reinforcement Learning (MARL) has demonstrated significant advantages over model-free methods in terms of sample efficiency by using independent environment dynamics world models for data sample…

Multiagent Systems · Computer Science 2025-01-20 Zifeng Shi , Meiqin Liu , Senlin Zhang , Ronghao Zheng , Shanling Dong , Ping Wei

Scaling Vision-Language-Action (VLA) models on large-scale data offers a promising path to achieving a more generalized driving intelligence. However, VLA models are limited by a ``supervision deficit'': the vast model capacity is…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Yingyan Li , Shuyao Shang , Weisong Liu , Bing Zhan , Haochen Wang , Yuqi Wang , Yuntao Chen , Xiaoman Wang , Yasong An , Chufeng Tang , Lu Hou , Lue Fan , Zhaoxiang Zhang

We present the Multi-Agent Transformer World Model (MATWM), a novel transformer-based world model designed for multi-agent reinforcement learning in both vector- and image-based environments. MATWM combines a decentralized imagination…

Machine Learning · Computer Science 2025-06-24 Azad Deihim , Eduardo Alonso , Dimitra Apostolopoulou

A surgical world model capable of generating realistic surgical action videos with precise control over tool-tissue interactions can address fundamental challenges in surgical AI and simulation -- from data scarcity and rare event synthesis…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Sampath Rapuri , Lalithkumar Seenivasan , Dominik Schneider , Roger Soberanis-Mukul , Yufan He , Hao Ding , Jiru Xu , Chenhao Yu , Chenyan Jing , Pengfei Guo , Daguang Xu , Mathias Unberath

Post-training is essential for turning pretrained generalist robot policies into reliable task-specific controllers, but existing human-in-the-loop pipelines remain tied to physical execution: each correction requires robot time, scene…

Robotics · Computer Science 2026-05-06 Yaxuan Li , Zhongyi Zhou , Yefei Chen , Yanjiang Guo , Jiaming Liu , Shanghang Zhang , Jianyu Chen , Yichen Zhu

World Action Models (WAMs) improve robot manipulation by using video-based future representations to condition action generation. In pixel-space WAMs, however, the best action condition is not necessarily the fully denoised video.…

Robotics · Computer Science 2026-05-28 Yirui Sun , Guangyu Zhuge , Keliang Liu , Jie Gu , Xinyu Bing , Zhongxue Gan , Chunxu Tian

Internal modelling of the world -- predicting transitions between previous states $X$ and next states $Y$ under actions $Z$ -- is essential to reasoning and planning for LLMs and VLMs. Learning such models typically requires costly…

Machine Learning · Computer Science 2026-02-17 Yifu Qiu , Zheng Zhao , Waylon Li , Yftah Ziser , Anna Korhonen , Shay B. Cohen , Edoardo M. Ponti

Evaluating robot control policies is difficult: real-world testing is costly, and handcrafted simulators require manual effort to improve in realism and generality. We propose a world-model-based policy evaluation environment (WorldGym), an…

Robotics · Computer Science 2025-10-01 Julian Quevedo , Ansh Kumar Sharma , Yixiang Sun , Varad Suryavanshi , Percy Liang , Sherry Yang

World models have been emerging as critical components for assessing the consequences of actions generated by interactive agents in online planning and offline evaluation. In text-based environments, world models are typically evaluated and…