English
Related papers

Related papers: Is the Future Compatible? Diagnosing Dynamic Consi…

200 papers

World Action Models (WAMs) have recently emerged as a promising paradigm for robotic manipulation by jointly predicting future visual observations and future actions. However, current WAMs typically execute a fixed number of predicted…

Robotics · Computer Science 2026-05-12 Rui Wang , Yue Zhang , Jiehong Lin , Kuncheng Luo , Jianan Wang , Zhongrui Wang , Xiaojuan Qi

A plausible scene evolution depends on the maneuver being considered, while a good maneuver depends on how the scene may evolve. Existing World Action Models (WAMs) largely miss this reciprocity, treating world prediction and action…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Hongbo Lu , Liang Yao , Chenghao He , Haoyu Wang , Xiang Gu , Xianfei Li , Wenlong Liao , Tao He , Pai Peng

General-purpose world models promise scalable policy evaluation, optimization, and planning, yet achieving the required level of robustness remains challenging. Unlike policy learning, which primarily focuses on optimal actions, a world…

Machine Learning · Computer Science 2026-04-03 Yuejiang Liu , Fan Feng , Lingjing Kong , Weifeng Lu , Jinzhou Tang , Kun Zhang , Kevin Murphy , Chelsea Finn , Yilun Du

World Action Models (WAMs) have emerged as a promising alternative to Vision-Language-Action (VLA) models for embodied control because they explicitly model how visual observations may evolve under action. Most existing WAMs follow an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Tianyuan Yuan , Zibin Dong , Yicheng Liu , Hang Zhao

World Action Models (WAMs) have emerged as a promising paradigm for robot control by modeling physical dynamics. Current WAMs generally follow two paradigms: the "Imagine-then-Execute" approach, which uses video prediction to infer actions…

World-Action Models (WAM) initialized from pre-trained video generation backbones have demonstrated remarkable potential for robot policy learning. However, existing approaches face two critical bottlenecks that hinder performance and…

Robot action planning in the real world is challenging as it requires not only understanding the current state of the environment but also predicting how it will evolve in response to actions. Vision-language-action (VLA), which repurpose…

World models enable planning in imagined future predicted space, offering a promising framework for embodied navigation. However, existing navigation world models often lack action-conditioned consistency, so visually plausible predictions…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Han Yan , Zishang Xiang , Zeyu Zhang , Hao Tang

This paper presents the World-Action Model (WAM), an action-regularized world model that jointly reasons over future visual observations and the actions that drive state transitions. Unlike conventional world models trained solely via image…

Artificial Intelligence · Computer Science 2026-04-01 Yuci Han , Alper Yilmaz

A world model is an AI system that simulates how an environment evolves under actions, enabling planning through imagined futures rather than reactive perception. Current world models, however, suffer from visual conflation: the mistaken…

Artificial Intelligence · Computer Science 2026-01-23 Zhikang Chen , Tingting Zhu

Learning predictive world models from visual observations is a core problem in embodied AI, with applications to model-based reinforcement learning and robotic planning. Existing latent world models typically generate future states with…

Machine Learning · Computer Science 2026-05-12 Qixin Xiao , Maani Ghaffari

World Action Models (WAMs) enhance Vision-Language-Action policies by jointly predicting scene evolution and robot actions, but existing methods usually represent the predicted world as holistic images, video tokens, or global latents.…

Action-conditioned video prediction models (often referred to as world models) have shown strong potential for robotics applications, but existing approaches are often slow and struggle to capture physically consistent interactions over…

World models (WMs) are intended to serve as internal simulators of the real world that enable agents to understand, anticipate, and act upon complex environments. Existing WM benchmarks remain narrowly focused on next-state prediction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 PAN Team , Qiyue Gao , Kun Zhou , Jiannan Xiang , Zihan Liu , Dequan Yang , Junrong Chen , Arif Ahmad , Cong Zeng , Ganesh Bannur , Xinqi Huang , Zheqi Liu , Yi Gu , Yichi Yang , Guangyi Liu , Zhiting Hu , Zhengzhong Liu , Eric Xing

Action-conditioned robot world models generate future video frames of the manipulated scene given a robot action sequence, offering a promising alternative for simulating tasks that are difficult to model with traditional physics engines.…

Robotics · Computer Science 2026-03-27 Jai Bardhan , Patrik Drozdik , Josef Sivic , Vladimir Petrik

World models enable agents to plan by imagining future states, but existing approaches operate from a single viewpoint, typically egocentric, even when other perspectives would make planning easier; navigation, for instance, benefits from a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Rishabh Sharma , Gijs Hogervorst , Wayne E. Mackey , David J. Heeger , Stefano Martiniani

Training robot policies within a learned world model is trending due to the inefficiency of real-world interactions. The established image-based world models and policies have shown prior success, but lack robust geometric information that…

Robotics · Computer Science 2025-09-18 Guanxing Lu , Baoxiong Jia , Puhao Li , Yixin Chen , Ziwei Wang , Yansong Tang , Siyuan Huang

Vision-Language-Action (VLA) models have achieved strong semantic generalization for embodied policy learning, yet they learn reactive observation-to-action mappings without explicitly modeling how the physical world evolves under…

Action-conditioned world models are increasingly used as scalable simulators for robot learning, yet current evaluations provide limited evidence that their predictions are reliable under the actions they condition on. Existing benchmarks…

Artificial Intelligence · Computer Science 2026-05-29 Tianzhuo Yang , Zihan Shen , Zirui Mi , Zhaoyi Zhang , Jiayi Zhou , Jiaming Ji , Juntao Dai , Jiawei Chen , Boyuan Chen , Yaodong Yang

The rapid progress in embodied artificial intelligence has highlighted the necessity for more advanced and integrated models that can perceive, interpret, and predict environmental dynamics. In this context, World Models (WMs) have been…

‹ Prev 1 2 3 10 Next ›