English
Related papers

Related papers: World Action Models: The Next Frontier in Embodied…

200 papers

Vision-Language-Action (VLA) models offer a compelling framework for tackling complex robotic manipulation tasks, but they are often expensive to train. In this paper, we propose a novel VLA approach that leverages the competitive…

Robotics · Computer Science 2025-12-23 Max Argus , Jelena Bratulic , Houman Masnavi , Maxim Velikanov , Nick Heppert , Abhinav Valada , Thomas Brox

Scaling Vision-Language-Action (VLA) models on large-scale data offers a promising path to achieving a more generalized driving intelligence. However, VLA models are limited by a ``supervision deficit'': the vast model capacity is…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Yingyan Li , Shuyao Shang , Weisong Liu , Bing Zhan , Haochen Wang , Yuqi Wang , Yuntao Chen , Xiaoman Wang , Yasong An , Chufeng Tang , Lu Hou , Lue Fan , Zhaoxiang Zhang

Generative video models, a leading approach to world modeling, face fundamental limitations. They often violate physical and logical rules, lack interactivity, and operate as opaque black boxes ill-suited for building structured, queryable…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Felix O'Mahony , Roberto Cipolla , Ayush Tewari

Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation, but their reliance on expert demonstrations limits their ability to learn from failures and perform self-corrections. Reinforcement…

Robotics · Computer Science 2025-11-13 Fangqi Zhu , Zhengyang Yan , Zicong Hong , Quanxin Shou , Xiao Ma , Song Guo

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for embodied intelligence, enabling robots to perform tasks based on natural language instructions and current visual input. However, existing VLA models struggle with…

Vision-Language-Action (VLA) models are emerging as a unified substrate for embodied intelligence. This shift raises a new class of safety challenges, stemming from the embodied nature of VLA systems, including irreversible physical…

Robotics · Computer Science 2026-04-28 Qi Li , Bo Yin , Weiqi Huang , Ruhao Liu , Bojun Zou , Runpeng Yu , Jingwen Ye , Weihao Yu , Xinchao Wang

Vision-Language-Action (VLA) models drive next-generation autonomous systems, but training them requires scalable, high-quality annotations from complex environments. Current cloud pipelines rely on generic vision-language models (VLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Kangan Qian , ChuChu Xie , Yang Zhong , Jingrui Pang , Siwen Jiao , Sicong Jiang , Zilin Huang , Yunlong Wang , Kun Jiang , Mengmeng Yang , Hao Ye , Guanghao Zhang , Hangjun Ye , Guang Chen , Long Chen , Diange Yang

Vision-Language-Action (VLA) models have recently enabled embodied agents to perform increasingly complex tasks by jointly reasoning over visual, linguistic, and motor modalities. However, we find that the prevailing notion of…

Machine Learning · Computer Science 2026-03-20 Zhuofan Li , Hongkun Yang , Zhenyang Chen , Yangxuan Chen , Yingyan , Lin , Chaojian Li

Imitation learning has emerged as a promising approach towards building generalist robots. However, scaling imitation learning for large robot foundation models remains challenging due to its reliance on high-quality expert demonstrations.…

Robotics · Computer Science 2025-05-26 Chuning Zhu , Raymond Yu , Siyuan Feng , Benjamin Burchfiel , Paarth Shah , Abhishek Gupta

Vision Language Action models (VLAs) trained with policy-based reinforcement learning (RL) encode complex behaviors without explicitly modeling environmental dynamics. However, it remains unclear whether VLAs implicitly learn world models,…

Machine Learning · Computer Science 2025-09-30 Marco Molinari , Leonardo Nevali , Saharsha Navani , Omar G. Younis

The rapid progress of multimodal large language models (MLLM) has paved the way for Vision-Language-Action (VLA) paradigms, which integrate visual perception, natural language understanding, and control within a single policy. Researchers…

Action-conditioned world models (ACWMs) have shown strong promise for video prediction and decision-making. However, existing benchmarks are largely restricted to egocentric navigation or narrow, task-specific robotics datasets, offering…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Haotian Xue , Yipu Chen , Liqian Ma , Zelin Zhao , Lama Moukheiber , Yuchen Zhu , Yongxin Chen

Recently, world-action models (WAM) have emerged to bridge vision-language-action (VLA) models and world models, unifying their reasoning and instruction-following capabilities and spatio-temporal world modeling. However, existing WAM…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yang Zhou , Xiaofeng Wang , Hao Shao , Letian Wang , Guosheng Zhao , Jiangnan Shao , Jiagang Zhu , Tingdong Yu , Zheng Zhu , Guan Huang , Steven L. Waslander

Learning latent actions from action-free video has emerged as a powerful paradigm for scaling up controllable world model learning. Latent actions provide a natural interface for users to iteratively generate and manipulate videos. However,…

Machine Learning · Computer Science 2026-05-26 Zizhao Wang , Chang Shi , Jiaheng Hu , Kevin Rohling , Roberto Martín-Martín , Amy Zhang , Peter Stone

Vision-Language-Action (VLA) models frequently encounter challenges in generalizing to real-world environments due to inherent discrepancies between observation and action spaces. Although training data are collected from diverse camera…

Robotics · Computer Science 2025-08-19 Tianyi Zhang , Haonan Duan , Haoran Hao , Yu Qiao , Jifeng Dai , Zhi Hou

While Vision-Language-Action (VLA) models show strong promise for generalist robot control, it remains unclear whether -- and under what conditions -- the standard "scale data" recipe translates to robotics, where training data is…

While Vision-Language-Action (VLA) models have achieved remarkable success in ground-based embodied intelligence, their application to Aerial Manipulation Systems (AMS) remains a largely unexplored frontier. The inherent characteristics of…

Robotics · Computer Science 2026-02-04 Jianli Sun , Bin Tian , Qiyao Zhang , Chengxiang Li , Zihan Song , Zhiyong Cui , Yisheng Lv , Yonglin Tian

Recent studies on Vision-Language-Action (VLA) models have shifted from the end-to-end action-generation paradigm toward a pipeline involving task planning followed by action generation, demonstrating improved performance on various…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Chongkai Gao , Zixuan Liu , Zhenghao Chi , Junshan Huang , Xin Fei , Yiwen Hou , Yuxuan Zhang , Yudi Lin , Zhirui Fang , Zeyu Jiang , Lin Shao

Recent advancements in vision-language-action (VLA) models have shown promise in robotic manipulation, yet they continue to struggle with long-horizon, multi-step tasks. Existing methods lack internal reasoning mechanisms that can identify…

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability to deduce physical…