English
Related papers

Related papers: RotVLA: Rotational Latent Action for Vision-Langua…

200 papers

Improving embodied reasoning in multimodal-large-language models (MLLMs) is essential for building vision-language-action models (VLAs) on top of them to readily translate multimodal understanding into low-level actions. Accordingly, recent…

Artificial Intelligence · Computer Science 2026-03-24 Dongyoung Kim , Sumin Park , Woomin Song , Seungku Kim , Taeyoung Kim , Huiwon Jang , Jinwoo Shin , Jaehyung Kim , Younggyo Seo

Vision-language-action (VLA) models have emerged as generalist robotic controllers capable of mapping visual observations and natural language instructions to continuous action sequences. However, VLAs provide no calibrated measure of…

Robotics · Computer Science 2026-04-21 Lingling Chen , Zongyao Lyu , William J. Beksi

Vision-Language-Action (VLA) models mark a transformative advancement in artificial intelligence, aiming to unify perception, natural language understanding, and embodied action within a single computational framework. This foundational…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Ranjan Sapkota , Yang Cao , Konstantinos I. Roumeliotis , Manoj Karkee

Recent advances in vision-language-action (VLA) models have motivated the extension of their capabilities to embodied settings, where reinforcement learning (RL) offers a principled way to optimize task success through interaction. However,…

Vision Language Action (VLA) models represent a transformative shift in robotics, with the aim of unifying visual perception, natural language understanding, and embodied control within a single learning framework. This review presents a…

Robotics · Computer Science 2026-01-21 Muhayy Ud Din , Waseem Akram , Lyes Saad Saoud , Jan Rosell , Irfan Hussain

Fine-tuning vision-language models (VLMs) on robot teleoperation data to create vision-language-action (VLA) models is a promising paradigm for training generalist policies, but it suffers from a fundamental tradeoff: learning to produce…

Robotics · Computer Science 2025-09-29 Asher J. Hancock , Xindi Wu , Lihan Zha , Olga Russakovsky , Anirudha Majumdar

Vision-language-action (VLA) models have demonstrated exceptional performance in natural language-driven perception and control. However, the high computational cost of VLA models poses significant efficiency challenges, particularly for…

Vision-Language-Action (VLA) models unify perception, reasoning, and control within a single policy, yet their multi-billion-parameter backbones and diffusion-based action heads make on-device deployment prohibitively expensive. Prior…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Xinyu Wang , Mingze Li , Sicheng Lyu , Dongxiu Liu , Kaicheng Yang , Ziyu Zhao , Yufei Cui , Xiao-Wen Chang , Peng Lu

Vision-language-action (VLA) models have advanced the field of embodied manipulation by harnessing broad world knowledge and strong generalization. However, current VLA models still face several key challenges, including limited reasoning…

Robotics · Computer Science 2026-05-29 Wenhao Li , Xiu Su , Dan Niu , Yichao Cao , Hongyan Xu , Zhe Qu , Lei Fan , Shan You , Chang Xu

Manipulating dynamic objects remains an open challenge for Vision-Language-Action (VLA) models, which, despite strong generalization in static manipulation, struggle in dynamic scenarios requiring rapid perception, temporal anticipation,…

Robotics · Computer Science 2026-01-30 Haozhe Xie , Beichen Wen , Jiarui Zheng , Zhaoxi Chen , Fangzhou Hong , Haiwen Diao , Ziwei Liu

Recent vision-language-action (VLA) models built on pretrained vision-language models (VLMs) have demonstrated strong performance in robotic manipulation. However, these models remain constrained by the single-frame image paradigm and fail…

Robotics · Computer Science 2025-10-31 Hao Li , Shuai Yang , Yilun Chen , Xinyi Chen , Xiaoda Yang , Yang Tian , Hanqing Wang , Tai Wang , Dahua Lin , Feng Zhao , Jiangmiao Pang

Vision-Language-Action (VLA) models have emerged as a promising paradigm for general-purpose robotic manipulation, leveraging large-scale pre-training to achieve strong performance. The field has rapidly evolved with additional spatial…

Robotics · Computer Science 2026-02-23 Yuankai Luo , Woping Chen , Tong Liang , Baiqiao Wang , Zhenguo Li

Existing robotic foundation models, while powerful, are predicated on an implicit assumption of temporal homogeneity: treating all actions as equally informative during optimization. This "flat" training paradigm, inherited from language…

Robotics · Computer Science 2026-05-29 Daojie Peng , Fulong Ma , Jiahang Cao , Qiang Zhang , Xupeng Xie , Jian Guo , Ping Luo , Andrew F. Luo , Boyu Zhou , Jun Ma

Developing robust and general-purpose manipulation policies represents a fundamental objective in robotics research. While Vision-Language-Action (VLA) models have demonstrated promising capabilities for end-to-end robot control, existing…

Visual-Language-Action models (VLAs) have advanced generalist robot control by mapping multimodal observations and language instructions directly to actions, but sparse action supervision often encourages shortcut mappings rather than…

Robotics · Computer Science 2026-05-04 Hao Luo , Wanpeng Zhang , Yicheng Feng , Sipeng Zheng , Haiweng Xu , Chaoyi Xu , Ziheng Xi , Yuhui Fu , Zongqing Lu

This paper tackles spatial perception and manipulation challenges in Vision-Language-Action (VLA) models. To address depth ambiguity from monocular input, we leverage a pre-trained multi-view diffusion model to synthesize latent novel views…

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for general-purpose robot control through natural language instructions. However, their high inference cost-stemming from large-scale token computation and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xudong Tan , Yaoxin Yang , Peng Ye , Jialin Zheng , Bizhe Bai , Xinyi Wang , Jia Hao , Tao Chen

Reasoning Vision Language Action (VLA) models improve robotic instruction-following by generating step-by-step textual plans before low-level actions, an approach inspired by Chain-of-Thought (CoT) reasoning in language models. Yet even…

Robotics · Computer Science 2026-01-15 Yilin Wu , Anqi Li , Tucker Hermans , Fabio Ramos , Andrea Bajcsy , Claudia Pérez-D'Arpino

Large-scale pretraining has made Vision-Language-Action (VLA) models promising foundations for generalist robot manipulation, yet adapting them to downstream tasks remains necessary. However, the common practice of full fine-tuning treats…

Robotics · Computer Science 2026-05-12 Xinyu Guo , Bin Xie , Wei Chai , Xianchi Deng , Tiancai Wang , Zhengxing Wu , Xingyu Chen

Long-horizon robotic manipulation requires bridging the gap between high-level planning (System 2) and low-level control (System 1). Current Vision-Language-Action (VLA) models often entangle these processes, performing redundant multimodal…

Robotics · Computer Science 2026-02-10 Tongqing Chen , Hang Wu , Jiasen Wang , Xiaotao Li , Lu Fang