English
Related papers

Related papers: ActionCodec: What Makes for Good Action Tokenizers

200 papers

Vision-Language-Action (VLA) tasks require reasoning over complex visual scenes and executing adaptive actions in dynamic environments. While recent studies on reasoning VLAs show that explicit chain-of-thought (CoT) can improve…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Chi-Pin Huang , Yunze Man , Zhiding Yu , Min-Hung Chen , Jan Kautz , Yu-Chiang Frank Wang , Fu-En Yang

The Vision-Language-Action models (VLA) have achieved significant advances in robotic manipulation recently. However, vision-only VLA models create fundamental limitations, particularly in perceiving interactive and manipulation dynamic…

Robotics · Computer Science 2025-11-14 Xiangyi Wei , Haotian Zhang , Xinyi Cao , Siyu Xie , Weifeng Ge , Yang Li , Changbo Wang

Vision-Language-Action (VLA) models have emerged as a powerful paradigm in Embodied AI. However, the significant computational overhead of processing redundant visual tokens remains a critical bottleneck for real-time robotic deployment.…

Robotics · Computer Science 2025-11-25 Juntao Gao , Feiyang Ye , Jing Zhang , Wenjing Qian

The rapid advancement of generative AI and multi-modal foundation models has shown significant potential in advancing robotic manipulation. Vision-language-action (VLA) models, in particular, have emerged as a promising approach for…

Software Engineering · Computer Science 2025-05-13 Zhijie Wang , Zhehua Zhou , Jiayang Song , Yuheng Huang , Zhan Shu , Lei Ma

World Models (WMs) have emerged as a promising approach for post-training Vision-Language-Action (VLA) policies to improve robustness and generalization under environmental changes. However, most WM-based post-training methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 An Dinh Vuong , Tuan Van Vo , Abdullah Sohail , Haoran Ding , Liang Ma , Xiaodan Liang , Anqing Duan , Ivan Laptev , Ian Reid

Vision-Language-Action models (VLAs) have demonstrated remarkable performance in robot control. However, they remain fundamentally limited in tasks that require high precision due to their single-inference paradigm. While test-time scaling…

Robotics · Computer Science 2025-10-08 Suhyeok Jang , Dongyoung Kim , Changyeon Kim , Youngsuk Kim , Jinwoo Shin

Vision-Language-Action (VLA) models have made substantial progress by leveraging the robust capabilities of Visual Language Models (VLMs). However, VLMs' significant parameter size and autoregressive (AR) decoding nature impose considerable…

Machine Learning · Computer Science 2025-09-23 Songsheng Wang , Rucheng Yu , Zhihang Yuan , Chao Yu , Feng Gao , Yu Wang , Derek F. Wong

Vision-Language Models (VLMs) have emerged as a promising approach to address the data scarcity challenge in robotics, enabling the development of generalizable visuomotor control policies. While models like OpenVLA showcase the potential…

Existing Visual-Language-Action (VLA) models have shown promising performance in zero-shot scenarios, demonstrating impressive task execution and reasoning capabilities. However, a significant challenge arises from the limitations of visual…

Robotics · Computer Science 2025-04-29 Chia-Yu Hung , Qi Sun , Pengfei Hong , Amir Zadeh , Chuan Li , U-Xuan Tan , Navonil Majumder , Soujanya Poria

Conventional Vision-Language Models(VLMs) typically utilize a fixed number of vision tokens, regardless of task complexity. This one-size-fits-all strategy introduces notable inefficiencies: using excessive tokens leads to unnecessary…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Junshan Hu , Jialiang Mao , Zhikang Liu , Zhongpu Xia , Peng Jia , Xianpeng Lang

Vision--language--action (VLA) models have recently shown promising performance on a variety of embodied tasks, yet they still fall short in reliability and generalization, especially when deployed across different embodiments or real-world…

The rapid progress of multimodal large language models (MLLM) has paved the way for Vision-Language-Action (VLA) paradigms, which integrate visual perception, natural language understanding, and control within a single policy. Researchers…

Vision-language-action (VLA) models have recently emerged as a powerful paradigm for building generalist robots. However, traditional VLA models that generate actions through flow matching (FM) typically rely on rigid and uniform time…

Robotics · Computer Science 2026-05-08 Yuhua Jiang , Shuang Cheng , Yan Ding , Feifei Gao , Biqing Qi

Vision-language-action (VLA) models increasingly rely on auxiliary world modules to plan over long horizons, yet how such modules should be parameterized on top of a pretrained VLA remains an open design question. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zuojin Tang , Shengchao Yuan , Xiaoxin Bai , Zhiyuan Jing , De Ma , Gang Pan , Bin Liu

Due to their ability of follow natural language instructions, vision-language-action (VLA) models are increasingly prevalent in the embodied AI arena, following the widespread success of their precursors -- LLMs and VLMs. In this paper, we…

We present LightVLA, a simple yet effective differentiable token pruning framework for vision-language-action (VLA) models. While VLA models have shown impressive capability in executing real-world robotic tasks, their deployment on…

Robotics · Computer Science 2025-09-23 Titong Jiang , Xuefeng Jiang , Yuan Ma , Xin Wen , Bailin Li , Kun Zhan , Peng Jia , Yahui Liu , Sheng Sun , Xianpeng Lang

Despite advances in Vision-Language-Action (VLA) models, robotic manipulation struggles with fine-grained tasks because current models lack mechanisms for active visual attention allocation. Human gaze naturally encodes intent, planning,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Anupam Pani , Yanchao Yang

While vision-language models have advanced significantly, their application in language-conditioned robotic manipulation is still underexplored, especially for contact-rich tasks that extend beyond visually dominant pick-and-place…

Robotics · Computer Science 2025-05-15 Chaofan Zhang , Peng Hao , Xiaoge Cao , Xiaoshuai Hao , Shaowei Cui , Shuo Wang

Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for generalist robotic control. Built upon vision-language model (VLM) architectures, VLAs predict actions conditioned on visual observations and language…

Robotics · Computer Science 2026-05-26 Weikang Qiu , Huashuo Lei , Tinglin Huang , Rex Ying

We propose a standalone autoregressive (AR) Action Expert that generates actions as a continuous causal sequence while conditioning on refreshable vision-language prefixes. In contrast to existing Vision-Language-Action (VLA) models and…