English
Related papers

Related papers: FAST: Efficient Action Tokenization for Vision-Lan…

200 papers

In recent years, Vision-Language-Action (VLA) models have become a vital research direction in robotics due to their impressive multimodal understanding and generalization capabilities. Despite the progress, their practical deployment is…

Robotics · Computer Science 2025-06-17 Wenxuan Song , Jiayi Chen , Pengxiang Ding , Yuxin Huang , Han Zhao , Donglin Wang , Haoang Li

Vision-Language-Action (VLA) models have emerged as a unified paradigm for robotic perception and control, enabling emergent generalization and long-horizon task execution. However, their deployment in dynamic, real-world environments is…

Artificial Intelligence · Computer Science 2025-12-24 Yuntao Dai , Hang Gu , Teng Wang , Qianyu Cheng , Yifei Zheng , Zhiyong Qiu , Lei Gong , Wenqi Lou , Xuehai Zhou

Autoregressive policies offer a compelling foundation for scalable robot learning by enabling discrete abstraction, token-level reasoning, and flexible inference. However, applying autoregressive modeling to continuous robot actions…

Robotics · Computer Science 2026-02-12 Chaoqi Liu , Xiaoshen Han , Jiawei Gao , Yue Zhao , Haonan Chen , Yilun Du

Vision-Language-Action (VLA) models have achieved significant breakthroughs by leveraging Large Vision Language Models (VLMs) to jointly interpret instructions and visual inputs. However, the substantial increase in visual tokens,…

Robotics · Computer Science 2026-02-25 Haosheng Li , Weixin Mao , Zihan Lan , Hongwei Xiong , Hongan Wang , Chenyang Si , Ziwei Liu , Xiaoming Deng , Hua Chen

We introduce Latent Action Pretraining for general Action models (LAPA), an unsupervised method for pretraining Vision-Language-Action (VLA) models without ground-truth robot action labels. Existing Vision-Language-Action models require…

Vision-Language-Action (VLA) models leveraging the native autoregressive paradigm of Vision-Language Models (VLMs) have demonstrated superior instruction-following and training efficiency. Central to this paradigm is action tokenization,…

Manipulating dynamic objects remains an open challenge for Vision-Language-Action (VLA) models, which, despite strong generalization in static manipulation, struggle in dynamic scenarios requiring rapid perception, temporal anticipation,…

Robotics · Computer Science 2026-01-30 Haozhe Xie , Beichen Wen , Jiarui Zheng , Zhaoxi Chen , Fangzhou Hong , Haiwen Diao , Ziwei Liu

Recent vision-language-action models (VLAs) build upon pretrained vision-language models and leverage diverse robot datasets to demonstrate strong task execution, language following ability, and semantic generalization. Despite these…

Robotics · Computer Science 2025-04-29 Moo Jin Kim , Chelsea Finn , Percy Liang

Coarse-to-fine autoregressive modeling has recently shown strong promise for visuomotor policy learning, combining the inference efficiency of autoregressive methods with the global trajectory coherence of diffusion-based policies. However,…

Robotics · Computer Science 2026-03-31 Daichi Yashima , Koki Seno , Shuhei Kurita , Yusuke Oda , Komei Sugiura

Real-time execution is crucial for deploying Vision-Language-Action (VLA) models in the physical world. Existing asynchronous inference methods primarily optimize trajectory smoothness, but neglect the critical latency in reacting to…

Robotics · Computer Science 2026-05-19 Yuxiang Lu , Zhe Liu , Xianzhe Fan , Zhenya Yang , Jinghua Hou , Junyi Li , Kaixin Ding , Hengshuang Zhao

While autoregressive (AR) Vision-Language-Action (VLA) models have demonstrated formidable reasoning capabilities in robotic tasks, their sequential decoding process often incurs high inference latency and may amplify error accumulation…

Robotics · Computer Science 2026-05-14 Ruiheng Wang , Shuanghao Bai , Haoran Zhang , Badong Chen , Xiangyu Xu

Vision-Language Action (VLA) models significantly advance robotic manipulation by leveraging the strong perception capabilities of pretrained vision-language models (VLMs). By integrating action modules into these pretrained models, VLA…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Shaoqi Dong , Chaoyou Fu , Haihan Gao , Yi-Fan Zhang , Chi Yan , Chu Wu , Xiaoyu Liu , Yunhang Shen , Jing Huo , Deqiang Jiang , Haoyu Cao , Yang Gao , Xing Sun , Ran He , Caifeng Shan

Vision-Language-Action (VLA) models rely on current observations, including images, language instructions, and robot states, to predict actions and complete tasks. While accurate visual perception is crucial for precise action prediction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Cheng Yang , Jianhao Jiao , Lingyi Huang , Jinqi Xiao , Zhexiang Tang , Yu Gong , Yibiao Ying , Yang Sui , Jintian Lin , Wen Huang , Bo Yuan

We propose a standalone autoregressive (AR) Action Expert that generates actions as a continuous causal sequence while conditioning on refreshable vision-language prefixes. In contrast to existing Vision-Language-Action (VLA) models and…

We present a novel unsupervised framework to unlock vast unlabeled human demonstration data from continuous industrial video streams for Vision-Language-Action (VLA) model pre-training. Our method first trains a lightweight motion tokenizer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jiajie Zhang , Sören Schwertfeger , Alexander Kleiner

Vision-Language-Action (VLA) models have demonstrated strong performance in robotic manipulation, yet their closed-loop deployment is hindered by the high latency and compute cost of repeatedly running large vision-language backbones at…

Robotics · Computer Science 2026-01-28 Wenda Yu , Tianshi Wang , Fengling Li , Jingjing Li , Lei Zhu

A generalist robot should perform effectively across various environments. However, most existing approaches heavily rely on scaling action-annotated data to enhance their capabilities. Consequently, they are often limited to single…

Robotics · Computer Science 2025-11-04 Qingwen Bu , Yanting Yang , Jisong Cai , Shenyuan Gao , Guanghui Ren , Maoqing Yao , Ping Luo , Hongyang Li

Vision-Language-Action (VLA) models have shown remarkable potential in visuomotor control and instruction comprehension through end-to-end learning processes. However, current VLA models face significant challenges: they are slow during…

Vision-Language-Action (VLA) models aim to control robots for manipulation from visual observations and natural-language instructions. However, existing hierarchical and autoregressive paradigms often introduce architectural overhead,…

Flow-based vision-language-action (VLA) policies offer strong expressivity for action generation, but suffer from a fundamental inefficiency: multi-step inference is required to recover action structure from uninformative Gaussian noise,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Fan Du , Feng Yan , Jianxiong Wu , Xinrun Xu , Weiye Zhang , Weinong Wang , Yu Guo , Bin Qian , Zhihai He , Fei Wang , Heng Yang