English
Related papers

Related papers: FASTer: Toward Efficient Autoregressive Vision Lan…

200 papers

Vision-language-action (VLA) models have advanced robot manipulation through large-scale pretraining, but real-world deployment remains challenging due to partial observability and delayed feedback. Reinforcement learning addresses this via…

Vision-Language-Action (VLA) models have demonstrated significant advantages in robotic manipulation. However, their reliance on vision and language often leads to suboptimal performance in tasks involving visual occlusion, fine-grained…

Vision-Language-Action (VLA) models offer a promising path to generalist robot control, but their inference latency causes observation staleness when generated actions are executed asynchronously. Several methods have been proposed…

Robotics · Computer Science 2026-05-12 Ayoub Agouzoul

General vision-language models increasingly support unified spatiotemporal reasoning over long video streams, yet deploying such capabilities on robots remains constrained by the prohibitive latency of processing long-horizon histories and…

Robotics · Computer Science 2026-02-19 Jingjing Fan , Yushan Liu , Shoujie Li , Botao Ren , Siyuan Li , Xiao-Ping Zhang , Wenbo Ding , Zhidong Deng

To operate effectively in the real world, robots should integrate multimodal reasoning with precise action generation. However, existing vision-language-action (VLA) models often sacrifice one for the other, narrow their abilities to…

Robotics · Computer Science 2026-03-04 Shuai Yang , Hao Li , Bin Wang , Yilun Chen , Yang Tian , Tai Wang , Hanqing Wang , Feng Zhao , Yiyi Liao , Jiangmiao Pang

Many robotic manipulation tasks require sensing and responding to force signals such as torque to assess whether the task has been successfully completed and to enable closed-loop control. However, current Vision-Language-Action (VLA)…

Robotics · Computer Science 2025-09-10 Zongzheng Zhang , Haobo Xu , Zhuo Yang , Chenghao Yue , Zehao Lin , Huan-ang Gao , Ziwei Wang , Hao Zhao

Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs), VLAs exhibit higher complexity due to their multi-modal…

Robotics · Computer Science 2026-03-06 Hugo Buurmeijer , Carmen Amo Alonso , Aiden Swann , Marco Pavone

Vision-Language-Action (VLA) models have advanced rapidly with stronger backbones, broader pre-training, and larger demonstration datasets, yet their action heads remain largely homogeneous: most directly predict action commands in a fixed…

Artificial Intelligence · Computer Science 2026-05-13 Huoren Yang , Jianchao Zhao , Hu Yusong , Qiguan Ou , Yuyang Gao , Wei Ke , Yuhang He , SongLin Dong , Zhiheng Ma , Yihong Gong

Vision-Language-Action (VLA) models enable robots to interpret natural-language instructions and perform diverse tasks, yet their integration of perception, language, and control introduces new safety vulnerabilities. Despite growing…

Cryptography and Security · Computer Science 2025-11-18 Jiayu Li , Yunhan Zhao , Xiang Zheng , Zonghuan Xu , Yige Li , Xingjun Ma , Yu-Gang Jiang

Scaling the input image resolution is essential for enhancing the performance of Vision Language Models (VLMs), particularly in text-rich image understanding tasks. However, popular visual encoders such as ViTs become inefficient at high…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Pavan Kumar Anasosalu Vasu , Fartash Faghri , Chun-Liang Li , Cem Koc , Nate True , Albert Antony , Gokul Santhanam , James Gabriel , Peter Grasch , Oncel Tuzel , Hadi Pouransari

Flow-based vision-language-action (VLA) policies offer strong expressivity for action generation, but suffer from a fundamental inefficiency: multi-step inference is required to recover action structure from uninformative Gaussian noise,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Fan Du , Feng Yan , Jianxiong Wu , Xinrun Xu , Weiye Zhang , Weinong Wang , Yu Guo , Bin Qian , Zhihai He , Fei Wang , Heng Yang

End-to-end autonomous driving requires models to understand traffic scenes, infer driving intent, and generate executable motion plans. Recent vision-language-action (VLA) models inherit semantic priors from large-scale vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Rui Zhao , Jianlin Yu , Zhenhai Gao , Jiaqiao Liu , Fei Gao

Pre-trained vision-language models provide a robust foundation for efficient transfer learning across various downstream tasks. In the field of video action recognition, mainstream approaches often introduce additional modules to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Haoxing Chen , Zizheng Huang , Yan Hong , Yanshuo Wang , Zhongcai Lyu , Zhuoer Xu , Jun Lan , Zhangxuan Gu

We propose Avi, a novel 3D Vision-Language-Action (VLA) architecture that reframes robotic action generation as a problem of 3D perception and spatial reasoning, rather than low-level policy learning. While existing VLA models primarily…

Robotics · Computer Science 2025-10-28 Harris Song , Long Le

Diffusion and flow matching models have emerged as powerful robot policies, enabling Vision-Language-Action (VLA) models to generalize across diverse scenes and instructions. Yet, when trained via imitation learning, their high generative…

Robotics · Computer Science 2026-03-26 Minho Park , Kinam Kim , Junha Hyung , Hyojin Jang , Hoiyeong Jin , Jooyeol Yun , Hojoon Lee , Jaegul Choo

Recent advances in Vision-Language-Action (VLA) models have opened new avenues for robot manipulation, yet existing methods exhibit limited efficiency and a lack of high-level knowledge and spatial awareness. To address these challenges, we…

Vision-language Models (VLMs) have made significant strides in visual understanding and query response generation, but often face challenges of high computational cost and inference latency due to autoregressive decoding. In this work, we…

Machine Learning · Computer Science 2025-10-28 Divya Jyoti Bajpai , Manjesh Kumar Hanawal

Visual Autoregressive (VAR) models enable efficient image generation via next-scale prediction but face escalating computational costs as sequence length grows. Existing static pruning methods degrade performance by permanently removing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Kaixin Zhang , Ruiqing Yang , Yuan Zhang , Shan You , Tao Huang

The advancement of large Vision-Language-Action (VLA) models has significantly improved robotic manipulation in terms of language-guided task execution and generalization to unseen scenarios. While existing VLAs adapted from pretrained…

Vision-language-action (VLA) models increasingly rely on auxiliary world modules to plan over long horizons, yet how such modules should be parameterized on top of a pretrained VLA remains an open design question. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zuojin Tang , Shengchao Yuan , Xiaoxin Bai , Zhiyuan Jing , De Ma , Gang Pan , Bin Liu