English
Related papers

Related papers: SQAP-VLA: A Synergistic Quantization-Aware Pruning…

200 papers

Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs), VLAs exhibit higher complexity due to their multi-modal…

Robotics · Computer Science 2026-03-06 Hugo Buurmeijer , Carmen Amo Alonso , Aiden Swann , Marco Pavone

Vision Transformers (ViTs) have emerged as the backbone of many segmentation models, consistently achieving state-of-the-art (SOTA) performance. However, their success comes at a significant computational cost. Image token pruning is one of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Hanning Chen , Yang Ni , Wenjun Huang , Yezi Liu , SungHeon Jeong , Fei Wen , Nathaniel Bastian , Hugo Latapie , Mohsen Imani

The application of artificial intelligence (AI) in industry is accelerating the shift from traditional automation to intelligent systems with perception and cognition. Vision language-action (VLA) models have been a key paradigm in AI to…

Artificial Intelligence · Computer Science 2025-09-30 Shuai Li , Chen Yizhe , Li Dong , Liu Sichao , Lan Dapeng , Liu Yu , Zhibo Pang

Recent Large Vision-Language Models (LVLMs) have advanced multi-modal understanding by incorporating finer-grained visual perception and encoding. However, such methods incur significant computational costs due to longer visual token…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Ce Zhang , Kaixin Ma , Tianqing Fang , Wenhao Yu , Hongming Zhang , Zhisong Zhang , Haitao Mi , Dong Yu

While Large Vision-Language Models (LVLMs) demonstrate exceptional multi-modal capabilities, the quadratic computational cost of processing high-resolution visual tokens remains a critical bottleneck. Though recent token reduction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Surendra Pathak , Bo Han

Vision-Language-Action (VLA) tasks require reasoning over complex visual scenes and executing adaptive actions in dynamic environments. While recent studies on reasoning VLAs show that explicit chain-of-thought (CoT) can improve…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Chi-Pin Huang , Yunze Man , Zhiding Yu , Min-Hung Chen , Jan Kautz , Yu-Chiang Frank Wang , Fu-En Yang

Multimodal Large Language Models (MLLMs) have shown remarkable versatility in understanding diverse multimodal data and tasks. However, these capabilities come with an increased model scale. While post-training pruning reduces model size in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Jaewoo Lee , Keyang Xuan , Chanakya Ekbote , Sandeep Polisetty , Yi R. Fung , Paul Pu Liang

Vision-Language-Action (VLA) models provide a promising paradigm for robot learning by integrating visual perception with language-guided policy learning. However, most existing approaches rely on 2D visual inputs to perform actions in 3D…

Robotics · Computer Science 2025-12-16 Yicheng Feng , Wanpeng Zhang , Ye Wang , Hao Luo , Haoqi Yuan , Sipeng Zheng , Zongqing Lu

Vision-Language-Action (VLA) models offer a promising autonomous driving paradigm for leveraging world knowledge and reasoning capabilities, especially in long-tail scenarios. However, existing VLA models often struggle with the high…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Zewei Zhou , Ruining Yang , Xuewei , Qi , Yiluan Guo , Sherry X. Chen , Tao Feng , Kateryna Pistunova , Yishan Shen , Lili Su , Jiaqi Ma

Vision-Language-Action (VLA) models have demonstrated remarkable capabilities in robotic manipulation,enabling robots to execute natural language commands through end-to-end learning from visual observations.However, deploying large-scale…

Robotics · Computer Science 2025-12-16 Abdullah Yahya Abdullah Omaisan , Ibrahim Sheikh Mohamed

Vision-Language-Action (VLA) models are emerging as a promising paradigm for end-to-end autonomous driving, valued for their potential to leverage world knowledge and reason about complex driving scenes. However, existing methods suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xinyang Wang , Qian Liu , Wenjie Ding , Zhao Yang , Wei Li , Chang Liu , Bailin Li , Kun Zhan , Xianpeng Lang , Wei Chen

Current research on Vision-Language-Action (VLA) models predominantly focuses on enhancing generalization through established reasoning techniques. While effective, these improvements invariably increase computational complexity and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Riccardo Andrea Izzo , Gianluca Bardaro , Matteo Matteucci

While Vision-Language-Action (VLA) models generalize well to generic instructions, they struggle with personalized commands such as "bring my cup," where the robot must act on one specific instance among visually similar objects. We study…

Robotics · Computer Science 2026-01-30 Sangoh Lee , Sangwoo Mo , Wook-Shin Han

Efficient inference in Large Vision-Language Models is constrained by the high cost of processing thousands of visual tokens, yet it remains unclear which tokens and computations can be safely removed. While attention scores are commonly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Samyak Jha , Junho Kim

Recent advances in Vision-Language-Action (VLA) models have opened new avenues for robot manipulation, yet existing methods exhibit limited efficiency and a lack of high-level knowledge and spatial awareness. To address these challenges, we…

Vision-Language-Action (VLA) models rely on current observations, including images, language instructions, and robot states, to predict actions and complete tasks. While accurate visual perception is crucial for precise action prediction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Cheng Yang , Jianhao Jiao , Lingyi Huang , Jinqi Xiao , Zhexiang Tang , Yu Gong , Yibiao Ying , Yang Sui , Jintian Lin , Wen Huang , Bo Yuan

Large Vision-Language Models (LVLMs) incur substantial inference costs due to the processing of a vast number of visual tokens. Existing methods typically struggle to model progressive visual token reduction as a multi-step decision process…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Sihan Cao , Jianwei Zhang , Pengcheng Zheng , Jiaxin Yan , Caiyan Qin , Yalan Ye , Wei Dong , Peng Wang , Yang Yang , Chaoning Zhang

This paper proposes VLA-AN, an efficient and onboard Vision-Language-Action (VLA) framework dedicated to autonomous drone navigation in complex environments. VLA-AN addresses four major limitations of existing large aerial navigation…

Robotics · Computer Science 2025-12-22 Yuze Wu , Mo Zhu , Xingxing Li , Yuheng Du , Yuxin Fan , Wenjun Li , Zhichao Han , Xin Zhou , Fei Gao

Vision-Language Transformers (VLTs) have shown great success recently, but are meanwhile accompanied by heavy computation costs, where a major reason can be attributed to the large number of visual and language tokens. Existing token…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Jianjian Cao , Peng Ye , Shengze Li , Chong Yu , Yansong Tang , Jiwen Lu , Tao Chen

The long-standing vision of general-purpose robots hinges on their ability to understand and act upon natural language instructions. Vision-Language-Action (VLA) models have made remarkable progress toward this goal, yet their generated…

Robotics · Computer Science 2026-02-19 Jacky Kwok , Xilun Zhang , Mengdi Xu , Yuejiang Liu , Azalia Mirhoseini , Chelsea Finn , Marco Pavone