English

SQAP-VLA: A Synergistic Quantization-Aware Pruning Framework for High-Performance Vision-Language-Action Models

Computer Vision and Pattern Recognition 2025-09-12 v1 Artificial Intelligence

Abstract

Vision-Language-Action (VLA) models exhibit unprecedented capabilities for embodied intelligence. However, their extensive computational and memory costs hinder their practical deployment. Existing VLA compression and acceleration approaches conduct quantization or token pruning in an ad-hoc manner but fail to enable both for a holistic efficiency improvement due to an observed incompatibility. This work introduces SQAP-VLA, the first structured, training-free VLA inference acceleration framework that simultaneously enables state-of-the-art quantization and token pruning. We overcome the incompatibility by co-designing the quantization and token pruning pipeline, where we propose new quantization-aware token pruning criteria that work on an aggressively quantized model while improving the quantizer design to enhance pruning effectiveness. When applied to standard VLA models, SQAP-VLA yields significant gains in computational efficiency and inference speed while successfully preserving core model performance, achieving a ×\times1.93 speedup and up to a 4.5\% average success rate enhancement compared to the original model.

Keywords

Cite

@article{arxiv.2509.09090,
  title  = {SQAP-VLA: A Synergistic Quantization-Aware Pruning Framework for High-Performance Vision-Language-Action Models},
  author = {Hengyu Fang and Yijiang Liu and Yuan Du and Li Du and Huanrui Yang},
  journal= {arXiv preprint arXiv:2509.09090},
  year   = {2025}
}

Comments

12 pages, 9 figures

R2 v1 2026-07-01T05:31:15.817Z