English

Compressor-VLA: Instruction-Guided Visual Token Compression for Efficient Robotic Manipulation

Robotics 2025-11-25 v1 Computer Vision and Pattern Recognition Machine Learning

Abstract

Vision-Language-Action (VLA) models have emerged as a powerful paradigm in Embodied AI. However, the significant computational overhead of processing redundant visual tokens remains a critical bottleneck for real-time robotic deployment. While standard token pruning techniques can alleviate this, these task-agnostic methods struggle to preserve task-critical visual information. To address this challenge, simultaneously preserving both the holistic context and fine-grained details for precise action, we propose Compressor-VLA, a novel hybrid instruction-conditioned token compression framework designed for efficient, task-oriented compression of visual information in VLA models. The proposed Compressor-VLA framework consists of two token compression modules: a Semantic Task Compressor (STC) that distills holistic, task-relevant context, and a Spatial Refinement Compressor (SRC) that preserves fine-grained spatial details. This compression is dynamically modulated by the natural language instruction, allowing for the adaptive condensation of task-relevant visual information. Experimentally, extensive evaluations demonstrate that Compressor-VLA achieves a competitive success rate on the LIBERO benchmark while reducing FLOPs by 59% and the visual token count by over 3x compared to its baseline. The real-robot deployments on a dual-arm robot platform validate the model's sim-to-real transferability and practical applicability. Moreover, qualitative analyses reveal that our instruction guidance dynamically steers the model's perceptual focus toward task-relevant objects, thereby validating the effectiveness of our approach.

Keywords

Cite

@article{arxiv.2511.18950,
  title  = {Compressor-VLA: Instruction-Guided Visual Token Compression for Efficient Robotic Manipulation},
  author = {Juntao Gao and Feiyang Ye and Jing Zhang and Wenjing Qian},
  journal= {arXiv preprint arXiv:2511.18950},
  year   = {2025}
}

Comments

11 pages, 5 figures

R2 v1 2026-07-01T07:51:51.068Z