English

QDepth-VLA: Quantized Depth Prediction as Auxiliary Supervision for Vision-Language-Action Models

Computer Vision and Pattern Recognition 2025-12-23 v2 Robotics

Abstract

Spatial perception and reasoning are crucial for Vision-Language-Action (VLA) models to accomplish fine-grained manipulation tasks. However, existing approaches often lack the ability to understand and reason over the essential 3D structures necessary for precise control. To address this limitation, we propose QDepth-VLA, a general framework that augments VLA models with an auxiliary depth prediction task. A dedicated depth expert is designed to predict quantized latent tokens of depth maps obtained from a VQ-VAE encoder, enabling the model to learn depth-aware representations that capture critical geometric cues. Experimental results on the simulation benchmarks and real-world tasks demonstrate that QDepth-VLA yields strong spatial reasoning and competitive performance on manipulation tasks.

Keywords

Cite

@article{arxiv.2510.14836,
  title  = {QDepth-VLA: Quantized Depth Prediction as Auxiliary Supervision for Vision-Language-Action Models},
  author = {Yixuan Li and Yuhui Chen and Mingcai Zhou and Haoran Li and Zhengtao Zhang and Dongbin Zhao},
  journal= {arXiv preprint arXiv:2510.14836},
  year   = {2025}
}
R2 v1 2026-07-01T06:41:39.373Z