English

CR-QAT: Curriculum Relational Quantization-Aware Training for Open-Vocabulary Object Detection

Computer Vision and Pattern Recognition 2026-03-10 v2

Abstract

Open-vocabulary object detection (OVOD) enables novel category detection via vision-language alignment, but massive model sizes hinder deployment on resource-constrained devices. While quantization offers practical compression, we reveal that naive extreme low-bit (e.g., 4-bit) quantization severely degrades fine-grained vision-language alignment and distorts inter-region relational structures. To address this, we propose curriculum relational quantization-aware training (CR-QAT), an integrated framework combining stage-by-stage optimization with relational knowledge distillation. Within CR-QAT, curriculum QAT (CQAT) mitigates error accumulation by partitioning the model for progressive quantization, ensuring stable optimization via error isolation. Concurrently, text-centric relational KD (TRKD) is applied to task-relevant modules. By constructing text-anchored pairwise similarity matrices, TRKD comprehensively transfers the teacher's multi-dimensional relational knowledge. Experiments on LVIS and COCO zero-shot benchmarks demonstrate that CR-QAT consistently outperforms existing QAT baselines under aggressive low-bit settings, achieving relative AP improvements of up to 38.9% and 40.9%, respectively.

Keywords

Cite

@article{arxiv.2603.05964,
  title  = {CR-QAT: Curriculum Relational Quantization-Aware Training for Open-Vocabulary Object Detection},
  author = {Jinyeong Park and Donghwa Kang and Brent ByungHoon Kang and Hyeongboo Baek and Jibum Kim},
  journal= {arXiv preprint arXiv:2603.05964},
  year   = {2026}
}
R2 v1 2026-07-01T11:06:17.377Z