English

AdaLoRA-QAT: Adaptive Low-Rank and Quantization-Aware Segmentation

Image and Video Processing 2026-04-02 v1 Artificial Intelligence Computer Vision and Pattern Recognition

Abstract

Chest X-ray (CXR) segmentation is an important step in computer-aided diagnosis, yet deploying large foundation models in clinical settings remains challenging due to computational constraints. We propose AdaLoRA-QAT, a two-stage fine-tuning framework that combines adaptive low-rank encoder adaptation with full quantization-aware training. Adaptive rank allocation improves parameter efficiency, while selective mixed-precision INT8 quantization preserves structural fidelity crucial for clinical reliability. Evaluated across large-scale CXR datasets, AdaLoRA-QAT achieves 95.6% Dice, matching full-precision SAM decoder fine-tuning while reducing trainable parameters by 16.6\times and yielding 2.24\times model compression. A Wilcoxon signed-rank test confirms that quantization does not significantly degrade segmentation accuracy. These results demonstrate that AdaLoRA-QAT effectively balances accuracy, efficiency, and structural trust-worthiness, enabling compact and deployable foundation models for medical image segmentation. Code and pretrained models are available at: https://prantik-pdeb.github.io/adaloraqat.github.io/

Keywords

Cite

@article{arxiv.2604.01167,
  title  = {AdaLoRA-QAT: Adaptive Low-Rank and Quantization-Aware Segmentation},
  author = {Prantik Deb and Srimanth Dhondy and N. Ramakrishna and Anu Kapoor and Raju S. Bapi and Tapabrata Chakraborti},
  journal= {arXiv preprint arXiv:2604.01167},
  year   = {2026}
}

Comments

Accepted to ISBI 2026(Oral Presentation)

R2 v1 2026-07-01T11:49:26.202Z