English

Beyond Cosine Similarity: Magnitude-Aware CLIP for No-Reference Image Quality Assessment

Computer Vision and Pattern Recognition 2026-02-03 v3 Artificial Intelligence

Abstract

Recent efforts have repurposed the Contrastive Language-Image Pre-training (CLIP) model for No-Reference Image Quality Assessment (NR-IQA) by measuring the cosine similarity between the image embedding and textual prompts such as "a good photo" or "a bad photo." However, this semantic similarity overlooks a critical yet underexplored cue: the magnitude of the CLIP image features, which we empirically find to exhibit a strong correlation with perceptual quality. In this work, we introduce a novel adaptive fusion framework that complements cosine similarity with a magnitude-aware quality cue. Specifically, we first extract the absolute CLIP image features and apply a Box-Cox transformation to statistically normalize the feature distribution and mitigate semantic sensitivity. The resulting scalar summary serves as a semantically-normalized auxiliary cue that complements cosine-based prompt matching. To integrate both cues effectively, we further design a confidence-guided fusion scheme that adaptively weighs each term according to its relative strength. Extensive experiments on multiple benchmark IQA datasets demonstrate that our method consistently outperforms standard CLIP-based IQA and state-of-the-art baselines, without any task-specific training.

Keywords

Cite

@article{arxiv.2511.09948,
  title  = {Beyond Cosine Similarity: Magnitude-Aware CLIP for No-Reference Image Quality Assessment},
  author = {Zhicheng Liao and Dongxu Wu and Zhenshan Shi and Sijie Mai and Hanwei Zhu and Lingyu Zhu and Yuncheng Jiang and Baoliang Chen},
  journal= {arXiv preprint arXiv:2511.09948},
  year   = {2026}
}

Comments

Accepted by AAAI 2026