English

Collaborative Auto-encoding for Blind Image Quality Assessment

Computer Vision and Pattern Recognition 2023-05-25 v1 Image and Video Processing

Abstract

Blind image quality assessment (BIQA) is a challenging problem with important real-world applications. Recent efforts attempting to exploit powerful representations by deep neural networks (DNN) are hindered by the lack of subjectively annotated data. This paper presents a novel BIQA method which overcomes this fundamental obstacle. Specifically, we design a pair of collaborative autoencoders (COAE) consisting of a content autoencoder (CAE) and a distortion autoencoder (DAE) that work together to extract content and distortion representations, which are shown to be highly descriptive of image quality. While the CAE follows a standard codec procedure, we introduce the CAE-encoded feature as an extra input to the DAE's decoder for reconstructing distorted images, thus effectively forcing DAE's encoder to extract distortion representations. The self-supervised learning framework allows the COAE including two feature extractors to be trained by almost unlimited amount of data, thus leaving limited samples with annotations to finetune a BIQA model. We will show that the proposed BIQA method achieves state-of-the-art performance and has superior generalization capability over other learning based models. The codes are available at: https://github.com/Macro-Zhou/NRIQA-VISOR/.

Keywords

Cite

@article{arxiv.2305.14684,
  title  = {Collaborative Auto-encoding for Blind Image Quality Assessment},
  author = {Zehong Zhou and Fei Zhou and Guoping Qiu},
  journal= {arXiv preprint arXiv:2305.14684},
  year   = {2023}
}
R2 v1 2026-06-28T10:43:55.746Z