English
Related papers

Related papers: Visual-Language Model Knowledge Distillation Metho…

200 papers

Inspired by the dual-stream theory of the human visual system (HVS) - where the ventral stream is responsible for object recognition and detail analysis, while the dorsal stream focuses on spatial relationships and motion perception - an…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Li Yu , Situo Wang , Wei Zhou , Moncef Gabbouj

Vision-Language Pre-training (VLP) shows remarkable progress with the assistance of extremely heavy parameters, which challenges deployment in real applications. Knowledge distillation is well recognized as the essential procedure in model…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Huafeng Kuang , Jie Wu , Xiawu Zheng , Ming Li , Xuefeng Xiao , Rui Wang , Min Zheng , Rongrong Ji

Recent multimodal large language models (MLLMs) have demonstrated strong capabilities in image quality assessment (IQA) tasks. However, adapting such large-scale models is computationally expensive and still relies on substantial Mean…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Xinyue Li , Zhichao Zhang , Zhiming Xu , Shubo Xu , Xiongkuo Min , Yitong Chen , Guangtao Zhai

Recent advances in Image Quality Assessment (IQA) have leveraged Multi-modal Large Language Models (MLLMs) to generate descriptive explanations. However, despite their strong visual perception modules, these models often fail to reliably…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yuan Li , Zitang Sun , Yen-Ju Chen , Shin'ya Nishida

Learning-based image quality assessment (IQA) has made remarkable progress in the past decade, but nearly all consider the two key components -- model and data -- in isolation. Specifically, model-centric IQA focuses on developing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Peibei Cao , Dingquan Li , Kede Ma

Blind Image Quality Assessment (BIQA) aims to develop methods that estimate the quality scores of images in the absence of a reference image. In this paper, we approach BIQA from a distortion identification perspective, where our primary…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Sepehr Kazemi Ranjbar , Emad Fatemizadeh

We present Distill CLIP (DCLIP), a fine-tuned variant of the CLIP model that enhances multimodal image-text retrieval while preserving the original model's strong zero-shot classification capabilities. CLIP models are typically constrained…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Daniel Csizmadia , Andrei Codreanu , Victor Sim , Vighnesh Prabhu , Michael Lu , Kevin Zhu , Sean O'Brien , Vasu Sharma

Contrastive Language-Image Pre-training (CLIP) has been shown to improve zero-shot generalization capabilities of language and vision models. In this paper, we extend CLIP for efficient knowledge distillation, by utilizing embeddings as…

Machine Learning · Computer Science 2024-09-02 Lakshmi Nair

Generally, humans are more skilled at perceiving differences between high-quality (HQ) and low-quality (LQ) images than directly judging the quality of a single LQ image. This situation also applies to image quality assessment (IQA).…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Guanghao Yin , Wei Wang , Zehuan Yuan , Chuchu Han , Wei Ji , Shouqian Sun , Changhu Wang

Blind dehazed image quality assessment (BDQA), which aims to accurately predict the visual quality of dehazed images without any reference information, is essential for the evaluation, comparison, and optimization of image dehazing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yirui Zeng , Jun Fu , Hadi Amirpour , Huasheng Wang , Guanghui Yue , Hantao Liu , Ying Chen , Wei Zhou

With the rapid development of generative technologies, AI-Generated Images (AIGIs) have been widely applied in various aspects of daily life. However, due to the immaturity of the technology, the quality of the generated images varies, so…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zhenchen Tang , Zichuan Wang , Bo Peng , Jing Dong

Vision-Language Models (VLMs) such as CLIP are trained on large amounts of image-text pairs, resulting in remarkable generalization across several data distributions. However, in several cases, their expensive training and data…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Sravanti Addepalli , Ashish Ramayee Asokan , Lakshay Sharma , R. Venkatesh Babu

Contrastive language-image pretraining (CLIP) links vision and language modalities into a unified embedding space, yielding the tremendous potential for vision-language (VL) tasks. While early concurrent works have begun to study this…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Zhecan Wang , Noel Codella , Yen-Chun Chen , Luowei Zhou , Jianwei Yang , Xiyang Dai , Bin Xiao , Haoxuan You , Shih-Fu Chang , Lu Yuan

Image-text contrastive models like CLIP have wide applications in zero-shot classification, image-text retrieval, and transfer learning. However, they often struggle on compositional visio-linguistic tasks (e.g., attribute-binding or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Samyadeep Basu , Shell Xu Hu , Maziar Sanjabi , Daniela Massiceti , Soheil Feizi

Image quality assessment (IQA) plays a critical role in optimizing radiation dose and developing novel medical imaging techniques in computed tomography (CT). Traditional IQA methods relying on hand-crafted features have limitations in…

Image and Video Processing · Electrical Eng. & Systems 2023-11-15 Tao Song , Ruizhi Hou , Lisong Dai , Lei Xiang

No-Reference Image Quality Assessment (NR-IQA) focuses on designing methods to measure image quality in alignment with human perception when a high-quality reference image is unavailable. Most state-of-the-art NR-IQA approaches are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Lorenzo Agnolucci , Leonardo Galteri , Marco Bertini

Vision-Language Models (VLMs) demonstrate remarkable capabilities in visual understanding and reasoning, such as in Visual Question Answering (VQA), where the model is asked a question related to a visual input. Still, these models can make…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Ben Vardi , Oron Nir , Ariel Shamir

Image quality assessment (IQA) focuses on the perceptual visual quality of images, playing a crucial role in downstream tasks such as image reconstruction, compression, and generation. The rapid advancement of multi-modal large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Weiqi Li , Xuanyu Zhang , Shijie Zhao , Yabin Zhang , Junlin Li , Li Zhang , Jian Zhang

Existing blind image quality assessment (BIQA) methods are mostly designed in a disposable way and cannot evolve with unseen distortions adaptively, which greatly limits the deployment and application of BIQA models in real-world scenarios.…

Multimedia · Computer Science 2021-04-30 Jianzhao Liu , Wei Zhou , Jiahua Xu , Xin Li , Shukun An , Zhibo Chen

With the rapid advancement of Vision Language Models (VLMs), VLM-based Image Quality Assessment (IQA) seeks to describe image quality linguistically to align with human expression and capture the multifaceted nature of IQA tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhiyuan You , Jinjin Gu , Xin Cai , Zheyuan Li , Kaiwen Zhu , Chao Dong , Tianfan Xue