English
Related papers

Related papers: AI-KD: Towards Alignment Invariant Face Image Qual…

200 papers

Image Quality Assessment (IQA) is a core task in computer vision. Multimodal methods based on vision-language models, such as CLIP, have demonstrated exceptional generalization capabilities in IQA tasks. To address the issues of excessive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yongkang Hou , Jiarun Song

Dense visual prediction tasks, such as detection and segmentation, are crucial for time-critical applications (e.g., autonomous driving and video surveillance). While deep models achieve strong performance, their efficiency remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Qizhen Lan , Qing Tian

An important scenario for image quality assessment (IQA) is to evaluate image restoration (IR) algorithms. The state-of-the-art approaches adopt a full-reference paradigm that compares restored images with their corresponding…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Heliang Zheng , Huan Yang , Jianlong Fu , Zheng-Jun Zha , Jiebo Luo

Knowledge Distillation (KD) refers to transferring knowledge from a large model to a smaller one, which is widely used to enhance model performance in machine learning. It tries to align embedding spaces generated from the teacher and the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Weidong Shi , Guanghui Ren , Yunpeng Chen , Shuicheng Yan

Collaborative fairness is a crucial challenge in federated learning. However, existing approaches often overlook a practical yet complex form of heterogeneity: imbalanced covariate shift. We provide a theoretical analysis of this setting,…

Machine Learning · Computer Science 2025-07-14 Tianrun Yu , Jiaqi Wang , Haoyu Wang , Mingquan Lin , Han Liu , Nelson S. Yee , Fenglong Ma

Due to the surging amount of AI-generated images, its provisioning to edges and mobile users from the cloud incurs substantial traffic on networks. Generative semantic communication (GSC) offers a promising solution by transmitting highly…

Machine Learning · Computer Science 2026-01-27 Jingzhi Hu , Geoffrey Ye Li

Data-free knowledge distillation (DFKD) is a promising approach for addressing issues related to model compression, security privacy, and transmission restrictions. Although the existing methods exploiting DFKD have achieved inspiring…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Renrong Shao , Wei Zhang , Jianhua Yin , Jun Wang

Despite significant advancements of deep learning-based forgery detectors for distinguishing manipulated deepfake images, most detection approaches suffer from moderate to significant performance degradation with low-quality compressed…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Binh M. Le , Simon S. Woo

Surface defect detection is one of the most essential processes for industrial quality inspection. Deep learning-based surface defect detection methods have shown great potential. However, the well-performed models usually require large…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Chen Sun , Liang Gao , Xinyu Li , Yiping Gao

Knowledge distillation (KD) represents a vital mechanism to transfer expertise from complex teacher networks to efficient student models. However, in decentralized or secure AI ecosystems, privacy regulations and proprietary interests often…

Machine Learning · Computer Science 2026-04-29 Tri-Nhan Vo , Dang Nguyen , Trung Le , Kien Do , Sunil Gupta

Face image quality assessment (FIQA) attempts to improve face recognition (FR) performance by providing additional information about sample quality. Because FIQA methods attempt to estimate the utility of a sample for face recognition, it…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Žiga Babnik , Vitomir Štruc

Modern face recognition (FR) models excel in constrained scenarios, but often suffer from decreased performance when deployed in unconstrained (real-world) environments due to uncertainties surrounding the quality of the captured facial…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Žiga Babnik , Peter Peer , Vitomir Štruc

With the rapid development of artificial intelligence (AI), especially in the medical field, the need for its explainability has grown. In medical image analysis, a high degree of transparency and model interpretability can help clinicians…

Artificial Intelligence · Computer Science 2025-02-25 Yuchen Jiang , Xinyuan Zhao , Yihang Wu , Ahmad Chaddad

Knowledge distillation (KD) is a widely-used technique that utilizes large networks to improve the performance of compact models. Previous KD approaches usually aim to guide the student to mimic the teacher's behavior completely in the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yuge Huang , Jiaxiang Wu , Xingkun Xu , Shouhong Ding

We survey various knowledge distillation (KD) strategies for simple classification tasks and implement a set of techniques that claim state-of-the-art accuracy. Our experiments using standardized model architectures, fixed compute budgets,…

Machine Learning · Computer Science 2019-12-24 Fabian Ruffy , Karanbir Chahal

Advanced change detection techniques primarily target image pairs of equal and high quality. However, variations in imaging conditions and platforms frequently lead to image pairs with distinct qualities: one image being high-quality, while…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Chao Pang , Xingxing Weng , Jiang Wu , Qiang Wang , Gui-Song Xia

The domain of computer vision has experienced significant advancements in facial-landmark detection, becoming increasingly essential across various applications such as augmented reality, facial recognition, and emotion analysis. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zong-Wei Hong , Yu-Chen Lin

In recent years, Face Image Quality Assessment (FIQA) has become an indispensable part of the face recognition system to guarantee the stability and reliability of recognition performance in an unconstrained scenario. For this purpose, the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Fu-Zhao Ou , Xingyu Chen , Ruixin Zhang , Yuge Huang , Shaoxin Li , Jilin Li , Yong Li , Liujuan Cao , Yuan-Gen Wang

We propose a novel knowledge distillation approach, CustomKD, that effectively leverages large vision foundation models (LVFMs) to enhance the performance of edge models (e.g., MobileNetV3). Despite recent advancements in LVFMs, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jungsoo Lee , Debasmit Das , Munawar Hayat , Sungha Choi , Kyuwoong Hwang , Fatih Porikli

An accurate computational model for image quality assessment (IQA) benefits many vision applications, such as image filtering, image processing, and image generation. Although the study of face images is an important subfield in computer…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Shaolin Su , Hanhe Lin , Vlad Hosu , Oliver Wiedemann , Jinqiu Sun , Yu Zhu , Hantao Liu , Yanning Zhang , Dietmar Saupe