English
Related papers

Related papers: SynthDistill: Face Recognition with Knowledge Dist…

200 papers

Advances in self-distillation have shown that when knowledge is distilled from a teacher to a student using the same deep learning (DL) architecture, the student performance can surpass the teacher particularly when the network is…

Machine Learning · Computer Science 2025-06-25 Muhammad Haseeb Aslam , Clara Martinez , Marco Pedersoli , Alessandro Koerich , Ali Etemad , Eric Granger

Enabling highly secure applications (such as border crossing) with face recognition requires extensive biometric performance tests through large scale data. However, using real face images raises concerns about privacy as the laws do not…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Marcel Grimmer , Haoyu Zhang , Raghavendra Ramachandra , Kiran Raja , Christoph Busch

Dataset distillation is the task of synthesizing a small dataset such that a model trained on the synthetic set will match the test accuracy of the model trained on the full dataset. In this paper, we propose a new formulation that…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 George Cazenavette , Tongzhou Wang , Antonio Torralba , Alexei A. Efros , Jun-Yan Zhu

In this paper, we propose a novel face synthesis approach that can generate an arbitrarily large number of synthetic images of both real and synthetic identities. Thus a face image dataset can be expanded in terms of the number of…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Sandipan Banerjee , John S. Bernhard , Walter J. Scheirer , Kevin W. Bowyer , Patrick J. Flynn

Over the past years, deep learning capabilities and the availability of large-scale training datasets advanced rapidly, leading to breakthroughs in face recognition accuracy. However, these technologies are foreseen to face a major…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Fadi Boutros , Vitomir Struc , Julian Fierrez , Naser Damer

Cross-resolution face recognition has become a challenging problem for modern deep face recognition systems. It aims at matching a low-resolution probe image with high-resolution gallery images registered in a database. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yuhang Lu , Touradj Ebrahimi

Dataset distillation seeks to synthesize a highly compact dataset that achieves performance comparable to the original dataset on downstream tasks. For the classification task that use pre-trained self-supervised models as backbones,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Qianxin Xia , Jiawei Du , Xin Zhang , Yuhan Zhang , Jielei Wang , Guoming Lu

Dataset distillation reduces the network training cost by synthesizing small and informative datasets from large-scale ones. Despite the success of the recent dataset distillation algorithms, three drawbacks still limit their wider…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Kai Wang , Jianyang Gu , Daquan Zhou , Zheng Zhu , Wei Jiang , Yang You

The deployment of facial recognition systems has created an ethical dilemma: achieving high accuracy requires massive datasets of real faces collected without consent, leading to dataset retractions and potential legal liabilities under…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Paweł Borsukiewicz , Fadi Boutros , Iyiola E. Olatunji , Charles Beumier , Wendkûuni C. Ouedraogo , Jacques Klein , Tegawendé F. Bissyandé

Model compression is important in federated learning (FL) with large models to reduce communication cost. Prior works have been focusing on sparsification based compression that could desparately affect the global model accuracy. In this…

Machine Learning · Computer Science 2022-04-05 Shengyuan Hu , Jack Goetz , Kshitiz Malik , Hongyuan Zhan , Zhe Liu , Yue Liu

While many deep learning models trained on private datasets have been deployed in various practical tasks, they may pose a privacy leakage risk as attackers could recover informative data or label knowledge from models. In this work, we…

Machine Learning · Computer Science 2026-01-28 Bochao Liu , Shiming Ge , Pengju Wang , Shikun Li , Tongliang Liu

In this paper, we propose a new dataset distillation method that considers balancing global structure and local details when distilling the information from a large dataset into a generative model. Dataset distillation has been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Longzhen Li , Guang Li , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Modern deep learning models in computer vision require large datasets of real images, which are difficult to curate and pose privacy and legal concerns, limiting their commercial use. Recent works suggest synthetic data as an alternative,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Farnood Salehi , Vandit Sharma , Amirhossein Askari Farsangi , Tunç Ozan Aydın

Generating synthetic datasets for training face recognition models is challenging because dataset generation entails more than creating high fidelity images. It involves generating multiple images of same subjects under different factors…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Minchul Kim , Feng Liu , Anil Jain , Xiaoming Liu

A robust face recognition model must be trained using datasets that include a large number of subjects and numerous samples per subject under varying conditions (such as pose, expression, age, noise, and occlusion). Due to ethical and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Bernardo Biesseck , Pedro Vidal , Luiz Coelho , Roger Granada , David Menotti|

Face recognition (FR) stands as one of the most crucial applications in computer vision. The accuracy of FR models has significantly improved in recent years due to the availability of large-scale human face datasets. However, directly…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Xiao Lin , Yuge Huang , Jianqing Xu , Yuxi Mi , Shuigeng Zhou , Shouhong Ding

Network quantization is an essential procedure in deep learning for development of efficient fixed-point inference models on mobile or edge platforms. However, as datasets grow larger and privacy regulations become stricter, data sharing…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Yoojin Choi , Jihwan Choi , Mostafa El-Khamy , Jungwon Lee

It is well known that deep learning approaches to face recognition and facial landmark detection suffer from biases in modern training datasets. In this work, we propose to use synthetic face images to reduce the negative effects of dataset…

Computer Vision and Pattern Recognition · Computer Science 2019-06-25 Adam Kortylewski , Bernhard Egger , Andreas Morel-Forster , Andreas Schneider , Thomas Gerig , Clemens Blumer , Corius Reyneke , Thomas Vetter

Critical obstacles in training classifiers to detect facial actions are the limited sizes of annotated video databases and the relatively low frequencies of occurrence of many actions. To address these problems, we propose an approach that…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Koichiro Niinuma , Itir Onal Ertugrul , Jeffrey F Cohn , László A Jeni

Synthetic image data generation represents a promising avenue for training deep learning models, particularly in the realm of transfer learning, where obtaining real images within a specific domain can be prohibitively expensive due to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yuhang Li , Xin Dong , Chen Chen , Jingtao Li , Yuxin Wen , Michael Spranger , Lingjuan Lyu