English
Related papers

Related papers: Two-in-one Knowledge Distillation for Efficient Fa…

200 papers

Knowledge distillation can lead to deploy-friendly networks against the plagued computational complexity problem, but previous methods neglect the feature hierarchy in detectors. Motivated by this, we propose a general framework for…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Yangyang Qin , Hefei Ling , Zhenghai He , Yuxuan Shi , Lei Wu

Deepfake detection refers to detecting artificially generated or edited faces in images or videos, which plays an essential role in visual information security. Despite promising progress in recent years, Deepfake detection remains a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Chunlei Peng , Huiqing Guo , Decheng Liu , Nannan Wang , Ruimin Hu , Xinbo Gao

Deep neural networks can capture the intricate interaction history information between queries and documents, because of their many complicated nonlinear units, allowing them to provide correct search recommendations. However, service…

Information Retrieval · Computer Science 2022-08-25 Zhitao Zhu , Shijing Si , Jianzong Wang , Yaodong Yang , Jing Xiao

Deepfake detection remains highly challenging, particularly in cross-dataset scenarios and complex real-world settings. This challenge mainly arises because artifact patterns vary substantially across different forgery methods, whereas…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xiang Zhang , Wenliang Weng , Daoyong Fu , Beijing Chen , Ziqiang Li , Ziwen He , Zhangjie Fu

Staining is essential in cell imaging and medical diagnostics but poses significant challenges, including high cost, time consumption, labor intensity, and irreversible tissue alterations. Recent advances in deep learning have enabled…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Ziwang Xu , Lanqing Guo , Satoshi Tsutsui , Shuyan Zhang , Alex C. Kot , Bihan Wen

Single-image haze removal is a long-standing hurdle for computer vision applications. Several works have been focused on transferring advances from image classification, detection, and segmentation to the niche of image dehazing, primarily…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Sai Mitheran , Anushri Suresh , Nisha J. S. , Varun P. Gopi

The rapid evolution of deepfake technologies demands robust and reliable face forgery detection algorithms. While determining whether an image has been manipulated remains essential, the ability to precisely localize forgery clues is also…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Siran Peng , Haoyuan Zhang , Li Gao , Tianshuo Zhang , Xiangyu Zhu , Bao Li , Weisong Zhao , Zhen Lei

Multi-domain fake news detection aims to identify whether various news from different domains is real or fake and has become urgent and important. However, existing methods are dedicated to improving the overall performance of fake news…

Computation and Language · Computer Science 2023-12-05 Jiayang Li , Xuan Feng , Tianlong Gu , Liang Chang

Knowledge distillation (KD) is the process of transferring knowledge from a large model to a small one. It has gained increasing attention in the natural language processing community, driven by the demands of compressing ever-growing…

Computation and Language · Computer Science 2023-07-31 Yuqiao Wen , Zichao Li , Wenyu Du , Lili Mou

We propose a unified cross-domain transfer learning framework that leverages knowledge from multiple heterogeneous medical imaging datasets to improve performance across segmentation, classification, and object detection tasks. Our approach…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Ceausescu Ciprian-Mihai , Anghelina Ion-Marian , Alexe Dumitru-Bogdan

Dataset distillation aims to distill the knowledge of a large-scale real dataset into small yet informative synthetic data such that a model trained on it performs as well as a model trained on the full dataset. Despite recent progress,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Ahmad Sajedi , Samir Khaki , Lucy Z. Liu , Ehsan Amjadian , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Recent generative models demonstrate impressive performance on synthesizing photographic images, which makes humans hardly to distinguish them from pristine ones, especially on realistic-looking synthetic facial images. Previous works…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Hao Wang , Cheng Deng , Zhidong Zhao

Splice detection models are the need of the hour since splice manipulations can be used to mislead, spread rumors and create disharmony in society. However, there is a severe lack of image splicing datasets, which restricts the capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Ankit Yadav , Dinesh Kumar Vishwakarma

State-of-the-art face recognition networks are often computationally expensive and cannot be used for mobile applications. Training lightweight face recognition models also requires large identity-labeled datasets. Meanwhile, there are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Hatef Otroshi Shahreza , Anjith George , Sébastien Marcel

Deploying medical image segmentation models in routine clinical workflows is often constrained by on-premises infrastructure, where computational resources are fixed and cloud-based inference may be restricted by governance and security…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Qizhen Lan , Aaron Choi , Jun Ma , Bo Wang , Zhaogming Zhao , Xiaoqian Jiang , Yu-Chun Hsu

In this paper, we propose a novel self-distillation method for fake speech detection (FSD), which can significantly improve the performance of FSD without increasing the model complexity. For FSD, some fine-grained information is very…

Sound · Computer Science 2023-03-03 Jun Xue , Cunhang Fan , Jiangyan Yi , Chenglong Wang , Zhengqi Wen , Dan Zhang , Zhao Lv

Knowledge distillation has emerged as a powerful technique for model compression, enabling the transfer of knowledge from large teacher networks to compact student models. However, traditional knowledge distillation methods treat all…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Aakash Gore , Anoushka Dey , Aryan Mishra

Deep learning techniques have been demonstrated to surpass preceding cutting-edge machine learning techniques in recent years, with computer vision being one of the most prominent examples. However, deep learning models suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Gousia Habib , Tausifa jan Saleem , Sheikh Musa Kaleem , Tufail Rouf , Brejesh Lall

Knowledge Distillation (KD) is a widely-used technology to inherit information from cumbersome teacher models to compact student models, consequently realizing model compression and acceleration. Compared with image classification, object…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Gang Li , Xiang Li , Yujie Wang , Shanshan Zhang , Yichao Wu , Ding Liang

Surface defect detection is one of the most essential processes for industrial quality inspection. Deep learning-based surface defect detection methods have shown great potential. However, the well-performed models usually require large…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Chen Sun , Liang Gao , Xinyu Li , Yiping Gao