English
Related papers

Related papers: CLIP-RD: Relative Distillation for Efficient CLIP …

200 papers

Large neural models (such as Transformers) achieve state-of-the-art performance for information retrieval (IR). In this paper, we aim to improve distillation methods that pave the way for the resource-efficient deployment of such models in…

Despite exciting progress in pre-training for visual-linguistic (VL) representations, very few aspire to a small VL model. In this paper, we study knowledge distillation (KD) to effectively compress a transformer-based large VL model into a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Zhiyuan Fang , Jianfeng Wang , Xiaowei Hu , Lijuan Wang , Yezhou Yang , Zicheng Liu

Contrastive Language-Image Pre-training (CLIP) models excel in integrating semantic information between images and text through contrastive learning techniques. It has achieved remarkable performance in various multimodal tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yifan Chen , Xiaozhen Qiao , Zhe Sun , Xuelong Li

With the rapid development of computer vision, Vision Transformers (ViTs) offer the tantalising prospect of unified information processing across visual and textual domains due to the lack of inherent inductive biases in ViTs. ViTs require…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Gousia Habib , Tausifa Jan Saleem , Ishfaq Ahmad Malik , Brejesh Lall

This paper proposes a content relationship distillation (CRD) to tackle the over-parameterized generative adversarial networks (GANs) for the serviceability in cutting-edge devices. In contrast to traditional instance-level distillation, we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Lizhou You , Mingbao Lin , Tie Hu , Fei Chao , Rongrong Ji

Knowledge Distillation (KD) has emerged as a pivotal technique for neural network compression and performance enhancement. Most KD methods aim to transfer dark knowledge from a cumbersome teacher model to a lightweight student model based…

Machine Learning · Computer Science 2024-10-10 Wenqi Niu , Yingchao Wang , Guohui Cai , Hanpo Hou

Recognizing objects in low-resolution images is a challenging task due to the lack of informative details. Recent studies have shown that knowledge distillation approaches can effectively transfer knowledge from a high-resolution teacher…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Kangkai Zhang , Shiming Ge , Ruixin Shi , Dan Zeng

Knowledge distillation is an effective method for model compression. However, it is still a challenging topic to apply knowledge distillation to detection tasks. There are two key points resulting in poor distillation performance for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Zhenliang Ni , Fukui Yang , Shengzhao Wen , Gang Zhang

Knowledge distillation (KD) is a machine learning framework that transfers knowledge from a teacher model to a student model. The vanilla KD proposed by Hinton et al. has been the dominant approach in logit-based distillation and…

Machine Learning · Computer Science 2026-05-01 Jiangnan Zhu , Yukai Xu , Li Xiong , Yixuan Liu , Junxu Liu , Hong kyu Lee , Yujie Gu

The primary goal of knowledge distillation (KD) is to encapsulate the information of a model learned from a teacher network into a student network, with the latter being more compact than the former. Existing work, e.g., using…

Machine Learning · Computer Science 2021-03-30 Liqun Chen , Dong Wang , Zhe Gan , Jingjing Liu , Ricardo Henao , Lawrence Carin

Knowledge distillation (KD) has emerged as a promising technique for addressing the computational challenges associated with deploying large-scale recommender systems. KD transfers the knowledge of a massive teacher system to a compact…

Information Retrieval · Computer Science 2024-06-27 Gyuseok Lee , SeongKu Kang , Wonbin Kweon , Hwanjo Yu

Training VideoLLMs for complex reasoning remains challenging due to sparse sequence level rewards and the lack of fine grained credit assignment over long, temporally grounded reasoning trajectories. While reinforcement learning with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hao Lin , Kunyang Lv , Xu Jiang , Jingqi Tian , Zhongjing Du , Jiayu Ding , Qiaoman Zhang , Hongbo Jin

This work explores knowledge distillation (KD) for visually-rich document (VRD) applications such as document layout analysis (DLA) and document image classification (DIC). While VRD research is dependent on increasingly sophisticated and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jordy Van Landeghem , Subhajit Maity , Ayan Banerjee , Matthew Blaschko , Marie-Francine Moens , Josep Lladós , Sanket Biswas

The recent large-scale vision-language pre-training (VLP) of dual-stream architectures (e.g., CLIP) with a tremendous amount of image-text pair data, has shown its superiority on various multimodal alignment tasks. Despite its success, the…

Computation and Language · Computer Science 2022-03-31 Wenliang Dai , Lu Hou , Lifeng Shang , Xin Jiang , Qun Liu , Pascale Fung

Heterogeneous distillation is an effective way to transfer knowledge from cross-architecture teacher models to student models. However, existing heterogeneous distillation methods do not take full advantage of the dark knowledge hidden in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yaoxin Yang , Peng Ye , Weihao Lin , Kangcong Li , Yan Wen , Jia Hao , Tao Chen

Knowledge distillation aims to transfer knowledge from a large teacher model to a compact student counterpart, often coming with a significant performance gap between them. We find that a too-large performance gap can hamper the training…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yong Guo , Shulian Zhang , Haolin Pan , Jing Liu , Yulun Zhang , Jian Chen

The widespread deployment of Large Language Models (LLMs) is hindered by the high computational demands, making knowledge distillation (KD) crucial for developing compact smaller ones. However, the conventional KD methods endure the…

Computation and Language · Computer Science 2025-02-18 Zengkui Sun , Yijin Liu , Fandong Meng , Yufeng Chen , Jinan Xu , Jie Zhou

Previous knowledge distillation (KD) methods mostly focus on compressing network architectures, which is not thorough enough in deployment as some costs like transmission bandwidth and imaging equipment are related to the image size.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Guangyu Guo , Dingwen Zhang , Longfei Han , Nian Liu , Ming-Ming Cheng , Junwei Han

Referring image segmentation (RIS) requires accurate segmentation of target regions in images according to language descriptions, which is a cross-modal task integrating vision and language. Existing RIS methods typically employ large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chen Yang

Instance-aware embeddings predicted by deep neural networks have revolutionized biomedical instance segmentation, but its resource requirements are substantial. Knowledge distillation offers a solution by transferring distilled knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Xiaoyu Liu , Yueyi Zhang , Zhiwei Xiong , Wei Huang , Bo Hu , Xiaoyan Sun , Feng Wu