English
Related papers

Related papers: Expandable Residual Approximation for Knowledge Di…

200 papers

Knowledge distillation (KD) has been extensively employed to transfer the knowledge from a large teacher model to the smaller students, where the parameters of the teacher are fixed (or partially) during training. Recent studies show that…

Machine Learning · Computer Science 2022-06-01 Jun Rao , Xv Meng , Liang Ding , Shuhan Qi , Dacheng Tao

Knowledge distillation (KD) is essentially a process of transferring a teacher model's behavior, e.g., network response, to a student model. The network response serves as additional supervision to formulate the machine domain, which uses…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Yulei Niu , Long Chen , Chang Zhou , Hanwang Zhang

Recent advances in knowledge distillation (KD) have enabled smaller student models to approach the performance of larger teacher models. However, popular methods such as supervised KD and on-policy KD, are adversely impacted by the…

Computation and Language · Computer Science 2025-04-29 Wenda Xu , Rujun Han , Zifeng Wang , Long T. Le , Dhruv Madeka , Lei Li , William Yang Wang , Rishabh Agarwal , Chen-Yu Lee , Tomas Pfister

Knowledge distillation (KD) is a technique that compresses large teacher models by training smaller student models to mimic them. The success of KD in auto-regressive language models mainly relies on Reverse KL for mode-seeking and…

Computation and Language · Computer Science 2024-09-23 Jun Rao , Xuebo Liu , Zepeng Lin , Liang Ding , Jing Li , Dacheng Tao , Min Zhang

Knowledge distillation aims to learn a lightweight student network from a pre-trained teacher network. In practice, existing knowledge distillation methods are usually infeasible when the original training data is unavailable due to some…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Jialiang Tang , Shuo Chen , Gang Niu , Masashi Sugiyama , Chen Gong

Sequential recommender systems (SRS) have become a research hotspot due to its power in modeling user dynamic interests and sequential behavioral patterns. To maximize model expressive ability, a default choice is to apply a larger and…

Information Retrieval · Computer Science 2022-04-12 Lei Chen , Fajie Yuan , Jiaxi Yang , Min Yang , Chengming Li

Knowledge Distillation (KD) has emerged as a powerful technique for model compression, enabling lightweight student networks to benefit from the performance of redundant teacher networks. However, the inherent capacity gap often limits the…

Machine Learning · Computer Science 2026-02-12 Yiyun Zhou , Jingwei Shi , Mingjing Xu , Zhonghua Jiang , Jingyuan Chen

Current state-of-the-art object detectors are at the expense of high computational costs and are hard to deploy to low-end devices. Knowledge distillation, which aims at training a smaller student network by transferring knowledge from a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Ruoyu Sun , Fuhui Tang , Xiaopeng Zhang , Hongkai Xiong , Qi Tian

In this work, we propose Mutual Information Maximization Knowledge Distillation (MIMKD). Our method uses a contrastive objective to simultaneously estimate and maximize a lower bound on the mutual information of local and global feature…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Aman Shrivastava , Yanjun Qi , Vicente Ordonez

Large Vision-Language Models (VLMs) are successful in addressing a multitude of vision-language understanding tasks, such as Visual Question Answering (VQA), but their memory and compute requirements remain a concern for practical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nikolaos Gkalelis , Vasileios Mezaris

Knowledge Distillation (KD) is a fundamental technique for compressing large language models (LLMs) into compact, efficient student models. However, existing white-box KD methods mainly focus on balancing ground truth and student-generated…

Computation and Language · Computer Science 2025-08-11 Lingyuan Liu , Mengxiang Zhang

Knowledge distillation~(KD) has been proved effective for compressing large-scale pre-trained language models. However, existing methods conduct KD statically, e.g., the student model aligns its output distribution to that of a selected…

Computation and Language · Computer Science 2021-09-24 Lei Li , Yankai Lin , Shuhuai Ren , Peng Li , Jie Zhou , Xu Sun

Knowledge distillation aims at transferring the knowledge from a large teacher model to a small student model with great improvements of the performance of the student model. Therefore, the student network can replace the teacher network to…

Machine Learning · Computer Science 2021-12-28 Jinhong Lin , Zhaoyang Li

Knowledge distillation (KD) is a general neural network training approach that uses a teacher model to guide the student model. Existing works mainly study KD from the network output side (e.g., trying to design a better KD loss function),…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Huan Wang , Suhas Lohit , Mike Jones , Yun Fu

With the emergence of Mixture-of-Experts (MoE), the efficient scaling of model size has accelerated the development of large language models in recent years. However, their high memory requirements prevent their use in resource-constrained…

Computation and Language · Computer Science 2025-02-19 Gyeongman Kim , Gyouk Chu , Eunho Yang

Crossmodal knowledge distillation (KD) aims to enhance a unimodal student using a multimodal teacher model. In particular, when the teacher's modalities include the student's, additional complementary information can be exploited to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Chenqi Guo , Mengshuo Rong , Qianli Feng , Rongfan Feng , Yinglong Ma

Knowledge Distillation (KD) aims to distill the knowledge of a cumbersome teacher model into a lightweight student model. Its success is generally attributed to the privileged information on similarities among categories provided by the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Li Yuan , Francis E. H. Tay , Guilin Li , Tao Wang , Jiashi Feng

Knowledge Distillation (KD) has been extensively used for natural language understanding (NLU) tasks to improve a small model's (a student) generalization by transferring the knowledge from a larger model (a teacher). Although KD methods…

Machine Learning · Computer Science 2022-12-13 Aref Jafari , Ivan Kobyzev , Mehdi Rezagholizadeh , Pascal Poupart , Ali Ghodsi

Traditional knowledge distillation (KD) relies on a proficient teacher trained on the target task, which is not always available. In this setting, cross-task distillation can be used, enabling the use of any teacher model trained on a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Dylan Auty , Roy Miles , Benedikt Kolbeinsson , Krystian Mikolajczyk

Knowledge distillation has emerged as a highly effective method for bridging the representation discrepancy between large-scale models and lightweight models. Prevalent approaches involve leveraging appropriate metrics to minimize the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Zikai Zhou , Yunhang Shen , Shitong Shao , Linrui Gong , Shaohui Lin