English
Related papers

Related papers: Improving Knowledge Distillation via Transferring …

200 papers

Knowledge distillation, transferring knowledge from a teacher model to a student model, has emerged as a powerful technique in neural machine translation for compressing models or simplifying training targets. Knowledge distillation…

Computation and Language · Computer Science 2024-04-24 Jingxuan Wei , Linzhuang Sun , Yichong Leng , Xu Tan , Bihui Yu , Ruifeng Guo

Despite the fact that deep neural networks are powerful models and achieve appealing results on many tasks, they are too large to be deployed on edge devices like smartphones or embedded sensor nodes. There have been efforts to compress…

Machine Learning · Computer Science 2019-12-18 Seyed-Iman Mirzadeh , Mehrdad Farajtabar , Ang Li , Nir Levine , Akihiro Matsukawa , Hassan Ghasemzadeh

Online Knowledge Distillation (OKD) improves the involved models by reciprocally exploiting the difference between teacher and student. Several crucial bottlenecks over the gap between them -- e.g., Why and when does a large gap harm the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Biao Qian , Yang Wang , Hongzhi Yin , Richang Hong , Meng Wang

Knowledge Distillation (KD) is an effective framework for compressing deep learning models, realized by a student-teacher paradigm requiring small student networks to mimic the soft target generated by well-trained teachers. However, the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Yuang Liu , Wei Zhang , Jun Wang

Knowledge distillation involves transferring knowledge from large, cumbersome teacher models to more compact student models. The standard approach minimizes the Kullback-Leibler (KL) divergence between the probabilistic outputs of a teacher…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Nikolaos Giakoumoglou , Tania Stathaki

Knowledge distillation transfers knowledge from a high capacity teacher to a compact student using a mixture of hard and soft losses. On imbalanced data, a fixed weighting between hard and soft losses becomes brittle the learning process.…

Machine Learning · Computer Science 2026-05-20 Anh B. H. Nguyen , Ba Tho Phan , Viet Cuong Ta

Knowledge Distillation (KD) transfers knowledge from a large pre-trained teacher network to a compact and efficient student network, making it suitable for deployment on resource-limited media terminals. However, traditional KD methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Xinlei Huang , Jialiang Tang , Xubin Zheng , Jinjia Zhou , Wenxin Yu , Ning Jiang

The improvement in the performance of efficient and lightweight models (i.e., the student model) is achieved through knowledge distillation (KD), which involves transferring knowledge from more complex models (i.e., the teacher model).…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Seonghak Kim , Gyeongdo Ham , Yucheol Cho , Daeshik Kim

Knowledge distillation (KD) has emerged as a promising technique for addressing the computational challenges associated with deploying large-scale recommender systems. KD transfers the knowledge of a massive teacher system to a compact…

Information Retrieval · Computer Science 2024-06-27 Gyuseok Lee , SeongKu Kang , Wonbin Kweon , Hwanjo Yu

Knowledge distillation is a method of transferring the knowledge from a pretrained complex teacher model to a student model, so a smaller network can replace a large teacher network at the deployment stage. To reduce the necessity of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Mingi Ji , Seungjae Shin , Seunghyun Hwang , Gibeom Park , Il-Chul Moon

Knowledge distillation (KD) is an effective tool for compressing deep classification models for edge devices. However, the performance of KD is affected by the large capacity gap between the teacher and student networks. Recent methods have…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Ibtihel Amara , Maryam Ziaeefard , Brett H. Meyer , Warren Gross , James J. Clark

With ever growing scale of neural models, knowledge distillation (KD) attracts more attention as a prominent tool for neural model compression. However, there are counter intuitive observations in the literature showing some challenging…

Computation and Language · Computer Science 2021-10-19 Mehdi Rezagholizadeh , Aref Jafari , Puneeth Salad , Pranav Sharma , Ali Saheb Pasand , Ali Ghodsi

In knowledge distillation, the knowledge from the teacher model is often too complex for the student model to thoroughly process. However, good teachers in real life always simplify complex material before teaching it to students. Inspired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Mengyang Yuan , Bo Lang , Fengnan Quan

Knowledge distillation (KD) is a promising technique for model compression in neural machine translation. However, where the knowledge hides in KD is still not clear, which may hinder the development of KD. In this work, we first unravel…

Computation and Language · Computer Science 2024-07-18 Songming Zhang , Yunlong Liang , Shuaibo Wang , Wenjuan Han , Jian Liu , Jinan Xu , Yufeng Chen

Traditional knowledge distillation transfers "dark knowledge" of a pre-trained teacher network to a student network, and ignores the knowledge in the training process of the teacher, which we call teacher's experience. However, in realistic…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Chaofei Wang , Shaowei Zhang , Shiji Song , Gao Huang

The knowledge distillation uses a high-performance teacher network to guide the student network. However, the performance gap between the teacher and student networks can affect the student's training. This paper proposes a novel knowledge…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Songling Zhu , Ronghua Shang , Bo Yuan , Weitong Zhang , Yangyang Li , Licheng Jiao

Knowledge distillation (KD) is a well-known technique to effectively compress a large network (teacher) to a smaller network (student) with little sacrifice in performance. However, most KD methods require a large training set and internal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Tri-Nhan Vo , Dang Nguyen , Kien Do , Sunil Gupta

Despite its breakthrough in classification problems, Knowledge distillation (KD) to recommendation models and ranking problems has not been studied well in the previous literature. This dissertation is devoted to developing knowledge…

Information Retrieval · Computer Science 2024-07-22 SeongKu Kang

Knowledge distillation (KD) is a promising yet challenging model compression technique that transfers rich learning representations from a well-performing but cumbersome teacher model to a compact student model. Previous methods for image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Simiao Li , Yun Zhang , Wei Li , Hanting Chen , Wenjia Wang , Bingyi Jing , Shaohui Lin , Jie Hu

With the growth of computing power neural machine translation (NMT) models also grow accordingly and become better. However, they also become harder to deploy on edge devices due to memory constraints. To cope with this problem, a common…

Computation and Language · Computer Science 2020-10-08 Yimeng Wu , Peyman Passban , Mehdi Rezagholizade , Qun Liu