English
Related papers

Related papers: Learning from a Lightweight Teacher for Efficient …

200 papers

Knowledge Distillation (KD) is a common method for transferring the ``knowledge'' learned by one machine learning model (the \textit{teacher}) into another model (the \textit{student}), where typically, the teacher has a greater capacity…

Machine Learning · Computer Science 2020-04-21 Jie Fu , Xue Geng , Zhijian Duan , Bohan Zhuang , Xingdi Yuan , Adam Trischler , Jie Lin , Chris Pal , Hao Dong

Knowledge Distillation (KD) is a promising technique for reducing the high computational demand of large language models (LLMs). However, previous KD methods are primarily applied to white-box classification models or training small models…

Computation and Language · Computer Science 2026-02-03 Yuxian Gu , Li Dong , Furu Wei , Minlie Huang

Although Deep neural networks (DNNs) have shown a strong capacity to solve large-scale problems in many areas, such DNNs are hard to be deployed in real-world systems due to their voluminous parameters. To tackle this issue, Teacher-Student…

Machine Learning · Computer Science 2023-08-09 Chengming Hu , Xuan Li , Dan Liu , Haolun Wu , Xi Chen , Ju Wang , Xue Liu

Knowledge distillation, aimed at transferring the knowledge from a heavy teacher network to a lightweight student network, has emerged as a promising technique for compressing neural networks. However, due to the capacity gap between the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Xuewei Li , Songyuan Li , Bourahla Omar , Fei Wu , Xi Li

Knowledge distillation is widely applied in various fundamental vision models to enhance the performance of compact models. Existing knowledge distillation methods focus on designing different distillation targets to acquire knowledge from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Yaoze Zhang , Yuming Zhang , Yu Zhao , Yue Zhang , Feiyu Zhu

Knowledge distillation field delicately designs various types of knowledge to shrink the performance gap between compact student and large-scale teacher. These existing distillation approaches simply focus on the improvement of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Xuanyang Zhang , Xiangyu Zhang , Jian Sun

Existing Knowledge Distillation (KD) methods often align feature information between teacher and student by exploring meaningful feature processing and loss functions. However, due to the difference in feature distributions between the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yu Wang , Chuanguang Yang , Zhulin An , Weilun Feng , Jiarui Zhao , Chengqing Yu , Libo Huang , Boyu Diao , Yongjun Xu

This work introduces a novel knowledge distillation framework for classification tasks where information on existing subclasses is available and taken into consideration. In classification tasks with a small number of classes or binary…

Machine Learning · Computer Science 2022-07-06 Ahmad Sajedi , Konstantinos N. Plataniotis

Knowledge distillation in machine learning is the process of transferring knowledge from a large model called the teacher to a smaller model called the student. Knowledge distillation is one of the techniques to compress the large network…

Machine Learning · Computer Science 2022-06-27 Durga Prasad Ganta , Himel Das Gupta , Victor S. Sheng

Knowledge distillation (KD) is a widely-used technique that utilizes large networks to improve the performance of compact models. Previous KD approaches usually aim to guide the student to mimic the teacher's behavior completely in the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yuge Huang , Jiaxiang Wu , Xingkun Xu , Shouhong Ding

The improvement in the performance of efficient and lightweight models (i.e., the student model) is achieved through knowledge distillation (KD), which involves transferring knowledge from more complex models (i.e., the teacher model).…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Seonghak Kim , Gyeongdo Ham , Yucheol Cho , Daeshik Kim

Temperature plays a pivotal role in moderating label softness in the realm of knowledge distillation (KD). Traditional approaches often employ a static temperature throughout the KD process, which fails to address the nuanced complexities…

Machine Learning · Computer Science 2024-04-22 Yukang Wei , Yu Bai

In this research, we propose an innovative method to boost Knowledge Distillation efficiency without the need for resource-heavy teacher models. Knowledge Distillation trains a smaller ``student'' model with guidance from a larger…

Machine Learning · Computer Science 2024-04-16 Divyang Doshi , Jung-Eun Kim

Knowledge distillation (KD) has emerged as a promising technique in deep learning, typically employed to enhance a compact student network through learning from their high-performance but more complex teacher variant. When applied in the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Yuxuan Jiang , Chen Feng , Fan Zhang , David Bull

Knowledge distillation (KD) has shown great promise in transferring knowledge from larger teacher models to smaller student models. However, existing KD strategies for large language models often minimize output distributions between…

Computation and Language · Computer Science 2024-12-23 Yuncheng Song , Liang Ding , Changtong Zan , Shujian Huang

Does Knowledge Distillation (KD) really work? Conventional wisdom viewed it as a knowledge transfer procedure where a perfect mimicry of the student to its teacher is desired. However, paradoxical studies indicate that closely replicating…

Machine Learning · Computer Science 2024-05-03 Chenqi Guo , Shiwei Zhong , Xiaofeng Liu , Qianli Feng , Yinglong Ma

Knowledge Distillation (KD) transfers the knowledge from a high-capacity teacher model to promote a smaller student model. Existing efforts guide the distillation by matching their prediction logits, feature embedding, etc., while leaving…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yiyang Liu , Chenxin Li , Xiaotong Tu , Xinghao Ding , Yue Huang

Knowledge distillation (KD) is a technique that compresses large teacher models by training smaller student models to mimic them. The success of KD in auto-regressive language models mainly relies on Reverse KL for mode-seeking and…

Computation and Language · Computer Science 2024-09-23 Jun Rao , Xuebo Liu , Zepeng Lin , Liang Ding , Jing Li , Dacheng Tao , Min Zhang

Knowledge distillation (KD) is an effective method for model compression and transferring knowledge between models. However, its effect on model's robustness against spurious correlations that degrade performance on out-of-distribution data…

Machine Learning · Computer Science 2025-10-31 Jiali Cheng , Chirag Agarwal , Hadi Amiri

Spatiotemporal forecasting often relies on computationally intensive models to capture complex dynamics. Knowledge distillation (KD) has emerged as a key technique for creating lightweight student models, with recent advances like…

Machine Learning · Computer Science 2025-12-02 Wenshuo Wang , Yaomin Shen , Yingjie Tan , Yihao Chen