English
Related papers

Related papers: Multi-level Knowledge Distillation via Knowledge A…

200 papers

To reduce a model size but retain performance, we often rely on knowledge distillation (KD) which transfers knowledge from a large "teacher" model to a smaller "student" model. However, KD on multimodal datasets such as vision-language…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Woojeong Jin , Maziar Sanjabi , Shaoliang Nie , Liang Tan , Xiang Ren , Hamed Firooz

Knowledge distillation (KD) is a key technique for compressing large language models into smaller ones while preserving performance. Despite the recent traction of KD research, its effectiveness for smaller language models (LMs) and the…

Computation and Language · Computer Science 2025-08-05 Suhas Kamasetty Ramesh , Ayan Sengupta , Tanmoy Chakraborty

Pre-trained language models have been applied to various NLP tasks with considerable performance gains. However, the large model sizes, together with the long inference time, limit the deployment of such models in real-time applications.…

Computation and Language · Computer Science 2022-11-03 Haojie Pan , Chengyu Wang , Minghui Qiu , Yichang Zhang , Yaliang Li , Jun Huang

Knowledge Distillation (KD) aims at improving the performance of a low-capacity student model by inheriting knowledge from a high-capacity teacher model. Previous KD methods typically train a student by minimizing a task-related loss and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Mengya Gao , Yujun Shen , Quanquan Li , Junjie Yan , Liang Wan , Dahua Lin , Chen Change Loy , Xiaoou Tang

Collaborative learning has emerged as a key paradigm in large-scale intelligent systems, enabling distributed agents to cooperatively train their models while addressing their privacy concerns. Central to this paradigm is knowledge…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-24 Pengchao Han , Xi Huang , Yi Fang , Guojun Han

Mixup is a popular data augmentation technique based on creating new samples by linear interpolation between two given data samples, to improve both the generalization and robustness of the trained model. Knowledge distillation (KD), on the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Hongjun Choi , Eun Som Jeon , Ankita Shukla , Pavan Turaga

Knowledge distillation is initially introduced to utilize additional supervision from a single teacher model for the student model training. To boost the student performance, some recent variants attempt to exploit diverse knowledge sources…

Machine Learning · Computer Science 2022-02-15 Hailin Zhang , Defang Chen , Can Wang

Multi-Teacher knowledge distillation provides students with additional supervision from multiple pre-trained teachers with diverse information sources. Most existing methods explore different weighting strategies to obtain a powerful…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Hailin Zhang , Defang Chen , Can Wang

Knowledge distillation (KD) is a widely adopted approach for compressing large neural networks by transferring knowledge from a large teacher model to a smaller student model. In the context of large language models, token level KD,…

Computation and Language · Computer Science 2025-09-19 Yihan Cao , Yanbin Kang , Zhengming Xing , Ruijie Jiang

Incremental learning targets at achieving good performance on new categories without forgetting old ones. Knowledge distillation has been shown critical in preserving the performance on old classes. Conventional methods, however,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Peng Zhou , Long Mai , Jianming Zhang , Ning Xu , Zuxuan Wu , Larry S. Davis

Knowledge distillation (KD) is a promising yet challenging model compression technique that transfers rich learning representations from a well-performing but cumbersome teacher model to a compact student model. Previous methods for image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Simiao Li , Yun Zhang , Wei Li , Hanting Chen , Wenjia Wang , Bingyi Jing , Shaohui Lin , Jie Hu

Knowledge distillation (KD) is widely used for training a compact model with the supervision of another large model, which could effectively improve the performance. Previous methods mainly focus on two aspects: 1) training the student to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Tiancheng Wen , Shenqi Lai , Xueming Qian

Knowledge distillation (KD) is a machine learning framework that transfers knowledge from a teacher model to a student model. The vanilla KD proposed by Hinton et al. has been the dominant approach in logit-based distillation and…

Machine Learning · Computer Science 2026-05-01 Jiangnan Zhu , Yukai Xu , Li Xiong , Yixuan Liu , Junxu Liu , Hong kyu Lee , Yujie Gu

Compact models can be effectively trained through Knowledge Distillation (KD), a technique that transfers knowledge from larger, high-performing teacher models. Two key challenges in Knowledge Distillation (KD) are: 1) balancing learning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zeeshan Hayder , Ali Cheraghian , Lars Petersson , Mehrtash Harandi

Knowledge distillation (KD) is an effective method for model compression and transferring knowledge between models. However, its effect on model's robustness against spurious correlations that degrade performance on out-of-distribution data…

Machine Learning · Computer Science 2025-10-31 Jiali Cheng , Chirag Agarwal , Hadi Amiri

Knowledge Distillation (KD) is a model compression algorithm that helps transfer the knowledge of a large neural network into a smaller one. Even though KD has shown promise on a wide range of Natural Language Processing (NLP) applications,…

Computation and Language · Computer Science 2021-09-21 Tianda Li , Ahmad Rashid , Aref Jafari , Pranav Sharma , Ali Ghodsi , Mehdi Rezagholizadeh

Typical technique in knowledge distillation (KD) is regularizing the learning of a limited capacity model (student) by pushing its responses to match a powerful model's (teacher). Albeit useful especially in the penultimate layer and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Ada Gorgun , Yeti Z. Gurbuz , A. Aydin Alatan

Knowledge Distillation (KD) is a powerful technique for transferring knowledge between neural network models, where a pre-trained teacher model is used to facilitate the training of the target student model. However, the availability of a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Xucong Wang , Pengchao Han , Lei Guo

Existing knowledge distillation methods generally use a teacher-student approach, where the student network solely learns from a well-trained teacher. However, this approach overlooks the inherent differences in learning abilities between…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Long Liu , Tong Li , Hui Cheng

Knowledge distillation (KD) has shown great promise in transferring knowledge from larger teacher models to smaller student models. However, existing KD strategies for large language models often minimize output distributions between…

Computation and Language · Computer Science 2024-12-23 Yuncheng Song , Liang Ding , Changtong Zan , Shujian Huang