English
Related papers

Related papers: Multi-level Knowledge Distillation via Knowledge A…

200 papers

Knowledge distillation (KD) has become a widely used technique in the field of model compression, which aims to transfer knowledge from a large teacher model to a lightweight student model for efficient network development. In addition to…

Machine Learning · Computer Science 2024-04-08 Weichao Lan , Yiu-ming Cheung , Qing Xu , Buhua Liu , Zhikai Hu , Mengke Li , Zhenghua Chen

Knowledge distillation aims to transfer knowledge to the student model by utilizing the predictions/features of the teacher model, and feature-based distillation has recently shown its superiority over logit-based distillation. However, due…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Shuoxi Zhang , Hanpeng Liu , John E. Hopcroft , Kun He

Knowledge distillation (KD) is generally considered as a technique for performing model compression and learned-label smoothing. However, in this paper, we study and investigate the KD approach from a new perspective: we study its efficacy…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Nandan Kumar Jha , Rajat Saini , Sparsh Mittal

Deep neural networks (DNNs) have improved NLP tasks significantly, but training and maintaining such networks could be costly. Model compression techniques, such as, knowledge distillation (KD), have been proposed to address the issue;…

Computation and Language · Computer Science 2023-11-08 Manas Mohanty , Tanya Roosta , Peyman Passban

Knowledge distillation (KD) is a core component in the training and deployment of modern generative models, particularly large language models (LLMs). While its empirical benefits are well documented -- enabling smaller student models to…

Machine Learning · Computer Science 2026-01-16 Sungmin Cha , Kyunghyun Cho

Despite the success of Deep Learning (DL), the deployment of modern DL models requiring large computational power poses a significant problem for resource-constrained systems. This necessitates building compact networks that reduce…

Machine Learning · Computer Science 2020-06-24 Akshay Kulkarni , Navid Panchi , Sharath Chandra Raparthy , Shital Chiddarwar

Knowledge Distillation (KD) has emerged as a promising approach for transferring knowledge from a larger, more complex teacher model to a smaller student model. Traditionally, KD involves training the student to mimic the teacher's output…

Machine Learning · Computer Science 2024-10-03 Noel Loo , Fotis Iliopoulos , Wei Hu , Erik Vee

Knowledge distillation (KD) is a popular method of transferring knowledge from a large "teacher" model to a small "student" model. Previous work has explored various layer-selection strategies (e.g., forward matching and in-order random…

Machine Learning · Computer Science 2025-12-11 Zony Yu , Yuqiao Wen , Lili Mou

In the field of large language models (LLMs), Knowledge Distillation (KD) is a critical technique for transferring capabilities from teacher models to student models. However, existing KD methods face limitations and challenges in…

Computation and Language · Computer Science 2025-04-08 Yixing Li , Yuxian Gu , Li Dong , Dequan Wang , Yu Cheng , Furu Wei

Deep learning models, particularly recurrent neural networks and their variants, such as long short-term memory, have significantly advanced time series data analysis. These models capture complex, sequential patterns in time series,…

Machine Learning · Computer Science 2026-01-12 Nilushika Udayangani , Kishor Nandakishor , Marimuthu Palaniswami

Several recent studies have elucidated why knowledge distillation (KD) improves model performance. However, few have researched the other advantages of KD in addition to its improving model performance. In this study, we have attempted to…

Machine Learning · Computer Science 2023-05-26 Hyeongrok Han , Siwon Kim , Hyun-Soo Choi , Sungroh Yoon

Multi-teacher Knowledge Distillation (KD) transfers diverse knowledge from a teacher pool to a student network. The core problem of multi-teacher KD is how to balance distillation strengths among various teachers. Most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Chuanguang Yang , Xinqiang Yu , Han Yang , Zhulin An , Chengqing Yu , Libo Huang , Yongjun Xu

Deep neural networks have achieved remarkable performance for artificial intelligence tasks. The success behind intelligent systems often relies on large-scale models with high computational complexity and storage costs. The…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Chuanguang Yang , Xinqiang Yu , Zhulin An , Yongjun Xu

In recent years, deep learning has spread rapidly, and deeper, larger models have been proposed. However, the calculation cost becomes enormous as the size of the models becomes larger. Various techniques for compressing the size of the…

Machine Learning · Computer Science 2020-04-20 Hideki Oki , Motoshi Abe , Junichi Miyao , Takio Kurita

Knowledge distillation (KD) is an effective framework that aims to transfer meaningful information from a large teacher to a smaller student. Generally, KD often involves how to define and transfer knowledge. Previous KD methods often focus…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Chuanguang Yang , Zhulin An , Linhang Cai , Yongjun Xu

Large Vision-Language Models (VLMs) are successful in addressing a multitude of vision-language understanding tasks, such as Visual Question Answering (VQA), but their memory and compute requirements remain a concern for practical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nikolaos Gkalelis , Vasileios Mezaris

Knowledge Distillation (KD) is a common method for transferring the ``knowledge'' learned by one machine learning model (the \textit{teacher}) into another model (the \textit{student}), where typically, the teacher has a greater capacity…

Machine Learning · Computer Science 2020-04-21 Jie Fu , Xue Geng , Zhijian Duan , Bohan Zhuang , Xingdi Yuan , Adam Trischler , Jie Lin , Chris Pal , Hao Dong

Knowledge distillation transfers knowledge from large teacher models to smaller students for efficient inference. While existing methods primarily focus on distillation strategies, they often overlook the importance of enhancing teacher…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xin Zhang , Jianyang Xu , Hao Peng , Dongjing Wang , Jingyuan Zheng , Yu Li , Yuyu Yin , Hongbo Wang

Knowledge distillation constitutes a potent methodology for condensing substantial neural networks into more compact and efficient counterparts. Within this context, softmax regression representation learning serves as a widely embraced…

Machine Learning · Computer Science 2024-02-12 Huayu Li , Xiwen Chen , Gregory Ditzler , Janet Roveda , Ao Li

Knowledge distillation (KD) is a common approach to compress a teacher model to reduce its inference cost and memory footprint, by training a smaller student model. However, in the context of autoregressive language models (LMs), we…

Computation and Language · Computer Science 2024-06-18 Qihuang Zhong , Liang Ding , Li Shen , Juhua Liu , Bo Du , Dacheng Tao