English
Related papers

Related papers: Progressive Class-level Distillation

200 papers

Recent advances in knowledge distillation (KD) have enabled smaller student models to approach the performance of larger teacher models. However, popular methods such as supervised KD and on-policy KD, are adversely impacted by the…

Computation and Language · Computer Science 2025-04-29 Wenda Xu , Rujun Han , Zifeng Wang , Long T. Le , Dhruv Madeka , Lei Li , William Yang Wang , Rishabh Agarwal , Chen-Yu Lee , Tomas Pfister

Recent advances in knowledge distillation (KD) predominantly emphasize feature-level knowledge transfer, frequently overlooking critical information embedded within the teacher's logit distributions. In this paper, we revisit logit-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Qi Wang , Jinjia Zhou

Large language models (LLMs) have significantly advanced various natural language processing tasks, but deploying them remains computationally expensive. Knowledge distillation (KD) is a promising solution, enabling the transfer of…

Computation and Language · Computer Science 2024-10-22 Yuhang Zhou , Jing Zhu , Paiheng Xu , Xiaoyu Liu , Xiyao Wang , Danai Koutra , Wei Ai , Furong Huang

Knowledge distillation has proven effective for model compression by transferring knowledge from a larger network called the teacher to a smaller network called the student. Current knowledge distillation in time series is predominantly…

Machine Learning · Computer Science 2026-01-12 Nilushika Udayangani Hewa Dehigahawattage , Kishor Nandakishor , Marimuthu Palaniswami

Knowledge Distillation (KD) compresses large language models (LLMs) by transferring the teacher model's capabilities to a smaller student model, reducing inference cost and memory usage while maintaining performance. However, existing KD…

Computation and Language · Computer Science 2025-06-11 Lingyuan Liu , Mengxiang Zhang

Knowledge Distillation (KD) uses the teacher's prediction logits as soft labels to guide the student, while self-KD does not need a real teacher to require the soft labels. This work unifies the formulations of the two tasks by decomposing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Zhendong Yang , Ailing Zeng , Zhe Li , Tianke Zhang , Chun Yuan , Yu Li

Knowledge Distillation (KD) refers to transferring knowledge from a large model to a smaller one, which is widely used to enhance model performance in machine learning. It tries to align embedding spaces generated from the teacher and the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Weidong Shi , Guanghui Ren , Yunpeng Chen , Shuicheng Yan

Knowledge distillation can be a cost-effective technique to distill knowledge in Large Language Models, if the teacher output logits can be pre-computed and cached. However, successfully applying this to pre-training remains largely…

Machine Learning · Computer Science 2025-07-25 Anshumann , Mohd Abbas Zaidi , Akhil Kedia , Jinwoo Ahn , Taehwak Kwon , Kangwook Lee , Haejun Lee , Joohyung Lee

Knowledge distillation is to transfer the knowledge from the data learned by the teacher network to the student network, so that the student has the advantage of less parameters and less calculations, and the accuracy is close to the…

Machine Learning · Computer Science 2020-06-03 Zaida Zhou , Chaoran Zhuge , Xinwei Guan , Wen Liu

Knowledge distillation is a popular approach for enhancing the performance of ''student'' models, with lower representational capacity, by taking advantage of more powerful ''teacher'' models. Despite its apparent simplicity and widespread…

Machine Learning · Computer Science 2023-12-12 Mher Safaryan , Alexandra Peste , Dan Alistarh

In the knowledge distillation literature, feature-based methods have dominated due to their ability to effectively tap into extensive teacher models. In contrast, logit-based approaches, which aim to distill "dark knowledge" from teachers,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Md. Ismail Hossain , M M Lutfe Elahi , Sameera Ramasinghe , Ali Cheraghian , Fuad Rahman , Nabeel Mohammed , Shafin Rahman

Cross-tokenizer distillation (CTD), the transfer of knowledge from a teacher to a student language model when the two use different tokenizers, remains a largely unsolved problem. Existing approaches rely on heuristic strategies to align…

Computation and Language · Computer Science 2026-04-14 Avyav Kumar Singh , Yen-Chen Wu , Alexandru Cioba , Alberto Bernacchia , Davide Buffelli

Existing knowledge distillation methods generally use a teacher-student approach, where the student network solely learns from a well-trained teacher. However, this approach overlooks the inherent differences in learning abilities between…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Long Liu , Tong Li , Hui Cheng

Knowledge Distillation (KD) has emerged as a pivotal technique for neural network compression and performance enhancement. Most KD methods aim to transfer dark knowledge from a cumbersome teacher model to a lightweight student model based…

Machine Learning · Computer Science 2024-10-10 Wenqi Niu , Yingchao Wang , Guohui Cai , Hanpo Hou

Knowledge distillation is considered as a training and compression strategy in which two neural networks, namely a teacher and a student, are coupled together during training. The teacher network is supposed to be a trustworthy predictor…

Computation and Language · Computer Science 2020-12-29 Peyman Passban , Yimeng Wu , Mehdi Rezagholizadeh , Qun Liu

We address the challenge of producing trustworthy and accurate compact models for edge devices. While Knowledge Distillation (KD) has improved model compression in terms of achieving high accuracy performance, calibration of these compact…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Ibtihel Amara , Nazanin Sepahvand , Brett H. Meyer , Warren J. Gross , James J. Clark

Knowledge distillation (KD) has been extensively studied in single-label image classification. However, its efficacy for multi-label classification remains relatively unexplored. In this study, we firstly investigate the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Youcai Zhang , Yuzhuo Qin , Hengwei Liu , Yanhao Zhang , Yaqian Li , Xiaodong Gu

Knowledge distillation is an effective way to transfer knowledge from a strong teacher to an efficient student model. Ideally, we expect the better the teacher is, the better the student. However, this expectation does not always come true.…

Information Retrieval · Computer Science 2023-06-27 Zhenghao Lin , Yeyun Gong , Xiao Liu , Hang Zhang , Chen Lin , Anlei Dong , Jian Jiao , Jingwen Lu , Daxin Jiang , Rangan Majumder , Nan Duan

Knowledge distillation aims at transferring the knowledge from a large teacher model to a small student model with great improvements of the performance of the student model. Therefore, the student network can replace the teacher network to…

Machine Learning · Computer Science 2021-12-28 Jinhong Lin , Zhaoyang Li

Discrete diffusion models (DDMs) have shown powerful generation ability for discrete data modalities like text and molecules. However, their practical application is hindered by inefficient sampling, requiring a large number of sampling…

Machine Learning · Computer Science 2025-09-25 Feiyang Fu , Tongxian Guo , Zhaoqiang Liu