English
Related papers

Related papers: Adaptive Temperature Based on Logits Correlation i…

200 papers

Knowledge distillation, transferring knowledge from a teacher model to a student model, has emerged as a powerful technique in neural machine translation for compressing models or simplifying training targets. Knowledge distillation…

Computation and Language · Computer Science 2024-04-24 Jingxuan Wei , Linzhuang Sun , Yichong Leng , Xu Tan , Bihui Yu , Ruifeng Guo

The performance of a distillation-based compressed network is governed by the quality of distillation. The reason for the suboptimal distillation of a large network (teacher) to a smaller network (student) is largely attributed to the gap…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vibhas Vats , David Crandall

Knowledge Distillation (KD) has emerged as a promising approach for transferring knowledge from a larger, more complex teacher model to a smaller student model. Traditionally, KD involves training the student to mimic the teacher's output…

Machine Learning · Computer Science 2024-10-03 Noel Loo , Fotis Iliopoulos , Wei Hu , Erik Vee

Knowledge distillation deals with the problem of training a smaller model (Student) from a high capacity source model (Teacher) so as to retain most of its performance. Existing approaches use either the training data or meta-data extracted…

Machine Learning · Computer Science 2019-05-21 Gaurav Kumar Nayak , Konda Reddy Mopuri , Vaisakh Shaj , R. Venkatesh Babu , Anirban Chakraborty

The representation gap between teacher and student is an emerging topic in knowledge distillation (KD). To reduce the gap and improve the performance, current methods often resort to complicated training schemes, loss functions, and feature…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Tao Huang , Yuan Zhang , Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Chang Xu

Knowledge distillation (KD) is a core component in the training and deployment of modern generative models, particularly large language models (LLMs). While its empirical benefits are well documented -- enabling smaller student models to…

Machine Learning · Computer Science 2026-01-16 Sungmin Cha , Kyunghyun Cho

Knowledge distillation transfers knowledge from a large model to a small one via task and distillation losses. In this paper, we observe a trade-off between task and distillation losses, i.e., introducing distillation loss limits the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Borui Zhao , Quan Cui , Renjie Song , Jiajun Liang

The challenging environment of real-time data processing systems at the Large Hadron Collider (LHC) strictly limits the computational complexity of algorithms that can be deployed. For deep learning models, this implies that only models…

High Energy Physics - Experiment · Physics 2023-11-27 Ryan Liu , Abhijith Gandrakota , Jennifer Ngadiuba , Maria Spiropulu , Jean-Roch Vlimant

Knowledge distillation (KD) exploits a large well-trained model (i.e., teacher) to train a small student model on the same dataset for the same task. Treating teacher features as knowledge, prevailing methods of knowledge distillation train…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Yuzhu Wang , Lechao Cheng , Manni Duan , Yongheng Wang , Zunlei Feng , Shu Kong

Training a small student network with the guidance of a larger teacher network is an effective way to promote the performance of the student. Despite the different types, the guided knowledge used to distill is always kept unchanged for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Jiangfan Han , Mengya Gao , Yujie Wang , Quanquan Li , Hongsheng Li , Xiaogang Wang

Knowledge distillation compresses a larger neural model (teacher) into smaller, faster student models by training them to match teacher outputs. However, the internal computational transformations that occur during this process remain…

Machine Learning · Computer Science 2026-03-10 Reilly Haskins , Benjamin Adams

It has been commonly observed that a teacher model with superior performance does not necessarily result in a stronger student, highlighting a discrepancy between current teacher training practices and effective knowledge transfer. In order…

Computation and Language · Computer Science 2024-05-16 Yuxin Ren , Zihan Zhong , Xingjian Shi , Yi Zhu , Chun Yuan , Mu Li

Knowledge distillation, which involves extracting the "dark knowledge" from a teacher network to guide the learning of a student network, has emerged as an important technique for model compression and transfer learning. Unlike previous…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Guodong Xu , Ziwei Liu , Xiaoxiao Li , Chen Change Loy

In deep learning-based classification tasks, the softmax function's temperature parameter $T$ critically influences the output distribution and overall performance. This study presents a novel theoretical insight that the optimal…

Machine Learning · Computer Science 2026-04-24 Tatsuhito Hasegawa , Shunsuke Sakai

Knowledge distillation (KD) has been extensively employed to transfer the knowledge from a large teacher model to the smaller students, where the parameters of the teacher are fixed (or partially) during training. Recent studies show that…

Machine Learning · Computer Science 2022-06-01 Jun Rao , Xv Meng , Liang Ding , Shuhan Qi , Dacheng Tao

Several methods of knowledge distillation have been developed for neural network compression. While they all use the KL divergence loss to align the soft outputs of the student model more closely with that of the teacher, the various…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Huan Wang , Suhas Lohit , Michael Jones , Yun Fu

Knowledge distillation is the technique of compressing a larger neural network, known as the teacher, into a smaller neural network, known as the student, while still trying to maintain the performance of the larger neural network as much…

Machine Learning · Computer Science 2023-05-11 Tianxun Zhou , Keng-Hwee Chiam

Artificial Intelligence (AI) has increasingly influenced modern society, recently in particular through significant advancements in Large Language Models (LLMs). However, high computational and storage demands of LLMs still limit their…

Computation and Language · Computer Science 2025-04-23 Daniel Hendriks , Philipp Spitzer , Niklas Kühl , Gerhard Satzger

Domain adaptation is crucial in many real-world applications where the distribution of the training data differs from the distribution of the test data. Previous Deep Learning-based approaches to domain adaptation need to be trained jointly…

Computation and Language · Computer Science 2017-02-08 Sebastian Ruder , Parsa Ghaffari , John G. Breslin

Video representation learning is a vital problem for classification task. Recently, a promising unsupervised paradigm termed self-supervised learning has emerged, which explores inherent supervisory signals implied in massive data for…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Chenrui Zhang , Yuxin Peng