English
Related papers

Related papers: Ranking Distillation: Learning Compact Ranking Mod…

200 papers

Knowledge distillation (KD) is a widely adopted approach for compressing large neural networks by transferring knowledge from a large teacher model to a smaller student model. In the context of large language models, token level KD,…

Computation and Language · Computer Science 2025-09-19 Yihan Cao , Yanbin Kang , Zhengming Xing , Ruijie Jiang

Intermediate layer knowledge distillation (KD) can improve the standard KD technique (which only targets the output of teacher and student models) especially over large pre-trained language models. However, intermediate layer distillation…

Computation and Language · Computer Science 2021-10-05 Md Akmal Haidar , Nithin Anchuri , Mehdi Rezagholizadeh , Abbas Ghaddar , Philippe Langlais , Pascal Poupart

Knowledge distillation (KD) is a common approach to compress a teacher model to reduce its inference cost and memory footprint, by training a smaller student model. However, in the context of autoregressive language models (LMs), we…

Computation and Language · Computer Science 2024-06-18 Qihuang Zhong , Liang Ding , Li Shen , Juhua Liu , Bo Du , Dacheng Tao

In instance-level detection tasks (e.g., object detection), reducing input resolution is an easy option to improve runtime efficiency. However, this option traditionally hurts the detection performance much. This paper focuses on boosting…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Lu Qi , Jason Kuen , Jiuxiang Gu , Zhe Lin , Yi Wang , Yukang Chen , Yanwei Li , Jiaya Jia

Knowledge Distillation (KD) has emerged as an effective model compression technique in deep learning, enabling the transfer of knowledge from a large teacher model to a compact student model. While KD has demonstrated significant success,…

Machine Learning · Computer Science 2025-08-29 Suyoung Kim , Seonguk Park , Junhoo Lee , Nojun Kwak

Deep learning models, particularly recurrent neural networks and their variants, such as long short-term memory, have significantly advanced time series data analysis. These models capture complex, sequential patterns in time series,…

Machine Learning · Computer Science 2026-01-12 Nilushika Udayangani , Kishor Nandakishor , Marimuthu Palaniswami

Current knowledge distillation (KD) methods primarily focus on transferring various structured knowledge and designing corresponding optimization goals to encourage the student network to imitate the output of the teacher network. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Dong Liang , Yue Sun , Yun Du , Songcan Chen , Sheng-Jun Huang

Knowledge distillation~(KD) has been proved effective for compressing large-scale pre-trained language models. However, existing methods conduct KD statically, e.g., the student model aligns its output distribution to that of a selected…

Computation and Language · Computer Science 2021-09-24 Lei Li , Yankai Lin , Shuhuai Ren , Peng Li , Jie Zhou , Xu Sun

Recently, deep learning-based models have been widely studied for click-through rate (CTR) prediction and lead to improved prediction accuracy in many industrial applications. However, current research focuses primarily on building complex…

Machine Learning · Computer Science 2023-07-06 Jieming Zhu , Jinyang Liu , Weiqi Li , Jincai Lai , Xiuqiang He , Liang Chen , Zibin Zheng

Knowledge Distillation (KD) is a fundamental technique for compressing large language models (LLMs) into compact, efficient student models. However, existing white-box KD methods mainly focus on balancing ground truth and student-generated…

Computation and Language · Computer Science 2025-08-11 Lingyuan Liu , Mengxiang Zhang

Knowledge distillation (KD) is an effective technique to transfer knowledge from one neural network (teacher) to another (student), thus improving the performance of the student. To make the student better mimic the behavior of the teacher,…

Machine Learning · Computer Science 2020-10-20 Xiang Deng , Zhongfei , Zhang

Knowledge distillation (KD) improves the performance of a low-complexity student model with the help of a more powerful teacher. The teacher in KD is a black-box model, imparting knowledge to the student only through its predictions. This…

Machine Learning · Computer Science 2023-10-05 Sayantan Chowdhury , Ben Liang , Ali Tizghadam , Ilijc Albanese

Knowledge Distillation (KD) has emerged as a promising approach for transferring knowledge from a larger, more complex teacher model to a smaller student model. Traditionally, KD involves training the student to mimic the teacher's output…

Machine Learning · Computer Science 2024-10-03 Noel Loo , Fotis Iliopoulos , Wei Hu , Erik Vee

The model reduction problem that eases the computation costs and latency of complex deep learning architectures has received an increasing number of investigations owing to its importance in model deployment. One promising method is…

Machine Learning · Computer Science 2018-12-04 Wei-Chun Chen , Chia-Che Chang , Chien-Yu Lu , Che-Rung Lee

Knowledge distillation (KD) enhances the performance of a student network by allowing it to learn the knowledge transferred from a teacher network incrementally. Existing methods dynamically adjust the temperature to enable the student…

Machine Learning · Computer Science 2026-02-03 Zhengbo Zhang , Yuxi Zhou , Jia Gong , Jun Liu , Zhigang Tu

Knowledge Distillation (KD) has emerged as a pivotal technique for neural network compression and performance enhancement. Most KD methods aim to transfer dark knowledge from a cumbersome teacher model to a lightweight student model based…

Machine Learning · Computer Science 2024-10-10 Wenqi Niu , Yingchao Wang , Guohui Cai , Hanpo Hou

In the era of large scale pretrained models, Knowledge Distillation (KD) serves an important role in transferring the wisdom of computationally heavy teacher models to lightweight, efficient student models while preserving performance.…

Machine Learning · Computer Science 2023-11-07 Alex Wilf , Alex Tianyi Xu , Paul Pu Liang , Alexander Obolenskiy , Daniel Fried , Louis-Philippe Morency

Knowledge Distillation (KD) has been considered as a key solution in model compression and acceleration in recent years. In KD, a small student model is generally trained from a large teacher model by minimizing the divergence between the…

Machine Learning · Computer Science 2021-11-16 Raed Alharbi , Minh N. Vu , My T. Thai

With numerous medical tasks, the performance of deep models has recently experienced considerable improvements. These models are often adept learners. Yet, their intricate architectural design and high computational complexity make…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Eddardaa Ben Loussaief , Hatem Rashwan , Mohammed Ayad , Mohammed Zakaria Hassan , Domenec Puig

Knowledge distillation is normally used to compress a big network, or teacher, onto a smaller one, the student, by training it to match its outputs. Recently, some works have shown that robustness against adversarial attacks can also be…

Machine Learning · Computer Science 2022-03-15 Javier Maroto , Guillermo Ortiz-Jiménez , Pascal Frossard