English
Related papers

Related papers: Knowledge Distillation: Enhancing Neural Network C…

200 papers

Knowledge distillation (KD) is a popular method for reducing the computational overhead of deep network inference, in which the output of a teacher model is used to train a smaller, faster student model. Hint training (i.e., FitNets)…

Machine Learning · Computer Science 2018-10-05 Animesh Koratana , Daniel Kang , Peter Bailis , Matei Zaharia

This paper proposes a new knowledge distillation method tailored for image semantic segmentation, termed Intra- and Inter-Class Knowledge Distillation (I2CKD). The focus of this method is on capturing and transferring knowledge between the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Ayoub Karine , Thibault Napoléon , Maher Jridi

Recent advancements in Neural Machine Translation (NMT) have significantly improved translation quality. However, the increasing size and complexity of state-of-the-art models present significant challenges for deployment on…

Computation and Language · Computer Science 2026-05-12 Xuewen Zhang , Haixiao Zhang , Xinlong Huang

Knowledge Distillation (KD) is a common knowledge transfer algorithm used for model compression across a variety of deep learning based natural language processing (NLP) solutions. In its regular manifestations, KD requires access to the…

Computation and Language · Computer Science 2021-01-01 Ahmad Rashid , Vasileios Lioutas , Abbas Ghaddar , Mehdi Rezagholizadeh

Deep cascaded architectures for magnetic resonance imaging (MRI) acceleration have shown remarkable success in providing high-quality reconstruction. However, as the number of cascades increases, the improvements in reconstruction tend to…

Image and Video Processing · Electrical Eng. & Systems 2024-02-06 Matcha Naga Gayathri , Sriprabha Ramanarayanan , Mohammad Al Fahim , Rahul G S , Keerthi Ram , Mohanasankar Sivaprakasam

Knowledge distillation (KD) has gained much attention due to its effectiveness in compressing large-scale pre-trained models. In typical KD methods, the small student model is trained to match the soft targets generated by the big teacher…

Machine Learning · Computer Science 2021-09-13 Yitao Liu , Tianxiang Sun , Xipeng Qiu , Xuanjing Huang

Knowledge distillation (KD) is a widely adopted approach for compressing large neural networks by transferring knowledge from a large teacher model to a smaller student model. In the context of large language models, token level KD,…

Computation and Language · Computer Science 2025-09-19 Yihan Cao , Yanbin Kang , Zhengming Xing , Ruijie Jiang

Conventional knowledge distillation (KD) approaches are designed for the student model to predict similar output as the teacher model for each sample. Unfortunately, the relationship across samples with same class is often neglected. In…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Jinjing Zhu , Songze Li , Lin Wang

Monocular depth estimation (MDE) methods are often either too computationally expensive or not accurate enough due to the trade-off between model complexity and inference performance. In this paper, we propose a lightweight network that can…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Junjie Hu , Chenyou Fan , Hualie Jiang , Xiyue Guo , Yuan Gao , Xiangyong Lu , Tin Lun Lam

As a promising solution for model compression, knowledge distillation (KD) has been applied in recommender systems (RS) to reduce inference latency. Traditional solutions first train a full teacher model from the training data, and then…

Information Retrieval · Computer Science 2022-11-29 Gang Chen , Jiawei Chen , Fuli Feng , Sheng Zhou , Xiangnan He

Knowledge distillation (KD) is essentially a process of transferring a teacher model's behavior, e.g., network response, to a student model. The network response serves as additional supervision to formulate the machine domain, which uses…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Yulei Niu , Long Chen , Chang Zhou , Hanwang Zhang

Knowledge distillation is considered as a training and compression strategy in which two neural networks, namely a teacher and a student, are coupled together during training. The teacher network is supposed to be a trustworthy predictor…

Computation and Language · Computer Science 2020-12-29 Peyman Passban , Yimeng Wu , Mehdi Rezagholizadeh , Qun Liu

Deep neural network compression techniques such as pruning and weight tensor decomposition usually require fine-tuning to recover the prediction accuracy when the compression ratio is high. However, conventional fine-tuning suffers from the…

Machine Learning · Computer Science 2020-04-01 Tianhong Li , Jianguo Li , Zhuang Liu , Changshui Zhang

This study proposes a method for knowledge distillation (KD) of fine-tuned Large Language Models (LLMs) into smaller, more efficient, and accurate neural networks. We specifically target the challenge of deploying these models on…

Computation and Language · Computer Science 2024-06-13 Ehsan Latif , Luyang Fang , Ping Ma , Xiaoming Zhai

Knowledge distillation is widely adopted in semantic segmentation to reduce the computation cost.The previous knowledge distillation methods for semantic segmentation focus on pixel-wise feature alignment and intra-class feature variation…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Zhengbo Zhang , Chunluan Zhou , Zhigang Tu

This paper aims to provide a selective survey about knowledge distillation(KD) framework for researchers and practitioners to take advantage of it for developing new optimized models in the deep neural network field. To this end, we give a…

Machine Learning · Computer Science 2020-12-01 Jeong-Hoe Ku , JiHun Oh , YoungYoon Lee , Gaurav Pooniwala , SangJeong Lee

Knowledge distillation (KD) techniques have emerged as a powerful tool for transferring expertise from complex teacher models to lightweight student models, particularly beneficial for deploying high-performance models in…

Machine Learning · Computer Science 2025-10-28 Paul Agbaje , Arkajyoti Mitra , Afia Anjum , Pranali Khose , Ebelechukwu Nwafor , Habeeb Olufowobi

In recent years, the rapid development of deep neural networks has brought increased attention to the security and robustness of these models. While existing adversarial attack algorithms have demonstrated success in improving adversarial…

Machine Learning · Computer Science 2025-02-25 Wenyuan Wu , Zheng Liu , Yong Chen , Chao Su , Dezhong Peng , Xu Wang

High storage and computational costs obstruct deep neural networks to be deployed on resource-constrained devices. Knowledge distillation aims to train a compact student network by transferring knowledge from a larger pre-trained teacher…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Haoran Zhao , Xin Sun , Junyu Dong , Changrui Chen , Zihe Dong

Graph neural networks (GNNs) have shown remarkable performance on diverse graph mining tasks. Although different GNNs can be unified as the same message passing framework, they learn complementary knowledge from the same graph. Knowledge…

Machine Learning · Computer Science 2023-04-06 Zhichun Guo , Chunhui Zhang , Yujie Fan , Yijun Tian , Chuxu Zhang , Nitesh Chawla