English
Related papers

Related papers: Why Skip If You Can Combine: A Simple Knowledge Di…

200 papers

Unlike existing knowledge distillation methods focus on the baseline settings, where the teacher models and training strategies are not that strong and competing as state-of-the-art approaches, this paper presents a method dubbed DIST to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Tao Huang , Shan You , Fei Wang , Chen Qian , Chang Xu

Quantization and Knowledge distillation (KD) methods are widely used to reduce memory and power consumption of deep neural networks (DNNs), especially for resource-constrained edge devices. Although their combination is quite promising to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Jangho Kim , Yash Bhalgat , Jinwon Lee , Chirag Patel , Nojun Kwak

Knowledge distillation (KD) is a key technique for compressing large language models into smaller ones while preserving performance. Despite the recent traction of KD research, its effectiveness for smaller language models (LMs) and the…

Computation and Language · Computer Science 2025-08-05 Suhas Kamasetty Ramesh , Ayan Sengupta , Tanmoy Chakraborty

Today, transformer language models serve as a core component for majority of natural language processing tasks. Industrial application of such models requires minimization of computation time and memory footprint. Knowledge distillation is…

Computation and Language · Computer Science 2022-05-06 Alina Kolesnikova , Yuri Kuratov , Vasily Konovalov , Mikhail Burtsev

Several recent studies have elucidated why knowledge distillation (KD) improves model performance. However, few have researched the other advantages of KD in addition to its improving model performance. In this study, we have attempted to…

Machine Learning · Computer Science 2023-05-26 Hyeongrok Han , Siwon Kim , Hyun-Soo Choi , Sungroh Yoon

Knowledge distillation compacts deep networks by letting a small student network learn from a large teacher network. The accuracy of knowledge distillation recently benefited from adding residual layers. We propose to reduce the size of the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Silvia L. Pintea , Yue Liu , Jan C. van Gemert

Knowledge distillation (KD) has emerged as a promising technique in deep learning, typically employed to enhance a compact student network through learning from their high-performance but more complex teacher variant. When applied in the…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Yuxuan Jiang , Chen Feng , Fan Zhang , David Bull

Non-autoregressive machine translation (NAT) systems predict a sequence of output tokens in parallel, achieving substantial improvements in generation speed compared to autoregressive models. Existing NAT models usually rely on the…

Computation and Language · Computer Science 2021-02-24 Chunting Zhou , Graham Neubig , Jiatao Gu

Knowledge Distillation (KD) transfers knowledge from a large pre-trained teacher network to a compact and efficient student network, making it suitable for deployment on resource-limited media terminals. However, traditional KD methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Xinlei Huang , Jialiang Tang , Xubin Zheng , Jinjia Zhou , Wenxin Yu , Ning Jiang

Knowledge distillation aims to transfer useful information from a teacher network to a student network, with the primary goal of improving the student's performance for the task at hand. Over the years, there has a been a deluge of novel…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Utkarsh Ojha , Yuheng Li , Anirudh Sundara Rajan , Yingyu Liang , Yong Jae Lee

Knowledge distillation, which involves extracting the "dark knowledge" from a teacher network to guide the learning of a student network, has emerged as an important technique for model compression and transfer learning. Unlike previous…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Guodong Xu , Ziwei Liu , Xiaoxiao Li , Chen Change Loy

In recent years, deep learning has spread rapidly, and deeper, larger models have been proposed. However, the calculation cost becomes enormous as the size of the models becomes larger. Various techniques for compressing the size of the…

Machine Learning · Computer Science 2020-04-20 Hideki Oki , Motoshi Abe , Junichi Miyao , Takio Kurita

Knowledge Distillation (KD) is a powerful technique for transferring knowledge between neural network models, where a pre-trained teacher model is used to facilitate the training of the target student model. However, the availability of a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Xucong Wang , Pengchao Han , Lei Guo

Multi-Teacher knowledge distillation provides students with additional supervision from multiple pre-trained teachers with diverse information sources. Most existing methods explore different weighting strategies to obtain a powerful…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Hailin Zhang , Defang Chen , Can Wang

Knowledge distillation (KD) is a highly promising method for mitigating the computational problems of pre-trained language models (PLMs). Among various KD approaches, Intermediate Layer Distillation (ILD) has been a de facto standard KD…

Computation and Language · Computer Science 2023-02-06 Jongwoo Ko , Seungjoon Park , Minchan Jeong , Sukjin Hong , Euijai Ahn , Du-Seong Chang , Se-Young Yun

Knowledge distillation (KD), which can efficiently transfer knowledge from a cumbersome network (teacher) to a compact network (student), has demonstrated its advantages in some computer vision applications. The representation of knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Han Zhu , Zhenzhong Chen , Shan Liu

Knowledge distillation often involves how to define and transfer knowledge from teacher to student effectively. Although recent self-supervised contrastive knowledge achieves the best performance, forcing the network to learn such knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Chuanguang Yang , Zhulin An , Linhang Cai , Yongjun Xu

Monocular depth estimation (MDE) methods are often either too computationally expensive or not accurate enough due to the trade-off between model complexity and inference performance. In this paper, we propose a lightweight network that can…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Junjie Hu , Chenyou Fan , Hualie Jiang , Xiyue Guo , Yuan Gao , Xiangyong Lu , Tin Lun Lam

Graph neural networks (GNNs) have shown remarkable performance on diverse graph mining tasks. Although different GNNs can be unified as the same message passing framework, they learn complementary knowledge from the same graph. Knowledge…

Machine Learning · Computer Science 2023-04-06 Zhichun Guo , Chunhui Zhang , Yujie Fan , Yijun Tian , Chuxu Zhang , Nitesh Chawla

This paper aims to provide a selective survey about knowledge distillation(KD) framework for researchers and practitioners to take advantage of it for developing new optimized models in the deep neural network field. To this end, we give a…

Machine Learning · Computer Science 2020-12-01 Jeong-Hoe Ku , JiHun Oh , YoungYoon Lee , Gaurav Pooniwala , SangJeong Lee