English
Related papers

Related papers: Self-Supervised Quantization-Aware Knowledge Disti…

200 papers

Knowledge distillation (KD) is a new method for transferring knowledge of a structure under training to another one. The typical application of KD is in the form of learning a small model (named as a student) by soft labels produced by a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Sajjad Abbasi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

Significant improvement has been achieved in automated audio captioning (AAC) with recent models. However, these models have become increasingly large as their performance is enhanced. In this work, we propose a knowledge distillation (KD)…

Sound · Computer Science 2024-07-22 Xuenan Xu , Haohe Liu , Mengyue Wu , Wenwu Wang , Mark D. Plumbley

Knowledge distillation (KD) is commonly used to construct synthetic data for training non-autoregressive translation (NAT) models. However, there exists a discrepancy on low-frequency words between the distilled and the original data,…

Computation and Language · Computer Science 2022-04-27 Liang Ding , Longyue Wang , Xuebo Liu , Derek F. Wong , Dacheng Tao , Zhaopeng Tu

Knowledge distillation (KD) is the process of transferring knowledge from a large model to a small one. It has gained increasing attention in the natural language processing community, driven by the demands of compressing ever-growing…

Computation and Language · Computer Science 2023-07-31 Yuqiao Wen , Zichao Li , Wenyu Du , Lili Mou

With the increasing size of datasets used for training neural networks, data pruning becomes an attractive field of research. However, most current data pruning algorithms are limited in their ability to preserve accuracy compared to models…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Emanuel Ben-Baruch , Adam Botach , Igor Kviatkovsky , Manoj Aggarwal , Gérard Medioni

State-of-the-art results in deep learning have been improving steadily, in good part due to the use of larger models. However, widespread use is constrained by device hardware limitations, resulting in a substantial performance gap between…

Machine Learning · Computer Science 2021-11-08 Roy Henha Eyono , Fabio Maria Carlucci , Pedro M Esperança , Binxin Ru , Phillip Torr

Knowledge Distillation (KD) utilizes training data as a transfer set to transfer knowledge from a complex network (Teacher) to a smaller network (Student). Several works have recently identified many scenarios where the training data may…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Gaurav Kumar Nayak , Monish Keswani , Sharan Seshadri , Anirban Chakraborty

To boost the performance, deep neural networks require deeper or wider network structures that involve massive computational and memory costs. To alleviate this issue, the self-knowledge distillation method regularizes the model by…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Hyoje Lee , Yeachan Park , Hyun Seo , Myungjoo Kang

Spatiotemporal forecasting tasks, such as traffic flow, combustion dynamics, and weather forecasting, often require complex models that suffer from low training efficiency and high memory consumption. This paper proposes a lightweight…

Machine Learning · Computer Science 2025-07-22 Yuqi Li , Chuanguang Yang , Hansheng Zeng , Zeyu Dong , Zhulin An , Yongjun Xu , Yingli Tian , Hao Wu

In this research, we propose an innovative method to boost Knowledge Distillation efficiency without the need for resource-heavy teacher models. Knowledge Distillation trains a smaller ``student'' model with guidance from a larger…

Machine Learning · Computer Science 2024-04-16 Divyang Doshi , Jung-Eun Kim

Knowledge distillation is initially introduced to utilize additional supervision from a single teacher model for the student model training. To boost the student performance, some recent variants attempt to exploit diverse knowledge sources…

Machine Learning · Computer Science 2022-02-15 Hailin Zhang , Defang Chen , Can Wang

Recent advances in deep learning has lead to rapid developments in the field of image retrieval. However, the best performing architectures incur significant computational cost. Recent approaches tackle this issue using knowledge…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Zakaria Laskar , Juho Kannala

Knowledge Distillation (KD) can transfer the reasoning abilities of large models to smaller ones, which can reduce the costs to generate Chain-of-Thoughts for reasoning tasks. KD methods typically ask the student to mimic the teacher's…

Computation and Language · Computer Science 2026-03-17 Minsang Kim , Seung Jun Baek

Large language models (LLMs) have significantly advanced various natural language processing tasks, but deploying them remains computationally expensive. Knowledge distillation (KD) is a promising solution, enabling the transfer of…

Computation and Language · Computer Science 2024-10-22 Yuhang Zhou , Jing Zhu , Paiheng Xu , Xiaoyu Liu , Xiyao Wang , Danai Koutra , Wei Ai , Furong Huang

We survey various knowledge distillation (KD) strategies for simple classification tasks and implement a set of techniques that claim state-of-the-art accuracy. Our experiments using standardized model architectures, fixed compute budgets,…

Machine Learning · Computer Science 2019-12-24 Fabian Ruffy , Karanbir Chahal

Knowledge distillation (KD) is generally considered as a technique for performing model compression and learned-label smoothing. However, in this paper, we study and investigate the KD approach from a new perspective: we study its efficacy…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Nandan Kumar Jha , Rajat Saini , Sparsh Mittal

Knowledge distillation (KD) has become a widely used technique in the field of model compression, which aims to transfer knowledge from a large teacher model to a lightweight student model for efficient network development. In addition to…

Machine Learning · Computer Science 2024-04-08 Weichao Lan , Yiu-ming Cheung , Qing Xu , Buhua Liu , Zhikai Hu , Mengke Li , Zhenghua Chen

We present FerKD, a novel efficient knowledge distillation framework that incorporates partial soft-hard label adaptation coupled with a region-calibration mechanism. Our approach stems from the observation and intuition that standard data…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Zhiqiang Shen

This paper aims to provide a selective survey about knowledge distillation(KD) framework for researchers and practitioners to take advantage of it for developing new optimized models in the deep neural network field. To this end, we give a…

Machine Learning · Computer Science 2020-12-01 Jeong-Hoe Ku , JiHun Oh , YoungYoon Lee , Gaurav Pooniwala , SangJeong Lee

Quantization-aware training (QAT) has achieved remarkable success in low-bit ($\leq$4-bit) quantization for classification networks. However, when applied to more complex visual tasks such as object detection and image segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Zhaoyang Wang , Dong Wang