English
Related papers

Related papers: Improving Task-Agnostic BERT Distillation with Lay…

200 papers

Quantization-aware training (QAT) and Knowledge Distillation (KD) are combined to achieve competitive performance in creating low-bit deep learning models. Existing KD and QAT works focus on improving the accuracy of quantized models from…

Machine Learning · Computer Science 2025-09-05 Justin Kur , Kaiqi Zhao

We study the problem of distilling knowledge from a large deep teacher network to a much smaller student network for the task of road marking segmentation. In this work, we explore a novel knowledge distillation (KD) approach that can…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yuenan Hou , Zheng Ma , Chunxiao Liu , Tak-Wai Hui , Chen Change Loy

Knowledge distillation (KD) is an effective model compression method that can transfer the internal capabilities of large language models (LLMs) to smaller ones. However, the multi-modal probability distribution predicted by teacher LLMs…

Computation and Language · Computer Science 2024-12-19 Tianyu Peng , Jiajun Zhang

In recent years, knowledge graph completion (KGC) models based on pre-trained language model (PLM) have shown promising results. However, the large number of parameters and high computational cost of PLM models pose challenges for their…

Computation and Language · Computer Science 2024-06-11 Cunhang Fan , Yujie Chen , Jun Xue , Yonghui Kong , Jianhua Tao , Zhao Lv

A pre-trained language model, BERT, has brought significant performance improvements across a range of natural language processing tasks. Since the model is trained on a large corpus of diverse topics, it shows robust performance for domain…

Computation and Language · Computer Science 2020-10-26 Minho Ryu , Kichun Lee

Developing deep learning models to analyze histology images has been computationally challenging, as the massive size of the images causes excessive strain on all parts of the computing pipeline. This paper proposes a novel deep…

Image and Video Processing · Electrical Eng. & Systems 2021-01-13 Joseph DiPalma , Arief A. Suriawinata , Laura J. Tafe , Lorenzo Torresani , Saeed Hassanpour

State-of-the-art results in deep learning have been improving steadily, in good part due to the use of larger models. However, widespread use is constrained by device hardware limitations, resulting in a substantial performance gap between…

Machine Learning · Computer Science 2021-11-08 Roy Henha Eyono , Fabio Maria Carlucci , Pedro M Esperança , Binxin Ru , Phillip Torr

Traditional knowledge distillation (KD) relies on a proficient teacher trained on the target task, which is not always available. In this setting, cross-task distillation can be used, enabling the use of any teacher model trained on a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Dylan Auty , Roy Miles , Benedikt Kolbeinsson , Krystian Mikolajczyk

Knowledge distillation has become increasingly important in model compression. It boosts the performance of a miniaturized student network with the supervision of the output distribution and feature maps from a sophisticated teacher…

Machine Learning · Computer Science 2020-08-04 Yushuo Guan , Pengyu Zhao , Bingxuan Wang , Yuanxing Zhang , Cong Yao , Kaigui Bian , Jian Tang

This paper explores the use of knowledge distillation to improve a Multi-Task Deep Neural Network (MT-DNN) (Liu et al., 2019) for learning text representations across multiple natural language understanding tasks. Although ensemble learning…

Computation and Language · Computer Science 2019-04-23 Xiaodong Liu , Pengcheng He , Weizhu Chen , Jianfeng Gao

Knowledge distillation aims to compress a powerful yet cumbersome teacher model into a lightweight student model without much sacrifice of performance. For this purpose, various approaches have been proposed over the past few years,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Defang Chen , Jian-Ping Mei , Hailin Zhang , Can Wang , Yan Feng , Chun Chen

Bearing fault diagnosis under varying working conditions faces challenges, including a lack of labeled data, distribution discrepancies, and resource constraints. To address these issues, we propose a progressive knowledge distillation…

Machine Learning · Computer Science 2025-11-04 Mohammadreza Kavianpour , Parisa Kavianpour , Amin Ramezani , Mohammad TH Beheshti

Knowledge Distillation (KD) aims to transfer knowledge from a large teacher model to a smaller student model. While contrastive learning has shown promise in self-supervised learning by creating discriminative representations, its…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Nikolaos Giakoumoglou , Tania Stathaki

Knowledge distillation (KD) is a highly promising method for mitigating the computational problems of pre-trained language models (PLMs). Among various KD approaches, Intermediate Layer Distillation (ILD) has been a de facto standard KD…

Computation and Language · Computer Science 2023-02-06 Jongwoo Ko , Seungjoon Park , Minchan Jeong , Sukjin Hong , Euijai Ahn , Du-Seong Chang , Se-Young Yun

The pre-training models such as BERT have achieved great results in various natural language processing problems. However, a large number of parameters need significant amounts of memory and the consumption of inference time, which makes it…

Computation and Language · Computer Science 2020-12-15 Hao Fu , Shaojun Zhou , Qihong Yang , Junjie Tang , Guiquan Liu , Kaikui Liu , Xiaolong Li

In the context of label-efficient learning on video data, the distillation method and the structural design of the teacher-student architecture have a significant impact on knowledge distillation. However, the relationship between these…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Chao Wang , Zheng Tang

Data-Free Knowledge Distillation (DFKD) plays a vital role in compressing the model when original training data is unavailable. Previous works for DFKD in NLP mainly focus on distilling encoder-only structures like BERT on classification…

Computation and Language · Computer Science 2023-11-06 Zheyuan Bai , Xinduo Liu , Hailin Hu , Tianyu Guo , Qinghua Zhang , Yunhe Wang

This work introduces a novel knowledge distillation framework for classification tasks where information on existing subclasses is available and taken into consideration. In classification tasks with a small number of classes or binary…

Machine Learning · Computer Science 2022-07-06 Ahmad Sajedi , Konstantinos N. Plataniotis

Knowledge Distillation (KD) aims to distill the knowledge of a cumbersome teacher model into a lightweight student model. Its success is generally attributed to the privileged information on similarities among categories provided by the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Li Yuan , Francis E. H. Tay , Guilin Li , Tao Wang , Jiashi Feng

Knowledge Distillation (KD) has been one of the most popu-lar methods to learn a compact model. However, it still suffers from highdemand in time and computational resources caused by sequential train-ing pipeline. Furthermore, the soft…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Benlin Liu , Yongming Rao , Jiwen Lu , Jie Zhou , Cho-jui Hsieh