English
Related papers

Related papers: Lightweight Neural Network with Knowledge Distilla…

200 papers

Knowledge distillation (KD) has been widely employed to transfer knowledge from a large language model (LLM) to a specialized model in low-data regimes through pseudo label learning. However, pseudo labels generated by teacher models are…

Machine Learning · Computer Science 2023-12-19 Jiachen Zhao

Knowledge distillation (KD) is a technique that compresses large teacher models by training smaller student models to mimic them. The success of KD in auto-regressive language models mainly relies on Reverse KL for mode-seeking and…

Computation and Language · Computer Science 2024-09-23 Jun Rao , Xuebo Liu , Zepeng Lin , Liang Ding , Jing Li , Dacheng Tao , Min Zhang

Many existing studies on knowledge distillation have focused on methods in which a student model mimics a teacher model well. Simply imitating the teacher's knowledge, however, is not sufficient for the student to surpass that of the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Jihyeon Seo , Kyusam Oh , Chanho Min , Yongkeun Yun , Sungwoo Cho

Designing the physical encoder is crucial for accurate image reconstruction in computational imaging (CI) systems. Currently, these systems are designed via end-to-end (E2E) optimization, where the encoder is modeled as a neural network…

Image and Video Processing · Electrical Eng. & Systems 2025-01-31 Leon Suarez-Rodriguez , Roman Jacome , Henry Arguello

This work introduces a novel knowledge distillation framework for classification tasks where information on existing subclasses is available and taken into consideration. In classification tasks with a small number of classes or binary…

Machine Learning · Computer Science 2022-07-06 Ahmad Sajedi , Konstantinos N. Plataniotis

Ensemble models comprising of deep Convolutional Neural Networks (CNN) have shown significant improvements in model generalization but at the cost of large computation and memory requirements. In this paper, we present a framework for…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Umar Asif , Jianbin Tang , Stefan Harrer

With the increasing size of datasets used for training neural networks, data pruning becomes an attractive field of research. However, most current data pruning algorithms are limited in their ability to preserve accuracy compared to models…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Emanuel Ben-Baruch , Adam Botach , Igor Kviatkovsky , Manoj Aggarwal , Gérard Medioni

Knowledge distillation (KD), as an efficient and effective model compression technique, has been receiving considerable attention in deep learning. The key to its success is to transfer knowledge from a large teacher network to a small…

Machine Learning · Computer Science 2021-01-28 Liyuan Sun , Jianping Gou , Baosheng Yu , Lan Du , Dacheng Tao

Knowledge Distillation (KD) transfers the knowledge from a high-capacity teacher model to promote a smaller student model. Existing efforts guide the distillation by matching their prediction logits, feature embedding, etc., while leaving…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yiyang Liu , Chenxin Li , Xiaotong Tu , Xinghao Ding , Yue Huang

The advent of scalable deep models and large datasets has improved the performance of Neural Machine Translation. Knowledge Distillation (KD) enhances efficiency by transferring knowledge from a teacher model to a more compact student…

Computation and Language · Computer Science 2024-03-26 Heegon Jin , Seonil Son , Jemin Park , Youngseok Kim , Hyungjong Noh , Yeonsoo Lee

Knowledge distillation (KD) is a well-known technique to effectively compress a large network (teacher) to a smaller network (student) with little sacrifice in performance. However, most KD methods require a large training set and internal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Tri-Nhan Vo , Dang Nguyen , Kien Do , Sunil Gupta

Multi-teacher Knowledge Distillation (KD) transfers diverse knowledge from a teacher pool to a student network. The core problem of multi-teacher KD is how to balance distillation strengths among various teachers. Most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Chuanguang Yang , Xinqiang Yu , Han Yang , Zhulin An , Chengqing Yu , Libo Huang , Yongjun Xu

Knowledge distillation (KD), which can efficiently transfer knowledge from a cumbersome network (teacher) to a compact network (student), has demonstrated its advantages in some computer vision applications. The representation of knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Han Zhu , Zhenzhong Chen , Shan Liu

Knowledge Distillation (KD) has emerged as a promising approach for transferring knowledge from a larger, more complex teacher model to a smaller student model. Traditionally, KD involves training the student to mimic the teacher's output…

Machine Learning · Computer Science 2024-10-03 Noel Loo , Fotis Iliopoulos , Wei Hu , Erik Vee

Streaming automatic speech recognition (ASR) models are restricted from accessing future context, which results in worse performance compared to the non-streaming models. To improve the performance of streaming ASR, knowledge distillation…

Computation and Language · Computer Science 2023-09-01 Kyuhong Shim , Jinkyu Lee , Simyung Chang , Kyuwoong Hwang

Knowledge distillation (KD) enables a smaller "student" model to mimic a larger "teacher" model by transferring knowledge from the teacher's output or features. However, most KD methods treat all samples uniformly, overlooking the varying…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Chi-Ping Su , Ching-Hsun Tseng , Bin Pu , Lei Zhao , Jiewen Yang , Zhuangzhuang Chen , Shin-Jye Lee

Tiny, causal models are crucial for embedded audio machine learning applications. Model compression can be achieved via distilling knowledge from a large teacher into a smaller student model. In this work, we propose a novel two-step…

Sound · Computer Science 2023-09-18 Rayan Daod Nathoo , Mikolaj Kegler , Marko Stamenovic

This work studies knowledge distillation (KD) and addresses its constraints for recurrent neural network transducer (RNN-T) models. In hard distillation, a teacher model transcribes large amounts of unlabelled speech to train a student…

Computation and Language · Computer Science 2023-03-13 Mohammad Zeineldeen , Kartik Audhkhasi , Murali Karthick Baskar , Bhuvana Ramabhadran

Device-directed speech detection (DDSD) is a binary classification task that separates the user's queries to a voice assistant (VA) from background speech or side conversations. This is important for achieving naturalistic user experience.…

Knowledge distillation~(KD) is an effective learning paradigm for improving the performance of lightweight student networks by utilizing additional supervision knowledge distilled from teacher networks. Most pioneering studies either learn…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Yuang Liu , Wei Zhang , Jun Wang