English
Related papers

Related papers: Adaptive Knowledge Distillation for Device-Directe…

200 papers

With the improvement of AI chips (e.g., GPU, TPU, and NPU) and the fast development of the Internet of Things (IoT), some robust deep neural networks (DNNs) are usually composed of millions or even hundreds of millions of parameters. Such a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Jun-Teng Yang , Sheng-Che Kao , Scott C. -H. Huang

This study proposes a method for knowledge distillation (KD) of fine-tuned Large Language Models (LLMs) into smaller, more efficient, and accurate neural networks. We specifically target the challenge of deploying these models on…

Computation and Language · Computer Science 2024-06-13 Ehsan Latif , Luyang Fang , Ping Ma , Xiaoming Zhai

Recently, deep learning-based models have been widely studied for click-through rate (CTR) prediction and lead to improved prediction accuracy in many industrial applications. However, current research focuses primarily on building complex…

Machine Learning · Computer Science 2023-07-06 Jieming Zhu , Jinyang Liu , Weiqi Li , Jincai Lai , Xiuqiang He , Liang Chen , Zibin Zheng

Knowledge distillation (KD) is a promising solution to compress large language models (LLMs) by transferring their knowledge to smaller models. During this process, white-box KD methods usually minimize the distance between the output…

Computation and Language · Computer Science 2025-04-16 Xue Zhang , Songming Zhang , Yunlong Liang , Fandong Meng , Yufeng Chen , Jinan Xu , Jie Zhou

Knowledge Distillation (KD) has emerged as an effective model compression technique in deep learning, enabling the transfer of knowledge from a large teacher model to a compact student model. While KD has demonstrated significant success,…

Machine Learning · Computer Science 2025-08-29 Suyoung Kim , Seonguk Park , Junhoo Lee , Nojun Kwak

Data-Free Knowledge Distillation (KD) allows knowledge transfer from a trained neural network (teacher) to a more compact one (student) in the absence of original training data. Existing works use a validation set to monitor the accuracy of…

Machine Learning · Computer Science 2024-07-30 Kuluhan Binici , Shivam Aggarwal , Nam Trung Pham , Karianto Leman , Tulika Mitra

The application of speech self-supervised learning (SSL) models has achieved remarkable performance in speaker verification (SV). However, there is a computational cost hurdle in employing them, which makes development and deployment…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-09 Jungwoo Heo , Chan-yeong Lim , Ju-ho Kim , Hyun-seo Shin , Ha-Jin Yu

Data-Free Knowledge Distillation (DFKD) is a novel task that aims to train high-performance student models using only the pre-trained teacher network without original training data. Most of the existing DFKD methods rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yuzheng Wang , Zhaoyu Chen , Jie Zhang , Dingkang Yang , Zuhao Ge , Yang Liu , Siao Liu , Yunquan Sun , Wenqiang Zhang , Lizhe Qi

Knowledge Distillation (KD) has proven effective for compressing large teacher models into smaller student models. While it is well known that student models can achieve similar accuracies as the teachers, it has also been shown that they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Amin Parchami-Araghi , Moritz Böhle , Sukrut Rao , Bernt Schiele

Knowledge Distillation (KD) has been validated as an effective model compression technique for learning compact object detectors. Existing state-of-the-art KD methods for object detection are mostly based on feature imitation. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jiabao Wang , Yuming Chen , Zhaohui Zheng , Xiang Li , Ming-Ming Cheng , Qibin Hou

Knowledge distillation (KD) improves the performance of a low-complexity student model with the help of a more powerful teacher. The teacher in KD is a black-box model, imparting knowledge to the student only through its predictions. This…

Machine Learning · Computer Science 2023-10-05 Sayantan Chowdhury , Ben Liang , Ali Tizghadam , Ilijc Albanese

Knowledge distillation establishes a learning paradigm that leverages both data supervision and teacher guidance. However, determining the optimal balance between learning from data and learning from the teacher is challenging, as some…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jingchen Sun , Shaobo Han , Deep Patel , Wataru Kohno , Can Jin , Changyou Chen

Condensed datasets offer a compact representation of larger datasets, but training models directly on them or using them to enhance model performance through knowledge distillation (KD) can result in suboptimal outcomes due to limited…

Machine Learning · Computer Science 2025-11-11 Kuluhan Binici , Shivam Aggarwal , Cihan Acar , Nam Trung Pham , Karianto Leman , Gim Hee Lee , Tulika Mitra

We address the problem of detecting speech directed to a device that does not contain a specific wake-word. Specifically, we focus on audio coming from a touch-based invocation. Mitigating virtual assistants (VAs) activation due to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-31 Vineet Garg , Ognjen Rudovic , Pranay Dighe , Ahmed H. Abdelaziz , Erik Marchi , Saurabh Adya , Chandra Dhir , Ahmed Tewfik

With the ever-growing complexity of models in the field of remote sensing (RS), there is an increasing demand for solutions that balance model accuracy with computational efficiency. Knowledge distillation (KD) has emerged as a powerful…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yassine Himeur , Nour Aburaed , Omar Elharrouss , Iraklis Varlamis , Shadi Atalla , Wathiq Mansoor , Hussain Al Ahmad

Deploying speaker verification on resource-constrained devices remains challenging due to the computational cost of high-capacity models; knowledge distillation (KD) offers a remedy. Classical KD entangles target confidence with non-target…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-22 Ju-ho Kim , Youngmoon Jung , Joon-Young Yang , Jaeyoung Roh , Chang Woo Han , Hoon-Young Cho

In this work, we propose a technique to transfer speech recognition capabilities from audio speech recognition systems to visual speech recognizers, where our goal is to utilize audio data during lipreading model training. Impressive…

Multimedia · Computer Science 2022-07-13 Hadeel Mabrouk , Omar Abugabal , Nourhan Sakr , Hesham M. Eraqi

Knowledge Distillation is becoming one of the primary trends among neural network compression algorithms to improve the generalization performance of a smaller student model with guidance from a larger teacher model. This momentous rise in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Sumanth Chennupati , Mohammad Mahdi Kamani , Zhongwei Cheng , Lin Chen

Knowledge distillation has been widely used to produce portable and efficient neural networks which can be well applied on edge devices for computer vision tasks. However, almost all top-performing knowledge distillation methods need to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Haoran Zhao , Xin Sun , Junyu Dong , Hui Yu , Huiyu Zhou

This paper studies the problem of pre-training for small models, which is essential for many mobile devices. Current state-of-the-art methods on this problem transfer the representational knowledge of a large network (as a Teacher) into a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Mingsheng Li , Lin Zhang , Mingzhen Zhu , Zilong Huang , Gang Yu , Jiayuan Fan , Tao Chen