English
Related papers

Related papers: Black-box Few-shot Knowledge Distillation

200 papers

Knowledge Distillation (KD) is a prominent neural model compression technique that heavily relies on teacher network predictions to guide the training of a student model. Considering the ever-growing size of pre-trained language models…

Machine Learning · Computer Science 2023-04-13 Ivan Kobyzev , Aref Jafari , Mehdi Rezagholizadeh , Tianda Li , Alan Do-Omri , Peng Lu , Pascal Poupart , Ali Ghodsi

Mixup is a popular data augmentation technique based on creating new samples by linear interpolation between two given data samples, to improve both the generalization and robustness of the trained model. Knowledge distillation (KD), on the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Hongjun Choi , Eun Som Jeon , Ankita Shukla , Pavan Turaga

With ever growing scale of neural models, knowledge distillation (KD) attracts more attention as a prominent tool for neural model compression. However, there are counter intuitive observations in the literature showing some challenging…

Computation and Language · Computer Science 2021-10-19 Mehdi Rezagholizadeh , Aref Jafari , Puneeth Salad , Pranav Sharma , Ali Saheb Pasand , Ali Ghodsi

Data-Free Knowledge Distillation (DFKD) is a novel task that aims to train high-performance student models using only the pre-trained teacher network without original training data. Most of the existing DFKD methods rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yuzheng Wang , Zhaoyu Chen , Jie Zhang , Dingkang Yang , Zuhao Ge , Yang Liu , Siao Liu , Yunquan Sun , Wenqiang Zhang , Lizhe Qi

Knowledge distillation, which involves extracting the "dark knowledge" from a teacher network to guide the learning of a student network, has emerged as an important technique for model compression and transfer learning. Unlike previous…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Guodong Xu , Ziwei Liu , Xiaoxiao Li , Chen Change Loy

This study proposes a method for knowledge distillation (KD) of fine-tuned Large Language Models (LLMs) into smaller, more efficient, and accurate neural networks. We specifically target the challenge of deploying these models on…

Computation and Language · Computer Science 2024-06-13 Ehsan Latif , Luyang Fang , Ping Ma , Xiaoming Zhai

Knowledge distillation (KD) has been a popular and effective method for model compression. One important assumption of KD is that the original training dataset is always available. However, this is not always the case due to privacy…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Logan Frank , Jim Davis

Knowledge distillation (KD) is a common approach to compress a teacher model to reduce its inference cost and memory footprint, by training a smaller student model. However, in the context of autoregressive language models (LMs), we…

Computation and Language · Computer Science 2024-06-18 Qihuang Zhong , Liang Ding , Li Shen , Juhua Liu , Bo Du , Dacheng Tao

Unlike the conventional Knowledge Distillation (KD), Self-KD allows a network to learn knowledge from itself without any guidance from extra networks. This paper proposes to perform Self-KD from image Mixture (MixSKD), which integrates…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Chuanguang Yang , Zhulin An , Helong Zhou , Linhang Cai , Xiang Zhi , Jiwen Wu , Yongjun Xu , Qian Zhang

Knowledge distillation deploys complex machine learning models in resource-constrained environments by training a smaller student model to emulate internal representations of a complex teacher model. However, the teacher's representations…

Knowledge distillation (KD) has been actively studied for image classification tasks in deep learning, aiming to improve the performance of a student based on the knowledge from a teacher. However, applying KD in image regression with a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Xin Ding , Yongwei Wang , Zuheng Xu , Z. Jane Wang , William J. Welch

Knowledge distillation (KD) is essentially a process of transferring a teacher model's behavior, e.g., network response, to a student model. The network response serves as additional supervision to formulate the machine domain, which uses…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Yulei Niu , Long Chen , Chang Zhou , Hanwang Zhang

Data-free knowledge distillation aims to learn a compact student network from a pre-trained large teacher network without using the original training data of the teacher network. Existing collection-based and generation-based methods train…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Jialiang Tang , Shuo Chen , Chen Gong

Knowledge Distillation (KD) is a strategy for the definition of a set of transferability gangways to improve the efficiency of Convolutional Neural Networks. Feature-based Knowledge Distillation is a subfield of KD that relies on…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Juan C. SanMiguel

Traditional knowledge distillation (KD) relies on a proficient teacher trained on the target task, which is not always available. In this setting, cross-task distillation can be used, enabling the use of any teacher model trained on a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Dylan Auty , Roy Miles , Benedikt Kolbeinsson , Krystian Mikolajczyk

Knowledge distillation has become widely recognized for its ability to transfer knowledge from a large teacher network to a compact and more streamlined student network. Traditional knowledge distillation methods primarily follow a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Chaomin Shen , Yaomin Huang , Haokun Zhu , Jinsong Fan , Guixu Zhang

Knowledge distillation (KD) is a model compression method that entails training a compact student model to emulate the performance of a more complex teacher model. However, the architectural capacity gap between the two models limits the…

Machine Learning · Computer Science 2025-01-09 Kuluhan Binici , Weiming Wu , Tulika Mitra

Knowledge distillation (KD) enables a smaller "student" model to mimic a larger "teacher" model by transferring knowledge from the teacher's output or features. However, most KD methods treat all samples uniformly, overlooking the varying…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Chi-Ping Su , Ching-Hsun Tseng , Bin Pu , Lei Zhao , Jiewen Yang , Zhuangzhuang Chen , Shin-Jye Lee

Knowledge Distillation (KD), a learning manner with a larger teacher network guiding a smaller student network, transfers dark knowledge from the teacher to the student via logits or intermediate features, with the aim of producing a…

Machine Learning · Computer Science 2024-12-04 Chengting Yu , Fengzhao Zhang , Ruizhe Chen , Aili Wang , Zuozhu Liu , Shurun Tan , Er-Ping Li

Knowledge distillation (KD), known for its ability to transfer knowledge from a cumbersome network (teacher) to a lightweight one (student) without altering the architecture, has been garnering increasing attention. Two primary categories…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Yaomin Huang , Zaomin Yan , Chaomin Shen , Faming Fang , Guixu Zhang