English
Related papers

Related papers: Knowledge Distillation from Internal Representatio…

200 papers

Since deep learning became a key player in natural language processing (NLP), many deep learning models have been showing remarkable performances in a variety of NLP tasks, and in some cases, they are even outperforming humans. Such high…

Computation and Language · Computer Science 2019-08-07 Sangchul Hahn , Heeyoul Choi

The outpouring of various pre-trained models empowers knowledge distillation by providing abundant teacher resources, but there lacks a developed mechanism to utilize these teachers adequately. With a massive model repository composed of…

Machine Learning · Computer Science 2022-09-29 Su Lu , Han-Jia Ye , De-Chuan Zhan

Despite the fact that deep neural networks are powerful models and achieve appealing results on many tasks, they are too large to be deployed on edge devices like smartphones or embedded sensor nodes. There have been efforts to compress…

Machine Learning · Computer Science 2019-12-18 Seyed-Iman Mirzadeh , Mehrdad Farajtabar , Ang Li , Nir Levine , Akihiro Matsukawa , Hassan Ghasemzadeh

As a promising solution for model compression, knowledge distillation (KD) has been applied in recommender systems (RS) to reduce inference latency. Traditional solutions first train a full teacher model from the training data, and then…

Information Retrieval · Computer Science 2022-11-29 Gang Chen , Jiawei Chen , Fuli Feng , Sheng Zhou , Xiangnan He

Complex deep learning models now achieve state of the art performance for many document retrieval tasks. The best models process the query or claim jointly with the document. However for fast scalable search it is desirable to have document…

Information Retrieval · Computer Science 2019-11-26 Siamak Shakeri , Abhinav Sethy , Cheng Cheng

Knowledge distillation aims at transferring knowledge acquired in one model (a teacher) to another model (a student) that is typically smaller. Previous approaches can be expressed as a form of training the student to mimic output…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Wonpyo Park , Dongju Kim , Yan Lu , Minsu Cho

Knowledge distillation (KD) is a widely adopted approach for compressing large neural networks by transferring knowledge from a large teacher model to a smaller student model. In the context of large language models, token level KD,…

Computation and Language · Computer Science 2025-09-19 Yihan Cao , Yanbin Kang , Zhengming Xing , Ruijie Jiang

Knowledge distillation is a popular technique to transfer knowledge from large teacher models to a small student model. Typically, the student learns to imitate the teacher by minimizing the KL divergence of its output distribution with the…

Machine Learning · Computer Science 2023-05-10 Rongzhi Zhang , Jiaming Shen , Tianqi Liu , Jialu Liu , Michael Bendersky , Marc Najork , Chao Zhang

Knowledge distillation (KD) is a new method for transferring knowledge of a structure under training to another one. The typical application of KD is in the form of learning a small model (named as a student) by soft labels produced by a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Sajjad Abbasi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

Knowledge distillation (KD) has become a widely used technique in the field of model compression, which aims to transfer knowledge from a large teacher model to a lightweight student model for efficient network development. In addition to…

Machine Learning · Computer Science 2024-04-08 Weichao Lan , Yiu-ming Cheung , Qing Xu , Buhua Liu , Zhikai Hu , Mengke Li , Zhenghua Chen

Deep learning methods usually require a large amount of training data and lack interpretability. In this paper, we propose a novel knowledge distillation and model interpretation framework for medical image classification that jointly…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Thanh Nguyen-Duc , He Zhao , Jianfei Cai , Dinh Phung

Knowledge Distillation (KD) aims to transfer knowledge from a large teacher model to a smaller student model. While contrastive learning has shown promise in self-supervised learning by creating discriminative representations, its…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Nikolaos Giakoumoglou , Tania Stathaki

Knowledge distillation is a method of transferring the knowledge from a pretrained complex teacher model to a student model, so a smaller network can replace a large teacher network at the deployment stage. To reduce the necessity of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Mingi Ji , Seungjae Shin , Seunghyun Hwang , Gibeom Park , Il-Chul Moon

Knowledge distillation (KD) is an efficient approach to transfer the knowledge from a large "teacher" network to a smaller "student" network. Traditional KD methods require lots of labeled training samples and a white-box teacher…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Dang Nguyen , Sunil Gupta , Kien Do , Svetha Venkatesh

Knowledge distillation is considered as a training and compression strategy in which two neural networks, namely a teacher and a student, are coupled together during training. The teacher network is supposed to be a trustworthy predictor…

Computation and Language · Computer Science 2020-12-29 Peyman Passban , Yimeng Wu , Mehdi Rezagholizadeh , Qun Liu

Knowledge distillation allows transferring knowledge from a pre-trained model to another. However, it suffers from limitations, and constraints related to the two models need to be architecturally similar. Knowledge distillation addresses…

Image and Video Processing · Electrical Eng. & Systems 2020-09-03 Sajjad Abbasi , Mohsen Hajabdollahi , Pejman Khadivi , Nader Karimi , Roshanak Roshandel , Shahram Shirani , Shadrokh Samavi

In this paper, we propose Stochastic Knowledge Distillation (SKD) to obtain compact BERT-style language model dubbed SKDBERT. In each iteration, SKD samples a teacher model from a pre-defined teacher ensemble, which consists of multiple…

Computation and Language · Computer Science 2022-11-30 Zixiang Ding , Guoqing Jiang , Shuai Zhang , Lin Guo , Wei Lin

Knowledge distillation in neural networks refers to compressing a large model or dataset into a smaller version of itself. We introduce Privacy Distillation, a framework that allows a text-to-image generative model to teach another model…

Knowledge distillation methods have recently shown to be a promising direction to speedup the synthesis of large-scale diffusion models by requiring only a few inference steps. While several powerful distillation methods were recently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Nikita Starodubcev , Artem Fedorov , Artem Babenko , Dmitry Baranchuk

Knowledge Distillation (KD) has been considered as a key solution in model compression and acceleration in recent years. In KD, a small student model is generally trained from a large teacher model by minimizing the divergence between the…

Machine Learning · Computer Science 2021-11-16 Raed Alharbi , Minh N. Vu , My T. Thai
‹ Prev 1 3 4 5 6 7 10 Next ›