English
Related papers

Related papers: Practical Insights into Knowledge Distillation for…

200 papers

Distributed learning frameworks often rely on exchanging model parameters across workers, instead of revealing their raw data. A prime example is federated learning that exchanges the gradients or weights of each neural network model. Under…

Machine Learning · Computer Science 2020-11-05 Hyowoon Seo , Jihong Park , Seungeun Oh , Mehdi Bennis , Seong-Lyun Kim

LLMs are increasingly explored for bundle generation, thanks to their reasoning capabilities and knowledge. However, deploying large-scale LLMs introduces significant efficiency challenges, primarily high computational costs during…

Computation and Language · Computer Science 2025-04-25 Kaidong Feng , Zhu Sun , Jie Yang , Hui Fang , Xinghua Qu , Wenyuan Liu

Knowledge distillation (KD) is a powerful strategy for training deep neural networks (DNNs). Although it was originally proposed to train a more compact "student" model from a large "teacher" model, many recent efforts have focused on…

Machine Learning · Computer Science 2025-05-20 Guanglong Sun , Hongwei Yan , Liyuan Wang , Qian Li , Bo Lei , Yi Zhong

Knowledge Distillation (KD) transfers knowledge from large models to small models and has recently achieved remarkable success. However, the reliability of existing KD methods in real-world applications, especially under distribution shift,…

Machine Learning · Computer Science 2025-07-22 Songming Zhang , Yuxiao Luo , Ziyu Lyu , Xiaofeng Chen

Knowledge distillation (KD) is known as a promising solution to compress large language models (LLMs) via transferring their knowledge to smaller models. During this process, white-box KD methods usually minimize the distance between the…

Computation and Language · Computer Science 2024-10-02 Songming Zhang , Xue Zhang , Zengkui Sun , Yufeng Chen , Jinan Xu

In the era of Large Language Models (LLMs), Knowledge Distillation (KD) emerges as a pivotal methodology for transferring advanced capabilities from leading proprietary LLMs, such as GPT-4, to their open-source counterparts like LLaMA and…

Computation and Language · Computer Science 2024-10-22 Xiaohan Xu , Ming Li , Chongyang Tao , Tao Shen , Reynold Cheng , Jinyang Li , Can Xu , Dacheng Tao , Tianyi Zhou

Knowledge distillation (KD) is a widely adopted technique for compressing large models into smaller, more efficient student models that can be deployed on devices with limited computational resources. Among various KD methods, Relational…

Quantum Physics · Physics 2025-08-19 Chen-Yu Liu , Kuan-Cheng Chen , Keisuke Murota , Samuel Yen-Chi Chen , Enrico Rinaldi

Knowledge distillation (KD) has been extensively employed to transfer the knowledge from a large teacher model to the smaller students, where the parameters of the teacher are fixed (or partially) during training. Recent studies show that…

Machine Learning · Computer Science 2022-06-01 Jun Rao , Xv Meng , Liang Ding , Shuhan Qi , Dacheng Tao

Knowledge Distillation (KD) is a model compression algorithm that helps transfer the knowledge of a large neural network into a smaller one. Even though KD has shown promise on a wide range of Natural Language Processing (NLP) applications,…

Computation and Language · Computer Science 2021-09-21 Tianda Li , Ahmad Rashid , Aref Jafari , Pranav Sharma , Ali Ghodsi , Mehdi Rezagholizadeh

Knowledge Distillation (KD) is a widespread technique for compressing the knowledge of large models into more compact and efficient models. KD has proved to be highly effective in building well-performing low-complexity Acoustic Scene…

Sound · Computer Science 2025-03-17 Tobias Morocutti , Florian Schmid , Khaled Koutini , Gerhard Widmer

Knowledge distillation (KD) is a core component in the training and deployment of modern generative models, particularly large language models (LLMs). While its empirical benefits are well documented -- enabling smaller student models to…

Machine Learning · Computer Science 2026-01-16 Sungmin Cha , Kyunghyun Cho

Recent advancements in large language models (LLMs) have raised concerns about inference costs, increasing the need for research into model compression. While knowledge distillation (KD) is a prominent method for this, research on KD for…

Computation and Language · Computer Science 2024-09-30 Gyeongman Kim , Doohyuk Jang , Eunho Yang

This paper aims to provide a selective survey about knowledge distillation(KD) framework for researchers and practitioners to take advantage of it for developing new optimized models in the deep neural network field. To this end, we give a…

Machine Learning · Computer Science 2020-12-01 Jeong-Hoe Ku , JiHun Oh , YoungYoon Lee , Gaurav Pooniwala , SangJeong Lee

With numerous medical tasks, the performance of deep models has recently experienced considerable improvements. These models are often adept learners. Yet, their intricate architectural design and high computational complexity make…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Eddardaa Ben Loussaief , Hatem Rashwan , Mohammed Ayad , Mohammed Zakaria Hassan , Domenec Puig

Significant memory and computational requirements of large deep neural networks restrict their application on edge devices. Knowledge distillation (KD) is a prominent model compression technique for deep neural networks in which the…

Computation and Language · Computer Science 2021-04-16 Aref Jafari , Mehdi Rezagholizadeh , Pranav Sharma , Ali Ghodsi

Knowledge distillation (KD) is a technique used to transfer knowledge from an overparameterized teacher network to a less-parameterized student network, thereby minimizing the incurred performance loss. KD methods can be categorized into…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jaeyeon Jang , Young-Ik Kim , Jisu Lim , Hyeonseong Lee

Knowledge Distillation (KD) has emerged as an effective model compression technique in deep learning, enabling the transfer of knowledge from a large teacher model to a compact student model. While KD has demonstrated significant success,…

Machine Learning · Computer Science 2025-08-29 Suyoung Kim , Seonguk Park , Junhoo Lee , Nojun Kwak

Deep neural networks (DNNs) have improved NLP tasks significantly, but training and maintaining such networks could be costly. Model compression techniques, such as, knowledge distillation (KD), have been proposed to address the issue;…

Computation and Language · Computer Science 2023-11-08 Manas Mohanty , Tanya Roosta , Peyman Passban

Knowledge Distillation (KD) has proven effective for compressing large teacher models into smaller student models. While it is well known that student models can achieve similar accuracies as the teachers, it has also been shown that they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Amin Parchami-Araghi , Moritz Böhle , Sukrut Rao , Bernt Schiele

Deep learning models for multimodal expression recognition have reached remarkable performance in controlled laboratory environments because of their ability to learn complementary and redundant semantic information. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Muhammad Haseeb Aslam , Muhammad Osama Zeeshan , Soufiane Belharbi , Marco Pedersoli , Alessandro Koerich , Simon Bacon , Eric Granger