English
Related papers

Related papers: Distiller: A Systematic Study of Model Distillatio…

200 papers

Neural network potentials (NNPs) offer a powerful alternative to traditional force fields for molecular dynamics (MD) simulations. Accurate and stable MD simulations, crucial for evaluating material properties, require training data…

Machine Learning · Computer Science 2025-06-23 Naoki Matsumura , Yuta Yoshimoto , Yuto Iwasaki , Meguru Yamazaki , Yasufumi Sakai

Mixup is a popular data augmentation technique based on creating new samples by linear interpolation between two given data samples, to improve both the generalization and robustness of the trained model. Knowledge distillation (KD), on the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Hongjun Choi , Eun Som Jeon , Ankita Shukla , Pavan Turaga

Knowledge distillation (KD) requires sufficient data to transfer knowledge from large-scale teacher models to small-scale student models. Therefore, data augmentation has been widely used to mitigate the shortage of data under specific…

Computation and Language · Computer Science 2023-05-23 Ziqi Wang , Chi Han , Wenxuan Bao , Heng Ji

Knowledge distillation (KD) is one of the most potent ways for model compression. The key idea is to transfer the knowledge from a deep teacher model (T) to a shallower student (S). However, existing methods suffer from performance…

Machine Learning · Computer Science 2020-02-24 Mengya Gao , Yujun Shen , Quanquan Li , Chen Change Loy

Incremental learning targets at achieving good performance on new categories without forgetting old ones. Knowledge distillation has been shown critical in preserving the performance on old classes. Conventional methods, however,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Peng Zhou , Long Mai , Jianming Zhang , Ning Xu , Zuxuan Wu , Larry S. Davis

Although large foundation models pre-trained by self-supervised learning have achieved state-of-the-art performance in many tasks including automatic speech recognition (ASR), knowledge distillation (KD) is often required in practice to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-21 Xiaoyu Yang , Qiujia Li , Chao Zhang , Philip C. Woodland

Continual learning refers to a dynamical framework in which a model receives a stream of non-stationary data over time and must adapt to new data while preserving previously acquired knowledge. Unluckily, neural networks fail to meet these…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Umberto Cappellazzo , Daniele Falavigna , Alessio Brutti

Knowledge distillation (KD) is an effective technique to transfer knowledge from one neural network (teacher) to another (student), thus improving the performance of the student. To make the student better mimic the behavior of the teacher,…

Machine Learning · Computer Science 2020-10-20 Xiang Deng , Zhongfei , Zhang

Knowledge distillation (KD) is a common approach to compress a teacher model to reduce its inference cost and memory footprint, by training a smaller student model. However, in the context of autoregressive language models (LMs), we…

Computation and Language · Computer Science 2024-06-18 Qihuang Zhong , Liang Ding , Li Shen , Juhua Liu , Bo Du , Dacheng Tao

Knowledge distillation (KD) is widely used for compressing a teacher model to reduce its inference cost and memory footprint, by training a smaller student model. However, current KD methods for auto-regressive sequence models suffer from…

Machine Learning · Computer Science 2024-01-18 Rishabh Agarwal , Nino Vieillard , Yongchao Zhou , Piotr Stanczyk , Sabela Ramos , Matthieu Geist , Olivier Bachem

Conventional knowledge distillation (KD) approaches are designed for the student model to predict similar output as the teacher model for each sample. Unfortunately, the relationship across samples with same class is often neglected. In…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Jinjing Zhu , Songze Li , Lin Wang

Knowledge Distillation (KD) is a promising technique for reducing the high computational demand of large language models (LLMs). However, previous KD methods are primarily applied to white-box classification models or training small models…

Computation and Language · Computer Science 2026-02-03 Yuxian Gu , Li Dong , Furu Wei , Minlie Huang

Knowledge distillation (KD), as an efficient and effective model compression technique, has been receiving considerable attention in deep learning. The key to its success is to transfer knowledge from a large teacher network to a small…

Machine Learning · Computer Science 2021-01-28 Liyuan Sun , Jianping Gou , Baosheng Yu , Lan Du , Dacheng Tao

Although deep learning models owe their remarkable success to deep and complex architectures, this very complexity typically comes at the expense of real-time performance. To address this issue, a variety of model compression techniques…

Machine Learning · Computer Science 2025-05-13 Seongmin Kim , Kwanho Kim , Minseung Kim , Kanghyun Jo

Knowledge distillation (KD) is a widely-used technique that utilizes large networks to improve the performance of compact models. Previous KD approaches usually aim to guide the student to mimic the teacher's behavior completely in the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yuge Huang , Jiaxiang Wu , Xingkun Xu , Shouhong Ding

In recent years, there has been a great deal of research in developing end-to-end speech recognition models, which enable simplifying the traditional pipeline and achieving promising results. Despite their remarkable performance…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-20 Ji Won Yoon , Hyeonseung Lee , Hyung Yong Kim , Won Ik Cho , Nam Soo Kim

In the field of large language models (LLMs), Knowledge Distillation (KD) is a critical technique for transferring capabilities from teacher models to student models. However, existing KD methods face limitations and challenges in…

Computation and Language · Computer Science 2025-04-08 Yixing Li , Yuxian Gu , Li Dong , Dequan Wang , Yu Cheng , Furu Wei

Knowledge distillation is widely used as a means of improving the performance of a relatively simple student model using the predictions from a complex teacher model. Several works have shown that distillation significantly boosts the…

Machine Learning · Computer Science 2021-07-09 Michal Lukasik , Srinadh Bhojanapalli , Aditya Krishna Menon , Sanjiv Kumar

Text image machine translation (TIMT) has been widely used in various real-world applications, which translates source language texts in images into another target language sentence. Existing methods on TIMT are mainly divided into two…

Computation and Language · Computer Science 2023-05-11 Cong Ma , Yaping Zhang , Mei Tu , Yang Zhao , Yu Zhou , Chengqing Zong

Knowledge Distillation (KD) is a widely used technique to transfer knowledge from pre-trained teacher models to (usually more lightweight) student models. However, in certain situations, this technique is more of a curse than a blessing.…

Machine Learning · Computer Science 2021-05-18 Haoyu Ma , Tianlong Chen , Ting-Kuei Hu , Chenyu You , Xiaohui Xie , Zhangyang Wang