English
Related papers

Related papers: Distilling Lightweight Domain Experts from Large M…

200 papers

Knowledge distillation is a mainstream algorithm in model compression by transferring knowledge from the larger model (teacher) to the smaller model (student) to improve the performance of student. Despite many efforts, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Muhe Ding , Jianlong Wu , Xue Dong , Xiaojie Li , Pengda Qin , Tian Gan , Liqiang Nie

Causal language models have demonstrated remarkable capabilities, but their size poses significant challenges for deployment in resource-constrained environments. Knowledge distillation, a widely-used technique for transferring knowledge…

Machine Learning · Computer Science 2025-03-03 Makoto Shing , Kou Misaki , Han Bao , Sho Yokoi , Takuya Akiba

Recent advances in knowledge distillation (KD) have enabled smaller student models to approach the performance of larger teacher models. However, popular methods such as supervised KD and on-policy KD, are adversely impacted by the…

Computation and Language · Computer Science 2025-04-29 Wenda Xu , Rujun Han , Zifeng Wang , Long T. Le , Dhruv Madeka , Lei Li , William Yang Wang , Rishabh Agarwal , Chen-Yu Lee , Tomas Pfister

Knowledge distillation (KD) improves the performance of a low-complexity student model with the help of a more powerful teacher. The teacher in KD is a black-box model, imparting knowledge to the student only through its predictions. This…

Machine Learning · Computer Science 2023-10-05 Sayantan Chowdhury , Ben Liang , Ali Tizghadam , Ilijc Albanese

Deploying medical image segmentation models in routine clinical workflows is often constrained by on-premises infrastructure, where computational resources are fixed and cloud-based inference may be restricted by governance and security…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Qizhen Lan , Aaron Choi , Jun Ma , Bo Wang , Zhaogming Zhao , Xiaoqian Jiang , Yu-Chun Hsu

Knowledge distillation (KD) is an efficient approach to transfer the knowledge from a large "teacher" network to a smaller "student" network. Traditional KD methods require lots of labeled training samples and a white-box teacher…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Dang Nguyen , Sunil Gupta , Kien Do , Svetha Venkatesh

The problem of learning from few labeled examples while using large amounts of unlabeled data has been approached by various semi-supervised methods. Although these methods can achieve superior performance, the models are often not…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Sahil Khose , Shruti Jain , V Manushree

Transferring the reasoning capability from stronger large language models (LLMs) to smaller ones has been quite appealing, as smaller LLMs are more flexible to deploy with less expense. Among the existing solutions, knowledge distillation…

Computation and Language · Computer Science 2024-11-26 Yijun Tian , Yikun Han , Xiusi Chen , Wei Wang , Nitesh V. Chawla

Deep learning methods show promising results for overlapping cervical cell instance segmentation. However, in order to train a model with good generalization ability, voluminous pixel-level annotations are demanded which is quite expensive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Yanning Zhou , Hao Chen , Huangjing Lin , Pheng-Ann Heng

We address the challenge of getting efficient yet accurate recognition systems with limited labels. While recognition models improve with model size and amount of data, many specialized applications of computer vision have severe resource…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Kenneth Borup , Cheng Perng Phoo , Bharath Hariharan

Enhancing small language models for real-life application deployment is a significant challenge facing the research community. Due to the difficulties and costs of using large language models, researchers are seeking ways to effectively…

Computation and Language · Computer Science 2024-09-20 Mohamad Ballout , Ulf Krumnack , Gunther Heidemann , Kai-Uwe Kühnberger

The performance of a distillation-based compressed network is governed by the quality of distillation. The reason for the suboptimal distillation of a large network (teacher) to a smaller network (student) is largely attributed to the gap…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vibhas Vats , David Crandall

Deep learning techniques have been demonstrated to surpass preceding cutting-edge machine learning techniques in recent years, with computer vision being one of the most prominent examples. However, deep learning models suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Gousia Habib , Tausifa jan Saleem , Sheikh Musa Kaleem , Tufail Rouf , Brejesh Lall

Although more layers and more parameters generally improve the accuracy of the models, such big models generally have high computational complexity and require big memory, which exceed the capacity of small devices for inference and incurs…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-15 Ji Liu , Daxiang Dong , Xi Wang , An Qin , Xingjian Li , Patrick Valduriez , Dejing Dou , Dianhai Yu

For a very long time, unsupervised learning for anomaly detection has been at the heart of image processing research and a stepping stone for high performance industrial automation process. With the emergence of CNN, several methods have…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Simon Thomine , Hichem Snoussi , Mahmoud Soua

Knowledge distillation is a popular approach for enhancing the performance of ''student'' models, with lower representational capacity, by taking advantage of more powerful ''teacher'' models. Despite its apparent simplicity and widespread…

Machine Learning · Computer Science 2023-12-12 Mher Safaryan , Alexandra Peste , Dan Alistarh

Knowledge distillation has become one of the most important model compression techniques by distilling knowledge from larger teacher networks to smaller student ones. Although great success has been achieved by prior distillation methods…

Machine Learning · Computer Science 2021-08-31 Yuzhang Shang , Bin Duan , Ziliang Zong , Liqiang Nie , Yan Yan

Knowledge distillation can be a cost-effective technique to distill knowledge in Large Language Models, if the teacher output logits can be pre-computed and cached. However, successfully applying this to pre-training remains largely…

Machine Learning · Computer Science 2025-07-25 Anshumann , Mohd Abbas Zaidi , Akhil Kedia , Jinwoo Ahn , Taehwak Kwon , Kangwook Lee , Haejun Lee , Joohyung Lee

In the era of large scale pretrained models, Knowledge Distillation (KD) serves an important role in transferring the wisdom of computationally heavy teacher models to lightweight, efficient student models while preserving performance.…

Machine Learning · Computer Science 2023-11-07 Alex Wilf , Alex Tianyi Xu , Paul Pu Liang , Alexander Obolenskiy , Daniel Fried , Louis-Philippe Morency

Neural machine translation (NMT) offers a novel alternative formulation of translation that is potentially simpler than statistical approaches. However to reach competitive performance, NMT models need to be exceedingly large. In this paper…

Computation and Language · Computer Science 2016-09-23 Yoon Kim , Alexander M. Rush