English
Related papers

Related papers: Knowledge Distillation Using Frontier Open-source …

200 papers

Large language models (LLMs) excel at clinical information extraction but their computational demands limit practical deployment. Knowledge distillation--the process of transferring knowledge from larger to smaller models--offers a…

Computation and Language · Computer Science 2025-01-03 Karthik S. Vedula , Annika Gupta , Akshay Swaminathan , Ivan Lopez , Suhana Bedi , Nigam H. Shah

Large reasoning models such as DeepSeek-R1 and their distilled variants achieve strong performance on complex reasoning tasks. Yet, distilling these models often demands large-scale data for supervised fine-tuning (SFT), motivating the…

Computation and Language · Computer Science 2026-01-16 Lechen Zhang , Yunxiang Zhang , Wei Hu , Lu Wang

Knowledge distillation in machine learning is the process of transferring knowledge from a large model called the teacher to a smaller model called the student. Knowledge distillation is one of the techniques to compress the large network…

Machine Learning · Computer Science 2022-06-27 Durga Prasad Ganta , Himel Das Gupta , Victor S. Sheng

Existing code large language models (LLMs) often rely on large-scale instruction data distilled from proprietary LLMs for fine-tuning, which typically incurs high costs. In this paper, we explore the potential of small-scale open-source…

Artificial Intelligence · Computer Science 2025-09-10 Xinyu Zhang , Changzhi Zhou , Linmei Hu , Luhao Zhang , Xiancai Chen , Haomin Fu , Yang Yang , Mengdi Zhang

Data allocation plays a critical role in federated large language model (LLM) and small language models (SLMs) reasoning collaboration. Nevertheless, existing data allocation methods fail to address an under-explored challenge in…

Artificial Intelligence · Computer Science 2026-02-24 Wei Guo , Siyuan Lu , Xiangdong Ran , Yiqi Tong , Yikun Ban , Zelong Xu , Jing Fan , Zixuan Huang , Xiao Zhang , Zhaojun Hu , Fuzhen Zhuang

We introduce a state-of-the-art approach for URL categorization that leverages the power of Large Language Models (LLMs) to address the primary objectives of web content filtering: safeguarding organizations from legal and ethical risks,…

Machine Learning · Computer Science 2023-05-11 Tamás Vörös , Sean Paul Bergeron , Konstantin Berlin

The emergence of Large Language Models (LLMs) has brought to light promising language generation capabilities, particularly in performing tasks like complex reasoning and creative writing. Consequently, distillation through imitation of…

Computation and Language · Computer Science 2024-02-29 Sahithya Ravi , Patrick Huber , Akshat Shrivastava , Aditya Sagar , Ahmed Aly , Vered Shwartz , Arash Einolghozati

Large Language Models (LLMs) excel at multi-step reasoning problems with explicit chain-of-thought (CoT), but verbose traces incur significant computational costs and memory overhead, and often carry redundant, stylistic artifacts. Latent…

Machine Learning · Computer Science 2026-05-08 Anna Kuzina , Maciej Pioro , Paul N. Whatmough , Babak Ehteshami Bejnordi

Mathematical reasoning continues to be a critical challenge in large language model (LLM) development with significant interest. However, most of the cutting-edge progress in mathematical reasoning with LLMs has become \emph{closed-source}…

Computation and Language · Computer Science 2024-10-08 Shubham Toshniwal , Wei Du , Ivan Moshkov , Branislav Kisacanin , Alexan Ayrapetyan , Igor Gitman

Can post-trained large language models (LLMs) further improve themselves using only unlabeled prompts, without external teachers or feedback from tools? We study this setting starting only from unlabeled seed questions with no ground-truth…

Computation and Language · Computer Science 2026-05-27 Tony Lee , Percy Liang

The challenge of reducing the size of Large Language Models (LLMs) while maintaining their performance has gained significant attention. However, existing methods, such as model distillation and transfer learning, often fail to achieve high…

Knowledge distillation is a potential solution for model compression. The idea is to make a small student network imitate the target of a large teacher network, then the student network can be competitive to the teacher one. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Chong Wang , Xipeng Lan , Yangang Zhang

Pre-trained language models have been applied to various NLP tasks with considerable performance gains. However, the large model sizes, together with the long inference time, limit the deployment of such models in real-time applications.…

Computation and Language · Computer Science 2022-11-03 Haojie Pan , Chengyu Wang , Minghui Qiu , Yichang Zhang , Yaliang Li , Jun Huang

Despite the success of distillation in large language models (LLMs), most prior work applies identical loss functions to both teacher- and student-generated data. These strategies overlook the synergy between loss formulations and data…

Computation and Language · Computer Science 2025-06-02 Jongwoo Ko , Tianyi Chen , Sungnyun Kim , Tianyu Ding , Luming Liang , Ilya Zharkov , Se-Young Yun

In recent years, deep learning has spread rapidly, and deeper, larger models have been proposed. However, the calculation cost becomes enormous as the size of the models becomes larger. Various techniques for compressing the size of the…

Machine Learning · Computer Science 2020-04-20 Hideki Oki , Motoshi Abe , Junichi Miyao , Takio Kurita

Large language models (LLMs) have achieved significant progress in natural language processing but face challenges in deployment due to high memory and computational requirements. Weight quantization is a common approach to address these…

Machine Learning · Computer Science 2025-06-17 Fangxin Liu , Ning Yang , Junping Zhao , Tao Yang , Haibing Guan , Li Jiang

Recently, multi-modal content generation has attracted lots of attention from researchers by investigating the utilization of visual instruction tuning based on large language models (LLMs). To enhance the performance and generalization…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Xinwei Li , Li Lin , Shuai Wang , Chen Qian

Growing efforts to improve knowledge distillation (KD) in large language models (LLMs) replace dense teacher supervision with selective distillation, which uses a subset of token positions, vocabulary classes, or training samples for…

Computation and Language · Computer Science 2026-02-03 Almog Tavor , Itay Ebenspanger , Neil Cnaan , Mor Geva

Knowledge distillation is a common technique for improving the performance of a shallow student network by transferring information from a teacher network, which in general, is comparatively large and deep. These teacher networks are…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Ishan Mishra , Sethu Vamsi Krishna , Deepak Mishra

Knowledge distillation (KD) is an effective model compression method that can transfer the internal capabilities of large language models (LLMs) to smaller ones. However, the multi-modal probability distribution predicted by teacher LLMs…

Computation and Language · Computer Science 2024-12-19 Tianyu Peng , Jiajun Zhang