English
Related papers

Related papers: Task-Specific Knowledge Distillation via Intermedi…

200 papers

There is increasing interest in distilling task-specific knowledge from large language models (LLM) to smaller student models. Nonetheless, LLM distillation presents a dual challenge: 1) there is a high cost associated with querying the…

Computation and Language · Computer Science 2024-06-11 Yuhang Zhou , Wei Ai

Artificial Intelligence (AI) has increasingly influenced modern society, recently in particular through significant advancements in Large Language Models (LLMs). However, high computational and storage demands of LLMs still limit their…

Computation and Language · Computer Science 2025-04-23 Daniel Hendriks , Philipp Spitzer , Niklas Kühl , Gerhard Satzger

Knowledge distillation in machine learning is the process of transferring knowledge from a large model called the teacher to a smaller model called the student. Knowledge distillation is one of the techniques to compress the large network…

Machine Learning · Computer Science 2022-06-27 Durga Prasad Ganta , Himel Das Gupta , Victor S. Sheng

Leading open-source large language models (LLMs) such as Llama-3.1-Instruct-405B are extremely capable at generating text, answering questions, and solving a variety of natural language understanding tasks. However, they incur higher…

Machine Learning · Computer Science 2024-10-25 Anup Shirgaonkar , Nikhil Pandey , Nazmiye Ceren Abay , Tolga Aktas , Vijay Aski

In knowledge distillation, a student model is trained with supervisions from both knowledge from a teacher and observations drawn from a training data distribution. Knowledge of a teacher is considered a subject that holds inter-class…

Computation and Language · Computer Science 2022-10-25 Dongkyu Lee , Zhiliang Tian , Yingxiu Zhao , Ka Chun Cheung , Nevin L. Zhang

The enhancement of mathematical capabilities in large language models (LLMs) fosters new developments in mathematics education within primary and secondary schools, particularly as they relate to intelligent tutoring systems. However, LLMs…

Computation and Language · Computer Science 2025-07-08 Zhenquan Shen , Xinguo Yu , Xiaotian Cheng , Rao Peng , Hao Ming

Knowledge distillation has emerged as an effective strategy for compressing large language models' (LLMs) knowledge into smaller, more efficient student models. However, standard one-shot distillation methods often produce suboptimal…

Computation and Language · Computer Science 2025-04-04 Kushal Jain , Piyushi Goyal , Kumar Shridhar

Knowledge distillation has emerged as a pivotal technique for transferring knowledge from stronger large language models (LLMs) to smaller, more efficient models. However, traditional distillation approaches face challenges related to…

Computation and Language · Computer Science 2026-04-14 Ruihan Jin , Pengpeng Shao , Zhengqi Wen , Jinyang Wu , Mingkuan Feng , Shuo Yang , Chu Yuan Zhang , Jianhua Tao

Large language models (LLMs) are trained on massive corpora that may contain sensitive information, creating privacy risks under membership inference attacks (MIAs). Knowledge distillation is widely used to compress LLMs into smaller…

Machine Learning · Computer Science 2026-01-13 Ziyao Cui , Minxing Zhang , Jian Pei

Distilling large language models (LLMs) typically involves transferring the teacher model's responses through supervised fine-tuning (SFT). However, this approach neglects the potential to distill both data (output content) and reward…

Computation and Language · Computer Science 2025-02-28 Yudi Zhang , Lu Wang , Meng Fang , Yali Du , Chenghua Huang , Jun Wang , Qingwei Lin , Mykola Pechenizkiy , Dongmei Zhang , Saravan Rajmohan , Qi Zhang

The widespread deployment of Large Language Models (LLMs) is hindered by the high computational demands, making knowledge distillation (KD) crucial for developing compact smaller ones. However, the conventional KD methods endure the…

Computation and Language · Computer Science 2025-02-18 Zengkui Sun , Yijin Liu , Fandong Meng , Yufeng Chen , Jinan Xu , Jie Zhou

Knowledge distillation transfers behavior from a teacher to a student model, but the process is inherently stochastic: teacher outputs, student training, and student inference can all be random. Collapsing these uncertainties to a single…

Machine Learning · Computer Science 2026-01-28 Ziyao Cui , Jian Pei

In-context learning (ICL) allows large language models (LLMs) to solve novel tasks without weight updates. Despite its empirical success, the mechanism behind ICL remains poorly understood, limiting our ability to interpret, improve, and…

Machine Learning · Computer Science 2025-06-16 Chengye Li , Haiyun Liu , Yuanxi Li

Large language models (LLMs) have become increasingly prevalent in our daily lives, leading to an expectation for LLMs to be trustworthy -- - both accurate and well-calibrated (the prediction confidence should align with its ground truth…

Computation and Language · Computer Science 2024-10-04 KaShun Shum , Minrui Xu , Jianshu Zhang , Zixin Chen , Shizhe Diao , Hanze Dong , Jipeng Zhang , Muhammad Omer Raza

Knowledge distillation from Large Language Models (LLMs) to smaller models has emerged as a critical technique for deploying efficient AI systems. However, current methods for distillation via synthetic data lack pedagogical awareness,…

Artificial Intelligence · Computer Science 2026-02-13 Bowei He , Yankai Chen , Xiaokun Zhang , Linghe Kong , Philip S. Yu , Xue Liu , Chen Ma

In recent years, many explanation methods have been proposed to explain individual classifications of deep neural networks. However, how to leverage the created explanations to improve the learning process has been less explored. As the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Jindong Gu , Zhiliang Wu , Volker Tresp

Pre-trained language models (PLMs) achieve great success in NLP. However, their huge model sizes hinder their applications in many practical systems. Knowledge distillation is a popular technique to compress PLMs, which learns a small…

Computation and Language · Computer Science 2021-06-03 Chuhan Wu , Fangzhao Wu , Yongfeng Huang

Knowledge Distillation (KD) has emerged as a promising approach for transferring knowledge from a larger, more complex teacher model to a smaller student model. Traditionally, KD involves training the student to mimic the teacher's output…

Machine Learning · Computer Science 2024-10-03 Noel Loo , Fotis Iliopoulos , Wei Hu , Erik Vee

Standard Knowledge Distillation (KD) compresses Large Language Models (LLMs) by optimizing final outputs, yet it typically treats the teacher's intermediate layer's thought process as a black box. While feature-based distillation attempts…

Computation and Language · Computer Science 2026-02-17 Manish Dhakal , Uthman Jinadu , Anjila Budathoki , Rajshekhar Sunderraman , Yi Ding

Knowledge distillation is used, in generative language modeling, to train a smaller student model using the help of a larger teacher model, resulting in improved capabilities for the student model. In this paper, we formulate a more general…

Computation and Language · Computer Science 2025-02-26 Guanlin Liu , Anand Ramachandran , Tanmay Gangwani , Yan Fu , Abhinav Sethy