English
Related papers

Related papers: Exploring the Limits of Model Compression in LLMs:…

200 papers

Large language models (LLMs) have garnered increasing attention owing to their powerful logical reasoning capabilities. Generally, larger LLMs (L-LLMs) that require paid interfaces exhibit significantly superior performance compared to…

Artificial Intelligence · Computer Science 2025-11-11 Dong Chen , Shilin Zhang , Fei Gao , Yueting Zhuang , Siliang Tang , Qidong Liu , Mingliang Xu

Retrained large language models (LLMs) have become extensively used across various sub-disciplines of natural language processing (NLP). In NLP, text classification problems have garnered considerable focus, but still faced with some…

Computation and Language · Computer Science 2023-12-05 Zhiqiang Wang , Yiran Pang , Yanbin Lin

Knowledge Distillation (KD) for Large Language Models (LLMs) has become increasingly important as models grow in size and complexity. While existing distillation approaches focus on imitating teacher behavior, they often overlook the…

Computation and Language · Computer Science 2026-02-16 Yuang Cai , Yuyu Yuan

Recent studies have demonstrated that Large Language Models (LLMs) have strong mathematical reasoning abilities but rely on hundreds of billions of parameters. To tackle the challenge of poor reasoning in Small Language Models (SLMs),…

Computation and Language · Computer Science 2025-08-19 Xinhe Li , Jiajun Liu , Peng Wang

Large Language Models (LLMs) have demonstrated exceptional proficiency in mathematical reasoning tasks due to their extensive parameter counts and training on vast datasets. Despite these capabilities, deploying LLMs is hindered by their…

Computation and Language · Computer Science 2024-10-11 Xunyu Zhu , Jian Li , Can Ma , Weiping Wang

Large Language Models (LLMs) have transformed natural language processing tasks successfully. Yet, their large size and high computational needs pose challenges for practical use, especially in resource-limited settings. Model compression…

Computation and Language · Computer Science 2024-07-31 Xunyu Zhu , Jian Li , Yong Liu , Can Ma , Weiping Wang

Knowledge Distillation (KD) is a model compression algorithm that helps transfer the knowledge of a large neural network into a smaller one. Even though KD has shown promise on a wide range of Natural Language Processing (NLP) applications,…

Computation and Language · Computer Science 2021-09-21 Tianda Li , Ahmad Rashid , Aref Jafari , Pranav Sharma , Ali Ghodsi , Mehdi Rezagholizadeh

Leading open-source large language models (LLMs) such as Llama-3.1-Instruct-405B are extremely capable at generating text, answering questions, and solving a variety of natural language understanding tasks. However, they incur higher…

Machine Learning · Computer Science 2024-10-25 Anup Shirgaonkar , Nikhil Pandey , Nazmiye Ceren Abay , Tolga Aktas , Vijay Aski

We study semi-supervised sequence generation tasks, where the few labeled examples are too scarce to finetune a model, and meanwhile, few-shot prompted large language models (LLMs) exhibit room for improvement. In this paper, we present the…

Computation and Language · Computer Science 2024-08-06 Jiachen Zhao , Wenlong Zhao , Andrew Drozdov , Benjamin Rozonoyer , Md Arafat Sultan , Jay-Yoon Lee , Mohit Iyyer , Andrew McCallum

Knowledge distillation is an effective technique for pre-trained language model compression. Although existing knowledge distillation methods perform well for the most typical model BERT, they could be further improved in two aspects: the…

Computation and Language · Computer Science 2024-07-04 Ying Zhang , Ziheng Yang , Shufan Ji

We perform knowledge distillation (KD) benchmark from task-specific BERT-base teacher models to various student models: BiLSTM, CNN, BERT-Tiny, BERT-Mini, and BERT-Small. Our experiment involves 12 datasets grouped in two tasks: text…

Computation and Language · Computer Science 2022-01-04 Made Nindyatama Nityasya , Haryo Akbarianto Wibowo , Rendi Chevi , Radityo Eko Prasojo , Alham Fikri Aji

This work studies knowledge distillation (KD) for large language models (LLMs) through preference optimization. We propose a reward-guided imitation learning framework for sequential KD, formulating a min-max optimization problem between…

Machine Learning · Computer Science 2025-05-27 Chen Jia

Knowledge distillation (KD) is an effective model compression technique where a compact student network is taught to mimic the behavior of a complex and highly trained teacher network. In contrast, Mutual Learning (ML) provides an…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Usma Niyaz , Deepti R. Bathula

Growing efforts to improve knowledge distillation (KD) in large language models (LLMs) replace dense teacher supervision with selective distillation, which uses a subset of token positions, vocabulary classes, or training samples for…

Computation and Language · Computer Science 2026-02-03 Almog Tavor , Itay Ebenspanger , Neil Cnaan , Mor Geva

Prompt engineering enables Large Language Models (LLMs) to perform a variety of tasks. However, lengthy prompts significantly increase computational complexity and economic costs. To address this issue, we study six prompt compression…

Computation and Language · Computer Science 2025-05-02 Zheng Zhang , Jinyi Li , Yihuai Lan , Xiang Wang , Hao Wang

Knowledge distillation offers a transformative pathway to developing powerful, yet efficient, small language models (SLMs) suitable for resource-constrained environments. In this paper, we benchmark the performance and computational cost of…

Computation and Language · Computer Science 2026-02-25 Sachin Gopal Wani , Eric Page , Ajay Dholakia , David Ellison

While large language models (LLMs) have demonstrated exceptional performance in recent natural language processing (NLP) tasks, their deployment poses substantial challenges due to high computational and memory demands in real-world…

Computation and Language · Computer Science 2024-02-27 Chenglin Li , Qianglong Chen , Liangyue Li , Caiyu Wang , Yicheng Li , Zulong Chen , Yin Zhang

Knowledge Distillation (KD) compresses computationally expensive pre-trained language models (PLMs) by transferring their knowledge to smaller models, allowing their use in resource-constrained or real-time settings. However, most smaller…

Computation and Language · Computer Science 2023-11-08 Hayeon Lee , Rui Hou , Jongpil Kim , Davis Liang , Hongbo Zhang , Sung Ju Hwang , Alexander Min

Previous studies have shown that demonstrations can significantly help Large Language Models (LLMs ) perform better on the given tasks. However, this so-called In-Context Learning ( ICL ) ability is very sensitive to the presenting context,…

Artificial Intelligence · Computer Science 2024-09-27 Weixing Wang , Haojin Yang , Christoph Meinel

Today, transformer language models serve as a core component for majority of natural language processing tasks. Industrial application of such models requires minimization of computation time and memory footprint. Knowledge distillation is…

Computation and Language · Computer Science 2022-05-06 Alina Kolesnikova , Yuri Kuratov , Vasily Konovalov , Mikhail Burtsev