English
Related papers

Related papers: Basic Reading Distillation

200 papers

Knowledge distillation (KD) is a core component in the training and deployment of modern generative models, particularly large language models (LLMs). While its empirical benefits are well documented -- enabling smaller student models to…

Machine Learning · Computer Science 2026-01-16 Sungmin Cha , Kyunghyun Cho

Knowledge distillation is an effective technique for pre-trained language model compression. Although existing knowledge distillation methods perform well for the most typical model BERT, they could be further improved in two aspects: the…

Computation and Language · Computer Science 2024-07-04 Ying Zhang , Ziheng Yang , Shufan Ji

Large Language Models (LLMs) can transfer their reasoning skills to smaller models by teaching them to generate the intermediate reasoning process required to solve multistep reasoning tasks. While LLMs can accurately solve reasoning tasks…

Artificial Intelligence · Computer Science 2024-10-25 Shivam Adarsh , Kumar Shridhar , Caglar Gulcehre , Nicholas Monath , Mrinmaya Sachan

Knowledge distillation (KD) is a common approach to compress a teacher model to reduce its inference cost and memory footprint, by training a smaller student model. However, in the context of autoregressive language models (LMs), we…

Computation and Language · Computer Science 2024-06-18 Qihuang Zhong , Liang Ding , Li Shen , Juhua Liu , Bo Du , Dacheng Tao

Neural machine translation (NMT) offers a novel alternative formulation of translation that is potentially simpler than statistical approaches. However to reach competitive performance, NMT models need to be exceedingly large. In this paper…

Computation and Language · Computer Science 2016-09-23 Yoon Kim , Alexander M. Rush

Large-scale language models have recently demonstrated impressive empirical performance. Nevertheless, the improved results are attained at the price of bigger models, more power consumption, and slower inference, which hinder their…

Computation and Language · Computer Science 2021-03-18 Kevin J Liang , Weituo Hao , Dinghan Shen , Yufan Zhou , Weizhu Chen , Changyou Chen , Lawrence Carin

Vision-Language Models (VLMs) bring powerful understanding and reasoning capabilities to multimodal tasks. Meanwhile, the great need for capable aritificial intelligence on mobile devices also arises, such as the AI assistant software. Some…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Qianhan Feng , Wenshuo Li , Tong Lin , Xinghao Chen

Owing to their powerful semantic reasoning capabilities, Large Language Models (LLMs) have been effectively utilized as recommenders, achieving impressive performance. However, the high inference latency of LLMs significantly restricts…

Information Retrieval · Computer Science 2024-08-21 Yu Cui , Feng Liu , Pengbo Wang , Bohao Wang , Heng Tang , Yi Wan , Jun Wang , Jiawei Chen

Sequence-level knowledge distillation (SLKD) is a model compression technique that leverages large, accurate teacher models to train smaller, under-parameterized student models. Why does pre-processing MT data with SLKD help us train…

Computation and Language · Computer Science 2019-12-10 Mitchell A. Gordon , Kevin Duh

Knowledge Distillation (KD) for Large Language Models (LLMs) has become increasingly important as models grow in size and complexity. While existing distillation approaches focus on imitating teacher behavior, they often overlook the…

Computation and Language · Computer Science 2026-02-16 Yuang Cai , Yuyu Yuan

The rapid advancement of large language models (LLMs) has significantly advanced the capabilities of artificial intelligence across various domains. However, their massive scale and high computational costs render them unsuitable for direct…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Miao Rang , Zhenni Bi , Hang Zhou , Hanting Chen , An Xiao , Tianyu Guo , Kai Han , Xinghao Chen , Yunhe Wang

Despite exciting progress in pre-training for visual-linguistic (VL) representations, very few aspire to a small VL model. In this paper, we study knowledge distillation (KD) to effectively compress a transformer-based large VL model into a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Zhiyuan Fang , Jianfeng Wang , Xiaowei Hu , Lijuan Wang , Yezhou Yang , Zicheng Liu

As Large Language Models (LLMs) continue to grow in both capability and cost, transferring frontier capabilities into smaller, deployable students has become a central engineering problem, and knowledge distillation remains the dominant…

Machine Learning · Computer Science 2026-05-19 Mingyang Song , Mao Zheng

Recent end-to-end approaches have shown promise in extending large language models (LLMs) to speech inputs, but face limitations in directly assessing and optimizing alignment quality and fail to achieve fine-grained alignment due to…

Computation and Language · Computer Science 2024-05-30 Chen Wang , Minpeng Liao , Zhongqiang Huang , Jiajun Zhang

The task of information retrieval is an important component of many natural language processing systems, such as open domain question answering. While traditional methods were based on hand-crafted features, continuous representations based…

Computation and Language · Computer Science 2022-08-05 Gautier Izacard , Edouard Grave

Query-service relevance prediction in e-commerce search systems faces strict latency requirements that prevent the direct application of Large Language Models (LLMs). To bridge this gap, we propose a two-stage reasoning distillation…

Information Retrieval · Computer Science 2026-01-27 Runze Xia , Yupeng Ji , Yuxi Zhou , Haodong Liu , Teng Zhang , Piji Li

The widespread deployment of Large Language Models (LLMs) is hindered by the high computational demands, making knowledge distillation (KD) crucial for developing compact smaller ones. However, the conventional KD methods endure the…

Computation and Language · Computer Science 2025-02-18 Zengkui Sun , Yijin Liu , Fandong Meng , Yufeng Chen , Jinan Xu , Jie Zhou

We introduce a state-of-the-art approach for URL categorization that leverages the power of Large Language Models (LLMs) to address the primary objectives of web content filtering: safeguarding organizations from legal and ethical risks,…

Machine Learning · Computer Science 2023-05-11 Tamás Vörös , Sean Paul Bergeron , Konstantin Berlin

In this paper, we explore multi-task learning (MTL) as a second pretraining step to learn enhanced universal language representation for transformer language models. We use the MTL enhanced representation across several natural language…

Computation and Language · Computer Science 2021-03-17 Haytham ElFadeel , Stan Peshterliev

Large language models (LLMs) have demonstrated remarkable capabilities across various NLP tasks. However, their computational costs are prohibitively high. To address this issue, previous research has attempted to distill the knowledge of…

Computation and Language · Computer Science 2024-03-12 Chengyuan Liu , Yangyang Kang , Fubang Zhao , Kun Kuang , Zhuoren Jiang , Changlong Sun , Fei Wu