English
Related papers

Related papers: DiPair: Fast and Accurate Distillation for Trillio…

200 papers

Distillation is an effective knowledge-transfer technique that uses predicted distributions of a powerful teacher model as soft targets to train a less-parameterized student model. A pre-trained high capacity teacher, however, is not always…

Machine Learning · Computer Science 2019-12-06 Defang Chen , Jian-Ping Mei , Can Wang , Yan Feng , Chun Chen

Diffusion Language Models (dLLMs) have emerged as promising alternatives to Auto-Regressive (AR) models. While recent efforts have validated their pre-training potential and accelerated inference speeds, the post-training landscape for…

Machine Learning · Computer Science 2026-01-07 Ying Zhu , Jiaxin Wan , Xiaoran Liu , Siyang He , Qiqi Wang , Xu Guo , Tianyi Liang , Zengfeng Huang , Ziwei He , Xipeng Qiu

Modern deep recommender models are trained under a continual learning paradigm, relying on massive and continuously growing streaming behavioral logs. In large-scale platforms, retraining models on full historical data for architecture…

Information Retrieval · Computer Science 2026-03-27 Jiaqing Zhang , Hao Wang , Mingjia Yin , Bo Chen , Qinglin Jia , Rui Zhou , Ruiming Tang , ChaoYi Ma , Enhong Chen

Large language models (LLMs) have become increasingly prevalent in our daily lives, leading to an expectation for LLMs to be trustworthy -- - both accurate and well-calibrated (the prediction confidence should align with its ground truth…

Computation and Language · Computer Science 2024-10-04 KaShun Shum , Minrui Xu , Jianshu Zhang , Zixin Chen , Shizhe Diao , Hanze Dong , Jipeng Zhang , Muhammad Omer Raza

This study proposes a method for knowledge distillation (KD) of fine-tuned Large Language Models (LLMs) into smaller, more efficient, and accurate neural networks. We specifically target the challenge of deploying these models on…

Computation and Language · Computer Science 2024-06-13 Ehsan Latif , Luyang Fang , Ping Ma , Xiaoming Zhai

Large Language Models (LLM) have demonstrated their strong ability in the field of machine translation (MT), yet they suffer from high computational cost and latency. Therefore, transferring translation knowledge from giant LLMs to…

Computation and Language · Computer Science 2024-04-02 Jiahuan Li , Shanbo Cheng , Shujian Huang , Jiajun Chen

Model distillation has emerged as a prominent technique to improve neural search models. To date, distillation taken an offline approach, wherein a new neural model is trained to predict relevance scores between arbitrary queries and…

Information Retrieval · Computer Science 2023-06-19 Sean MacAvaney , Xi Wang

Math Word Problem (MWP) solving is a critical task in natural language processing, has garnered significant research interest in recent years. Various recent studies heavily rely on Seq2Seq models and their extensions (e.g., Seq2Tree and…

Computation and Language · Computer Science 2025-01-08 Yi Zhang , Guangyou Zhou , Zhiwen Xie , Jinjin Ma , Jimmy Xiangji Huang

Deep pre-training and fine-tuning models (such as BERT and OpenAI GPT) have demonstrated excellent results in question answering areas. However, due to the sheer amount of model parameters, the inference speed of these models is very slow.…

Computation and Language · Computer Science 2019-10-21 Ze Yang , Linjun Shou , Ming Gong , Wutao Lin , Daxin Jiang

Retrieval-augmented generation framework can address the limitations of large language models by enabling real-time knowledge updates for more accurate answers. An efficient way in the training phase of retrieval-augmented models is…

Computation and Language · Computer Science 2024-02-20 Zizhong Li , Haopeng Zhang , Jiawei Zhang

Model distillation aims to distill the knowledge of a complex model into a simpler one. In this paper, we consider an alternative formulation called dataset distillation: we keep the model fixed and instead attempt to distill the knowledge…

Machine Learning · Computer Science 2020-02-26 Tongzhou Wang , Jun-Yan Zhu , Antonio Torralba , Alexei A. Efros

We propose a cross-modal attention distillation framework to train a dual-encoder model for vision-language understanding tasks, such as visual reasoning and visual question answering. Dual-encoder models have a faster inference speed than…

Computation and Language · Computer Science 2022-10-18 Zekun Wang , Wenhui Wang , Haichao Zhu , Ming Liu , Bing Qin , Furu Wei

Recent advances in open-domain dialogue systems rely on the success of neural models that are trained on large-scale data. However, collecting large-scale dialogue data is usually time-consuming and labor-intensive. To address this data…

Computation and Language · Computer Science 2020-11-11 Rongsheng Zhang , Yinhe Zheng , Jianzhi Shao , Xiaoxi Mao , Yadong Xi , Minlie Huang

Deep and large pre-trained language models are the state-of-the-art for various natural language processing tasks. However, the huge size of these models could be a deterrent to use them in practice. Some recent and concurrent works use…

Computation and Language · Computer Science 2020-05-06 Subhabrata Mukherjee , Ahmed Awadallah

Code retrieval aims to provide users with desired code snippets based on users' natural language queries. With the development of deep learning technologies, adopting pre-trained models for this task has become mainstream. Considering the…

Software Engineering · Computer Science 2025-08-04 Wenchao Gu , Zongyi Lyu , Yanlin Wang , Hongyu Zhang , Cuiyun Gao , Michael R. Lyu

Knowledge Distillation is an effective method of transferring knowledge from a large model to a smaller model. Distillation can be viewed as a type of model compression, and has played an important role for on-device ASR applications. In…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-13 Sankaran Panchapagesan , Daniel S. Park , Chung-Cheng Chiu , Yuan Shangguan , Qiao Liang , Alexander Gruenstein

We present an approach to ranking with dense representations that applies knowledge distillation to improve the recently proposed late-interaction ColBERT model. Specifically, we distill the knowledge from ColBERT's expressive MaxSim…

Information Retrieval · Computer Science 2020-10-23 Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin

Distilling knowledge from a large teacher model to a lightweight one is a widely successful approach for generating compact, powerful models in the semi-supervised learning setting where a limited amount of labeled data is available. In…

Machine Learning · Computer Science 2023-02-07 Cenk Baykal , Khoa Trinh , Fotis Iliopoulos , Gaurav Menghani , Erik Vee

Topic models are often used to identify human-interpretable topics to help make sense of large document collections. We use knowledge distillation to combine the best attributes of probabilistic topic models and pretrained transformers. Our…

Computation and Language · Computer Science 2020-10-07 Alexander Hoyle , Pranav Goel , Philip Resnik

Keyphrase extraction is the task of extracting a small set of phrases that best describe a document. Most existing benchmark datasets for the task typically have limited numbers of annotated documents, making it challenging to train…

Computation and Language · Computer Science 2020-10-26 Tuan Manh Lai , Trung Bui , Doo Soon Kim , Quan Hung Tran