English
Related papers

Related papers: PILE: Pairwise Iterative Logits Ensemble for Multi…

200 papers

In recent years, multi-label classification problem has become a controversial issue. In this kind of classification, each sample is associated with a set of class labels. Ensemble approaches are supervised learning algorithms in which an…

Machine Learning · Computer Science 2018-01-09 Amirreza Mahdavi-Shahri , Mahboobeh Houshmand , Mahdi Yaghoobi , Mehrdad Jalali

Knowledge distillation addresses the problem of transferring knowledge from a teacher model to a student model. In this process, we typically have multiple types of knowledge extracted from the teacher model. The problem is to make full use…

Computation and Language · Computer Science 2023-02-02 Chenglong Wang , Yi Lu , Yongyu Mu , Yimin Hu , Tong Xiao , Jingbo Zhu

Traditional knowledge distillation uses a two-stage training strategy to transfer knowledge from a high-capacity teacher model to a compact student model, which relies heavily on the pre-trained teacher. Recent online knowledge distillation…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Guile Wu , Shaogang Gong

This paper addresses the challenges of high computational cost and slow inference in deploying large language models. It proposes a distillation strategy guided by multiple teacher models. The method constructs several teacher models and…

Computation and Language · Computer Science 2025-07-22 Xiandong Meng , Yan Wu , Yexin Tian , Xin Hu , Tianze Kang , Junliang Du

Knowledge distillation can be a cost-effective technique to distill knowledge in Large Language Models, if the teacher output logits can be pre-computed and cached. However, successfully applying this to pre-training remains largely…

Machine Learning · Computer Science 2025-07-25 Anshumann , Mohd Abbas Zaidi , Akhil Kedia , Jinwoo Ahn , Taehwak Kwon , Kangwook Lee , Haejun Lee , Joohyung Lee

Pre-trained models like BERT (Devlin et al., 2018) have dominated NLP / IR applications such as single sentence classification, text pair classification, and question answering. However, deploying these models in real systems is highly…

Computation and Language · Computer Science 2021-05-06 Jiecao Chen , Liu Yang , Karthik Raman , Michael Bendersky , Jung-Jung Yeh , Yun Zhou , Marc Najork , Danyang Cai , Ehsan Emadzadeh

Effective organization of in-context learning (ICL) demonstrations is key to improving the quality of large language model (LLM) responses. To create better sample-label pairs that instruct LLM understanding, we introduce logit…

Computation and Language · Computer Science 2024-10-16 Zhu Zixiao , Feng Zijian , Zhou Hanzhang , Qian Junlang , Mao Kezhi

Although BERT-based ranking models have been commonly used in commercial search engines, they are usually time-consuming for online ranking tasks. Knowledge distillation, which aims at learning a smaller model with comparable performance to…

Information Retrieval · Computer Science 2023-02-09 Xubo Qin , Xiyuan Liu , Xiongfeng Zheng , Jie Liu , Yutao Zhu

Knowledge distillation with unlabeled examples is a powerful training paradigm for generating compact and lightweight student models in applications where the amount of labeled data is limited but one has access to a large pool of unlabeled…

Machine Learning · Computer Science 2023-06-12 Vasilis Kontonis , Fotis Iliopoulos , Khoa Trinh , Cenk Baykal , Gaurav Menghani , Erik Vee

Knowledge distillation aims to compress a powerful yet cumbersome teacher model into a lightweight student model without much sacrifice of performance. For this purpose, various approaches have been proposed over the past few years,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Defang Chen , Jian-Ping Mei , Hailin Zhang , Can Wang , Yan Feng , Chun Chen

Knowledge distillation has emerged as an effective strategy for compressing large language models' (LLMs) knowledge into smaller, more efficient student models. However, standard one-shot distillation methods often produce suboptimal…

Computation and Language · Computer Science 2025-04-04 Kushal Jain , Piyushi Goyal , Kumar Shridhar

Data-free knowledge distillation is a challenging model lightweight task for scenarios in which the original dataset is not available. Previous methods require a lot of extra computational costs to update one or more generators and their…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Yuzheng Wang , Zuhao Ge , Zhaoyu Chen , Xian Liu , Chuangjia Ma , Yunquan Sun , Lizhe Qi

Knowledge distillation is often used to transfer knowledge from a strong teacher model to a relatively weak student model. Traditional methods include response-based methods and feature-based methods. Response-based methods are widely used…

Information Retrieval · Computer Science 2023-12-12 Hao Sun , Xiao Liu , Yeyun Gong , Anlei Dong , Jingwen Lu , Yan Zhang , Linjun Yang , Rangan Majumder , Nan Duan

Real-world data usually suffers from severe class imbalance and long-tailed distributions, where minority classes are significantly underrepresented compared to the majority ones. Recent research prefers to utilize multi-expert…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Zhengzhuo Xu , Zenghao Chai , Chengyin Xu , Chun Yuan , Haiqin Yang

We formally study how ensemble of deep learning models can improve test accuracy, and how the superior performance of ensemble can be distilled into a single model using knowledge distillation. We consider the challenging case where the…

Machine Learning · Computer Science 2023-02-16 Zeyuan Allen-Zhu , Yuanzhi Li

Knowledge distillation in machine learning is the process of transferring knowledge from a large model called the teacher to a smaller model called the student. Knowledge distillation is one of the techniques to compress the large network…

Machine Learning · Computer Science 2022-06-27 Durga Prasad Ganta , Himel Das Gupta , Victor S. Sheng

This paper proposes a novel knowledge distillation-based learning method to improve the classification performance of convolutional neural networks (CNNs) without a pre-trained teacher network, called exit-ensemble distillation. Our method…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Hojung Lee , Jong-Seok Lee

Conventional knowledge distillation (KD) methods require access to the internal information of teachers, e.g., logits. However, such information may not always be accessible for large pre-trained language models (PLMs). In this work, we…

Computation and Language · Computer Science 2023-06-16 Qinhong Zhou , Zonghan Yang , Peng Li , Yang Liu

Knowledge distillation is an efficient strategy to use data generated by large "teacher" language models to train smaller capable "student" models, but selecting the optimal teacher for a specific student-task combination requires expensive…

Machine Learning · Computer Science 2025-12-23 Abhishek Panigrahi , Bingbin Liu , Sadhika Malladi , Sham Kakade , Surbhi Goel

It is well known that a speech recognition system that combines multiple acoustic models trained on the same data significantly outperforms a single-model system. Unfortunately, real time speech recognition using a whole ensemble of models…

Computation and Language · Computer Science 2019-06-27 Zhenchuan Yang , Chun Zhang , Weibin Zhang , Jianxiu Jin , Dongpeng Chen