English
Related papers

Related papers: Online Knowledge Distillation with Reward Guidance

200 papers

Distilling large language models (LLMs) typically involves transferring the teacher model's responses through supervised fine-tuning (SFT). However, this approach neglects the potential to distill both data (output content) and reward…

Computation and Language · Computer Science 2025-02-28 Yudi Zhang , Lu Wang , Meng Fang , Yali Du , Chenghua Huang , Jun Wang , Qingwei Lin , Mykola Pechenizkiy , Dongmei Zhang , Saravan Rajmohan , Qi Zhang

Knowledge Distillation (KD) has made remarkable progress in the last few years and become a popular paradigm for model compression and knowledge transfer. However, almost all existing KD algorithms are data-driven, i.e., relying on a large…

Machine Learning · Computer Science 2020-03-03 Gongfan Fang , Jie Song , Chengchao Shen , Xinchao Wang , Da Chen , Mingli Song

Knowledge distillation (KD) aims to distill the knowledge from the teacher (larger) to the student (smaller) model via soft-label for the efficient neural network. In general, the performance of a model is determined by accuracy, which is…

Signal Processing · Electrical Eng. & Systems 2025-08-25 Stephen Ekaputra Limantoro

Knowledge distillation aims to enhance the performance of a lightweight student model by exploiting the knowledge from a pre-trained cumbersome teacher model. However, in the traditional knowledge distillation, teacher predictions are only…

Machine Learning · Computer Science 2023-05-26 Shiya Luo , Defang Chen , Can Wang

Knowledge Distillation (KD) emerges as one of the most promising compression technologies to run advanced deep neural networks on resource-limited devices. In order to train a small network (student) under the guidance of a large network…

Machine Learning · Computer Science 2023-12-15 Yi Guo , Yiqian He , Xiaoyang Li , Haotong Qin , Van Tung Pham , Yang Zhang , Shouda Liu

The deployment of large language models (LLMs) faces considerable challenges concerning resource constraints and inference efficiency. Recent research has increasingly focused on smaller, task-specific models enhanced by distilling…

Computation and Language · Computer Science 2024-09-20 Wei Wang , Zhaowei Li , Qi Xu , Yiqing Cai , Hang Song , Qi Qi , Ran Zhou , Zhida Huang , Tao Wang , Li Xiao

Deep learning models, particularly recurrent neural networks and their variants, such as long short-term memory, have significantly advanced time series data analysis. These models capture complex, sequential patterns in time series,…

Machine Learning · Computer Science 2026-01-12 Nilushika Udayangani , Kishor Nandakishor , Marimuthu Palaniswami

Effective query-item relevance modeling is pivotal for enhancing user experience and safeguarding user satisfaction in e-commerce search systems. Recently, benefiting from the vast inherent knowledge, Large Language Model (LLM) approach…

Information Retrieval · Computer Science 2025-02-11 Gang Zhao , Ximing Zhang , Chenji Lu , Hui Zhao , Tianshu Wu , Pengjie Wang , Jian Xu , Bo Zheng

Post-training of language models (LMs) increasingly relies on the following two stages: (i) knowledge distillation, where the LM is trained to imitate a larger teacher LM, and (ii) reinforcement learning from human feedback (RLHF), where…

Machine Learning · Computer Science 2025-02-06 Daniil Tiapkin , Daniele Calandriello , Johan Ferret , Sarah Perrin , Nino Vieillard , Alexandre Ramé , Mathieu Blondel

Deep neural models in recent years have been successful in almost every field, including extremely complex problem statements. However, these models are huge in size, with millions (and even billions) of parameters, thus demanding more…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Lin Wang , Kuk-Jin Yoon

Knowledge distillation (KD) is an effective tool for compressing deep classification models for edge devices. However, the performance of KD is affected by the large capacity gap between the teacher and student networks. Recent methods have…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Ibtihel Amara , Maryam Ziaeefard , Brett H. Meyer , Warren Gross , James J. Clark

Knowledge distillation (KD) has proven to be a successful strategy to improve the performance of smaller models in many NLP tasks. However, most of the work in KD only explores monolingual scenarios. In this paper, we investigate the value…

Computation and Language · Computer Science 2024-11-11 Haryo Akbarianto Wibowo , Thamar Solorio , Alham Fikri Aji

Recently, deep learning-based models have been widely studied for click-through rate (CTR) prediction and lead to improved prediction accuracy in many industrial applications. However, current research focuses primarily on building complex…

Machine Learning · Computer Science 2023-07-06 Jieming Zhu , Jinyang Liu , Weiqi Li , Jincai Lai , Xiuqiang He , Liang Chen , Zibin Zheng

In this work, we propose Mutual Information Maximization Knowledge Distillation (MIMKD). Our method uses a contrastive objective to simultaneously estimate and maximize a lower bound on the mutual information of local and global feature…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Aman Shrivastava , Yanjun Qi , Vicente Ordonez

Knowledge distillation (KD) has become a widely used technique in the field of model compression, which aims to transfer knowledge from a large teacher model to a lightweight student model for efficient network development. In addition to…

Machine Learning · Computer Science 2024-04-08 Weichao Lan , Yiu-ming Cheung , Qing Xu , Buhua Liu , Zhikai Hu , Mengke Li , Zhenghua Chen

Knowledge Distillation (KD) refers to transferring knowledge from a large model to a smaller one, which is widely used to enhance model performance in machine learning. It tries to align embedding spaces generated from the teacher and the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Weidong Shi , Guanghui Ren , Yunpeng Chen , Shuicheng Yan

Knowledge distillation (KD) is a substantial strategy for transferring learned knowledge from one neural network model to another. A vast number of methods have been developed for this strategy. While most method designs a more efficient…

Machine Learning · Computer Science 2022-03-22 Yen-Chang Hsu , James Smith , Yilin Shen , Zsolt Kira , Hongxia Jin

This research investigates the enhancement of knowledge distillation (KD) processes in pre-trained models, an emerging field in knowledge transfer with significant implications for distributed training and federated learning environments.…

Machine Learning · Computer Science 2025-07-23 Norah Alballa , Ahmed M. Abdelmoniem , Marco Canini

Large Language Models (LLMs) have shown promising performance in text-to-SQL, which involves translating natural language questions into SQL queries. However, current text-to-SQL LLMs are computationally expensive and challenging to deploy…

Computation and Language · Computer Science 2024-10-16 Qihuang Zhong , Kunfeng Chen , Liang Ding , Juhua Liu , Bo Du , Dacheng Tao

Recent recommender systems have started to employ knowledge distillation, which is a model compression technique distilling knowledge from a cumbersome model (teacher) to a compact model (student), to reduce inference latency while…

Machine Learning · Computer Science 2020-12-09 SeongKu Kang , Junyoung Hwang , Wonbin Kweon , Hwanjo Yu