English
Related papers

Related papers: TransKD: Transformer Knowledge Distillation for Ef…

200 papers

Knowledge Distillation (KD) is a powerful approach for compressing a large model into a smaller, more efficient model, particularly beneficial for latency-sensitive applications like recommender systems. However, current KD research…

Information Retrieval · Computer Science 2024-08-28 Nikhil Khani , Shuo Yang , Aniruddh Nath , Yang Liu , Pendo Abbo , Li Wei , Shawn Andrews , Maciej Kula , Jarrod Kahn , Zhe Zhao , Lichan Hong , Ed Chi

Increased training parameters have enabled large pre-trained models to excel in various downstream tasks. Nevertheless, the extensive computational requirements associated with these models hinder their widespread adoption within the…

Artificial Intelligence · Computer Science 2024-11-12 Yu-Liang Zhan , Zhong-Yi Lu , Hao Sun , Ze-Feng Gao

This paper aims to provide a selective survey about knowledge distillation(KD) framework for researchers and practitioners to take advantage of it for developing new optimized models in the deep neural network field. To this end, we give a…

Machine Learning · Computer Science 2020-12-01 Jeong-Hoe Ku , JiHun Oh , YoungYoon Lee , Gaurav Pooniwala , SangJeong Lee

Knowledge Distillation (KD) aims to learn a compact student network using knowledge from a large pre-trained teacher network, where both networks are trained on data from the same distribution. However, in practical applications, the…

Machine Learning · Computer Science 2024-01-17 Jialiang Tang , Shuo Chen , Gang Niu , Hongyuan Zhu , Joey Tianyi Zhou , Chen Gong , Masashi Sugiyama

Deep pre-training and fine-tuning models (such as BERT and OpenAI GPT) have demonstrated excellent results in question answering areas. However, due to the sheer amount of model parameters, the inference speed of these models is very slow.…

Computation and Language · Computer Science 2019-10-21 Ze Yang , Linjun Shou , Ming Gong , Wutao Lin , Daxin Jiang

Most of recent attention-guided feature masking distillation methods perform knowledge transfer via global teacher attention maps without delving into fine-grained clues. Instead, performing distillation at finer granularity is conducive to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Zhourui Zhang , Jun Li , Jiayan Li , Jianhua Xu

This work introduces a novel knowledge distillation framework for classification tasks where information on existing subclasses is available and taken into consideration. In classification tasks with a small number of classes or binary…

Machine Learning · Computer Science 2022-07-19 Ahmad Sajedi , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Multimodal dataset distillation aims to construct compact synthetic datasets that enable efficient compression and knowledge transfer from large-scale image-text data. However, existing approaches often fail to capture the complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Shengbin Guo , Hang Zhao , Senqiao Yang , Chenyang Jiang , Yuhang Cheng , Xiangru Peng , Rui Shao , Zhuotao Tian

Knowledge distillation (KD) has shown to be effective to boost the performance of graph neural networks (GNNs), where the typical objective is to distill knowledge from a deeper teacher GNN into a shallower student GNN. However, it is often…

Machine Learning · Computer Science 2023-11-17 Kaituo Feng , Yikun Miao , Changsheng Li , Ye Yuan , Guoren Wang

Gait recognition is an attractive biometric modality for long-range and contact-free identification, but high-performing gait models often rely on deep and computationally expensive architectures that are difficult to deploy in practice.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Yuqi Li , Qian Zhou , Huiran Duan , Jingjie Wang , Shunli Zhang , Chuanguang Yang , Guoying Zhao , Yingli Tian

Structured prediction models aim at solving a type of problem where the output is a complex structure, rather than a single variable. Performing knowledge distillation for such models is not trivial due to their exponentially large output…

Machine Learning · Computer Science 2022-03-10 Wenye Lin , Yangming Li , Lemao Liu , Shuming Shi , Hai-tao Zheng

Large language models (LLMs) learn contextual embeddings that capture rich semantic information, yet they often overlook structured lexical knowledge such as word senses and relationships. Prior work has shown that incorporating sense…

Computation and Language · Computer Science 2026-02-27 Qitong Wang , Mohammed J. Zaki , Georgios Kollias , Vasileios Kalantzis

Semantic segmentation of 3D LiDAR data plays a pivotal role in autonomous driving. Traditional approaches rely on extensive annotated data for point cloud analysis, incurring high costs and time investments. In contrast, realworld image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jialiang Kang , Jiawen Wang , Dingsheng Luo

Recent recommender systems have shown remarkable performance by using an ensemble of heterogeneous models. However, it is exceedingly costly because it requires resources and inference latency proportional to the number of models, which…

Information Retrieval · Computer Science 2023-03-03 SeongKu Kang , Wonbin Kweon , Dongha Lee , Jianxun Lian , Xing Xie , Hwanjo Yu

Large pre-trained transformer-based language models have achieved impressive results on a wide range of NLP tasks. In the past few years, Knowledge Distillation(KD) has become a popular paradigm to compress a computationally expensive model…

Computation and Language · Computer Science 2020-10-13 Xinyin Ma , Yongliang Shen , Gongfan Fang , Chen Chen , Chenghao Jia , Weiming Lu

Knowledge Distillation (KD) is a common knowledge transfer algorithm used for model compression across a variety of deep learning based natural language processing (NLP) solutions. In its regular manifestations, KD requires access to the…

Computation and Language · Computer Science 2021-01-01 Ahmad Rashid , Vasileios Lioutas , Abbas Ghaddar , Mehdi Rezagholizadeh

Knowledge distillation (KD), a technique widely employed in computer vision, has emerged as a de facto standard for improving the performance of small neural networks. However, prevailing KD-based approaches in video tasks primarily focus…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Guiqin Wang , Peng Zhao , Yanjiang Shi , Cong Zhao , Shusen Yang

Knowledge Distillation (KD) transfers knowledge from a large pre-trained teacher network to a compact and efficient student network, making it suitable for deployment on resource-limited media terminals. However, traditional KD methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Xinlei Huang , Jialiang Tang , Xubin Zheng , Jinjia Zhou , Wenxin Yu , Ning Jiang

We study the problem of distilling knowledge from a large deep teacher network to a much smaller student network for the task of road marking segmentation. In this work, we explore a novel knowledge distillation (KD) approach that can…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yuenan Hou , Zheng Ma , Chunxiao Liu , Tak-Wai Hui , Chen Change Loy

Knowledge distillation (KD) is a widely-used technique that utilizes large networks to improve the performance of compact models. Previous KD approaches usually aim to guide the student to mimic the teacher's behavior completely in the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yuge Huang , Jiaxiang Wu , Xingkun Xu , Shouhong Ding