English
Related papers

Related papers: Knowledge Distillation in Document Retrieval

200 papers

Knowledge distillation, which involves extracting the "dark knowledge" from a teacher network to guide the learning of a student network, has emerged as an essential technique for model compression and transfer learning. Unlike previous…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Guodong Xu , Ziwei Liu , Chen Change Loy

In recent years, deep learning has spread rapidly, and deeper, larger models have been proposed. However, the calculation cost becomes enormous as the size of the models becomes larger. Various techniques for compressing the size of the…

Machine Learning · Computer Science 2020-04-20 Hideki Oki , Motoshi Abe , Junichi Miyao , Takio Kurita

Teacher-student knowledge distillation is a popular technique for compressing today's prevailing large language models into manageable sizes that fit low-latency downstream applications. Both the teacher and the choice of transfer set used…

Computation and Language · Computer Science 2022-10-19 Charith Peris , Lizhen Tan , Thomas Gueudre , Turan Gojayev , Pan Wei , Gokmen Oz

Deep learning methods usually require a large amount of training data and lack interpretability. In this paper, we propose a novel knowledge distillation and model interpretation framework for medical image classification that jointly…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Thanh Nguyen-Duc , He Zhao , Jianfei Cai , Dinh Phung

Deep learning has shown promise in enhancing channel state information (CSI) feedback. However, many studies indicate that better feedback performance often accompanies higher computational complexity. Pursuing better performance-complexity…

Signal Processing · Electrical Eng. & Systems 2024-03-05 Yiming Cui , Jiajia Guo , Zheng Cao , Huaze Tang , Chao-Kai Wen , Shi Jin , Xin Wang , Xiaolin Hou

Recent advances in pre-training huge models on large amounts of text through self supervision have obtained state-of-the-art results in various natural language processing tasks. However, these huge and expensive models are difficult to use…

Computation and Language · Computer Science 2020-07-24 Subhabrata Mukherjee , Ahmed Hassan Awadallah

Knowledge distillation (KD) has been proven to be a simple and effective tool for training compact models. Almost all KD variants for dense prediction tasks align the student and teacher networks' feature maps in the spatial domain,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Changyong Shu , Yifan Liu , Jianfei Gao , Zheng Yan , Chunhua Shen

Large language models (LLMs) are known to memorize parts of their training data, raising important concerns around privacy and security. While previous research has focused on studying memorization in pre-trained models, much less is known…

Machine Learning · Computer Science 2025-08-19 Simardeep Singh

Knowledge Distillation (KD) is a widely-used technology to inherit information from cumbersome teacher models to compact student models, consequently realizing model compression and acceleration. Compared with image classification, object…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Gang Li , Xiang Li , Yujie Wang , Shanshan Zhang , Yichao Wu , Ding Liang

Large Language Models (LLMs) have showcased exceptional capabilities in various domains, attracting significant interest from both academia and industry. Despite their impressive performance, the substantial size and computational demands…

Computation and Language · Computer Science 2024-07-03 Chuanpeng Yang , Wang Lu , Yao Zhu , Yidong Wang , Qian Chen , Chenlong Gao , Bingjie Yan , Yiqiang Chen

The enhancement of mathematical capabilities in large language models (LLMs) fosters new developments in mathematics education within primary and secondary schools, particularly as they relate to intelligent tutoring systems. However, LLMs…

Computation and Language · Computer Science 2025-07-08 Zhenquan Shen , Xinguo Yu , Xiaotian Cheng , Rao Peng , Hao Ming

Knowledge Distillation (KD) is a widespread technique for compressing the knowledge of large models into more compact and efficient models. KD has proved to be highly effective in building well-performing low-complexity Acoustic Scene…

Sound · Computer Science 2025-03-17 Tobias Morocutti , Florian Schmid , Khaled Koutini , Gerhard Widmer

Knowledge Distillation (KD) has made remarkable progress in the last few years and become a popular paradigm for model compression and knowledge transfer. However, almost all existing KD algorithms are data-driven, i.e., relying on a large…

Machine Learning · Computer Science 2020-03-03 Gongfan Fang , Jie Song , Chengchao Shen , Xinchao Wang , Da Chen , Mingli Song

Knowledge distillation (KD) improves the performance of a low-complexity student model with the help of a more powerful teacher. The teacher in KD is a black-box model, imparting knowledge to the student only through its predictions. This…

Machine Learning · Computer Science 2023-10-05 Sayantan Chowdhury , Ben Liang , Ali Tizghadam , Ilijc Albanese

In many practical applications, large language models (LLMs) need to acquire new knowledge not present in their pre-training data. Efficiently leveraging this knowledge usually relies on supervised fine-tuning or retrieval-augmented…

Computation and Language · Computer Science 2025-08-08 Kalle Kujanpää , Pekka Marttinen , Harri Valpola , Alexander Ilin

Knowledge Distillation (KD) has proven effective for compressing large teacher models into smaller student models. While it is well known that student models can achieve similar accuracies as the teachers, it has also been shown that they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Amin Parchami-Araghi , Moritz Böhle , Sukrut Rao , Bernt Schiele

Recent language models have shown remarkable performance on natural language understanding (NLU) tasks. However, they are often sub-optimal when faced with ambiguous samples that can be interpreted in multiple ways, over-confidently…

Computation and Language · Computer Science 2024-06-17 Hancheol Park , Soyeong Jeong , Sukmin Cho , Jong C. Park

Active learning can be defined as iterations of data labeling, model training, and data acquisition, until sufficient labels are acquired. A traditional view of data acquisition is that, through iterations, knowledge from human labels and…

Machine Learning · Computer Science 2022-01-28 Beong-woo Kwak , Youngwook Kim , Yu Jin Kim , Seung-won Hwang , Jinyoung Yeo

Visual retrieval aims to search for the most relevant visual items, e.g., images and videos, from a candidate gallery with a given query item. Accuracy and efficiency are two competing objectives in retrieval tasks. Instead of crafting a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Zhe Ma , Jianfeng Dong , Shouling Ji , Zhenguang Liu , Xuhong Zhang , Zonghui Wang , Sifeng He , Feng Qian , Xiaobo Zhang , Lei Yang

Knowledge distillation compresses a larger neural model (teacher) into smaller, faster student models by training them to match teacher outputs. However, the internal computational transformations that occur during this process remain…

Machine Learning · Computer Science 2026-03-10 Reilly Haskins , Benjamin Adams