English
Related papers

Related papers: HRKD: Hierarchical Relational Knowledge Distillati…

200 papers

Deep Neural Networks (DNNs) have achieved notable performance in the fields of computer vision and natural language processing with various applications in both academia and industry. However, with recent advancements in DNNs and…

Generalized Category Discovery (GCD) faces the challenge of categorizing unlabeled data containing both known and novel classes, given only labels for known classes. Previous studies often treat each class independently, neglecting the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Fang Zhou , Zhiqiang Chen , Martin Pavlovski , Yizhong Zhang

Model compression through knowledge distillation has seen extensive application in classification and segmentation tasks. However, its potential in image-to-image translation, particularly in image restoration, remains underexplored. To…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Yongheng Zhang , Danfeng Yan

This survey paper delves into the emerging and critical area of symbolic knowledge distillation in Large Language Models (LLMs). As LLMs like Generative Pre-trained Transformer-3 (GPT-3) and Bidirectional Encoder Representations from…

Computation and Language · Computer Science 2024-08-21 Kamal Acharya , Alvaro Velasquez , Houbing Herbert Song

Knowledge distillation (KD) is a key technique for compressing large language models into smaller ones while preserving performance. Despite the recent traction of KD research, its effectiveness for smaller language models (LMs) and the…

Computation and Language · Computer Science 2025-08-05 Suhas Kamasetty Ramesh , Ayan Sengupta , Tanmoy Chakraborty

Dataset distillation aims to compress a training dataset by creating a small number of informative synthetic samples such that neural networks trained on them perform as well as those trained on the original training dataset. Current text…

Computation and Language · Computer Science 2024-04-02 Aru Maekawa , Satoshi Kosugi , Kotaro Funakoshi , Manabu Okumura

Large language models (LLMs) have significantly advanced various natural language processing tasks, but deploying them remains computationally expensive. Knowledge distillation (KD) is a promising solution, enabling the transfer of…

Computation and Language · Computer Science 2024-10-22 Yuhang Zhou , Jing Zhu , Paiheng Xu , Xiaoyu Liu , Xiyao Wang , Danai Koutra , Wei Ai , Furong Huang

Data-Free Knowledge Distillation (DFKD) plays a vital role in compressing the model when original training data is unavailable. Previous works for DFKD in NLP mainly focus on distilling encoder-only structures like BERT on classification…

Computation and Language · Computer Science 2023-11-06 Zheyuan Bai , Xinduo Liu , Hailin Hu , Tianyu Guo , Qinghua Zhang , Yunhe Wang

While self-supervised representation learning (SSL) has proved to be effective in the large model, there is still a huge gap between the SSL and supervised method in the lightweight model when following the same solution. We delve into this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Kai Zheng , Yuanjiang Wang , Ye Yuan

Multimodal sentiment analysis (MSA) aims to understand human sentiment through multimodal data. Most MSA efforts are based on the assumption of modality completeness. However, in real-world applications, some practical factors cause…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Mingcheng Li , Dingkang Yang , Xiao Zhao , Shuaibing Wang , Yan Wang , Kun Yang , Mingyang Sun , Dongliang Kou , Ziyun Qian , Lihua Zhang

Knowledge distillation (KD) is the process of transferring knowledge from a large model to a small one. It has gained increasing attention in the natural language processing community, driven by the demands of compressing ever-growing…

Computation and Language · Computer Science 2023-07-31 Yuqiao Wen , Zichao Li , Wenyu Du , Lili Mou

The recent surge in Multimodal Large Language Models (MLLMs) has showcased their remarkable potential for achieving generalized intelligence by integrating visual understanding into Large Language Models.Nevertheless, the sheer model size…

Computation and Language · Computer Science 2024-07-30 Shilin Xu , Xiangtai Li , Haobo Yuan , Lu Qi , Yunhai Tong , Ming-Hsuan Yang

This work studies knowledge distillation (KD) for large language models (LLMs) through preference optimization. We propose a reward-guided imitation learning framework for sequential KD, formulating a min-max optimization problem between…

Machine Learning · Computer Science 2025-05-27 Chen Jia

Due to limitations in data quality, some essential visual tasks are difficult to perform independently. Introducing previously unavailable information to transfer informative dark knowledge has been a common way to solve such hard tasks.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Lingyu Si , Hongwei Dong , Wenwen Qiang , Junzhi Yu , Wenlong Zhai , Changwen Zheng , Fanjiang Xu , Fuchun Sun

Despite exciting progress in pre-training for visual-linguistic (VL) representations, very few aspire to a small VL model. In this paper, we study knowledge distillation (KD) to effectively compress a transformer-based large VL model into a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Zhiyuan Fang , Jianfeng Wang , Xiaowei Hu , Lijuan Wang , Yezhou Yang , Zicheng Liu

Modern Natural Language Generation (NLG) models come with massive computational and storage requirements. In this work, we study the potential of compressing them, which is crucial for real-world applications serving millions of users. We…

Computation and Language · Computer Science 2023-05-29 Nitay Calderon , Subhabrata Mukherjee , Roi Reichart , Amir Kantor

Large Language Models (LLMs) have attracted significant attention in recommender systems for their excellent world knowledge capabilities. However, existing methods that rely on Euclidean space struggle to capture the rich hierarchical…

Information Retrieval · Computer Science 2025-04-22 Wentao Cheng , Zhida Qin , Zexue Wu , Pengzhan Zhou , Tianyu Huang

Knowledge distillation (KD) is one of the prominent techniques for model compression. In this method, the knowledge of a large network (teacher) is distilled into a model (student) with usually significantly fewer parameters. KD tries to…

Machine Learning · Computer Science 2023-01-31 Aref Jafari , Mehdi Rezagholizadeh , Ali Ghodsi

Recent end-to-end approaches have shown promise in extending large language models (LLMs) to speech inputs, but face limitations in directly assessing and optimizing alignment quality and fail to achieve fine-grained alignment due to…

Computation and Language · Computer Science 2024-05-30 Chen Wang , Minpeng Liao , Zhongqiang Huang , Jiajun Zhang

Model distillation is a fundamental technique in building large language models (LLMs), transferring knowledge from a teacher model to a student model. However, distillation can lead to model homogenization, reducing diversity among models…