English
Related papers

Related papers: Learnable Cross-modal Knowledge Distillation for M…

200 papers

Cross-modal Knowledge Distillation has demonstrated promising performance on paired modalities with strong semantic connections, referred to as Symmetric Cross-modal Knowledge Distillation (SCKD). However, implementing SCKD becomes…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Riling Wei , Kelu Yao , Chuanguang Yang , Jin Wang , Zhuoyan Gao , Chao Li

Knowledge distillation addresses the problem of transferring knowledge from a teacher model to a student model. In this process, we typically have multiple types of knowledge extracted from the teacher model. The problem is to make full use…

Computation and Language · Computer Science 2023-02-02 Chenglong Wang , Yi Lu , Yongyu Mu , Yimin Hu , Tong Xiao , Jingbo Zhu

It is challenging to perform lifelong language learning (LLL) on a stream of different tasks without any performance degradation comparing to the multi-task counterparts. To address this issue, we present Lifelong Language Knowledge…

Computation and Language · Computer Science 2020-10-06 Yung-Sung Chuang , Shang-Yu Su , Yun-Nung Chen

Recently, large-scale pre-trained models have shown their advantages in many tasks. However, due to the huge computational complexity and storage requirements, it is challenging to apply the large-scale model to real scenes. A common…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Deng Li , Aming Wu , Yahong Han , Qi Tian

Knowledge distillation is a powerful method for model compression, enabling the efficient deployment of complex deep learning models (teachers), including large language models. However, its underlying statistical mechanisms remain unclear,…

Methodology · Statistics 2026-05-28 Luyang Fang , Yongkai Chen , Jiazhang Cai , Ping Ma , Wenxuan Zhong

Multimodal sentiment analysis (MSA) aims to understand human sentiment through multimodal data. Most MSA efforts are based on the assumption of modality completeness. However, in real-world applications, some practical factors cause…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Mingcheng Li , Dingkang Yang , Xiao Zhao , Shuaibing Wang , Yan Wang , Kun Yang , Mingyang Sun , Dongliang Kou , Ziyun Qian , Lihua Zhang

Knowledge distillation aims to transfer knowledge to the student model by utilizing the predictions/features of the teacher model, and feature-based distillation has recently shown its superiority over logit-based distillation. However, due…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Shuoxi Zhang , Hanpeng Liu , John E. Hopcroft , Kun He

Accurate and reliable brain tumor segmentation, particularly when dealing with missing modalities, remains a critical challenge in medical image analysis. Previous studies have not fully resolved the challenges of tumor boundary…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shenghao Zhu , Yifei Chen , Weihong Chen , Yuanhan Wang , Chang Liu , Shuo Jiang , Feiwei Qin , Changmiao Wang

Improving the performance of semantic segmentation models using multispectral information is crucial, especially for environments with low-light and adverse conditions. Multi-modal fusion techniques pursue either the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Aniruddh Sikdar , Jayant Teotia , Suresh Sundaram

Knowledge Distillation (KD) aims at improving the performance of a low-capacity student model by inheriting knowledge from a high-capacity teacher model. Previous KD methods typically train a student by minimizing a task-related loss and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Mengya Gao , Yujun Shen , Quanquan Li , Junjie Yan , Liang Wan , Dahua Lin , Chen Change Loy , Xiaoou Tang

The success of large-scale visual language pretraining (VLP) models has driven widespread adoption of image-text retrieval tasks. However, their deployment on mobile devices remains limited due to large model sizes and computational…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yuqi Li , Chuanguang Yang , Junhao Dong , Zhengtao Yao , Haoyan Xu , Zeyu Dong , Hansheng Zeng , Zhulin An , Yingli Tian

Most existing distillation methods ignore the flexible role of the temperature in the loss function and fix it as a hyper-parameter that can be decided by an inefficient grid search. In general, the temperature controls the discrepancy…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Zheng Li , Xiang Li , Lingfeng Yang , Borui Zhao , Renjie Song , Lei Luo , Jun Li , Jian Yang

Knowledge distillation is a key technique for transferring the capabilities of large language models (LLMs) into smaller, more efficient student models. Existing distillation approaches often overlook two critical factors: the learning…

Machine Learning · Computer Science 2026-05-13 Jincheng Cao , Fanzhi Zeng , Leqi Liu , Aryan Mokhtari

Recent advancements in camera-based 3D object detection have introduced cross-modal knowledge distillation to bridge the performance gap with LiDAR 3D detectors, leveraging the precise geometric information in LiDAR point clouds. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sanmin Kim , Youngseok Kim , Sihwan Hwang , Hyeonjun Jeong , Dongsuk Kum

Knowledge distillation has become an important approach to obtain a compact yet effective model. To achieve this goal, a small student model is trained to exploit the knowledge of a large well-trained teacher model. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Zhiqiang Liu , Chengkai Huang , Yanxia Liu

The joint use of multiple imaging modalities for medical image segmentation has been widely studied in recent years. The fusion of information from different modalities has demonstrated to improve the segmentation accuracy, with respect to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Minhao Hu , Matthis Maillard , Ya Zhang , Tommaso Ciceri , Giammarco La Barbera , Isabelle Bloch , Pietro Gori

The widespread use of multi-sensor systems has increased research in multi-view action recognition. While existing approaches in multi-view setups with fully overlapping sensors benefit from consistent view coverage, partially overlapping…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Trung Thanh Nguyen , Yasutomo Kawanishi , Vijay John , Takahiro Komamizu , Ichiro Ide

Existing knowledge distillation methods generally use a teacher-student approach, where the student network solely learns from a well-trained teacher. However, this approach overlooks the inherent differences in learning abilities between…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Long Liu , Tong Li , Hui Cheng

Knowledge distillation transfers knowledge from large teacher models to smaller students for efficient inference. While existing methods primarily focus on distillation strategies, they often overlook the importance of enhancing teacher…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xin Zhang , Jianyang Xu , Hao Peng , Dongjing Wang , Jingyuan Zheng , Yu Li , Yuyu Yin , Hongbo Wang

Incremental learning targets at achieving good performance on new categories without forgetting old ones. Knowledge distillation has been shown critical in preserving the performance on old classes. Conventional methods, however,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Peng Zhou , Long Mai , Jianming Zhang , Ning Xu , Zuxuan Wu , Larry S. Davis