English
Related papers

Related papers: Enhanced Multimodal Representation Learning with C…

200 papers

Knowledge distillation (KD) is a widely used technique to transfer knowledge from a large teacher network to a smaller student model. Traditional KD uses a fixed balancing factor alpha as a hyperparameter to combine the hard-label…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Zhengda Li

The widespread use of multi-sensor systems has increased research in multi-view action recognition. While existing approaches in multi-view setups with fully overlapping sensors benefit from consistent view coverage, partially overlapping…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Trung Thanh Nguyen , Yasutomo Kawanishi , Vijay John , Takahiro Komamizu , Ichiro Ide

Advances in self-distillation have shown that when knowledge is distilled from a teacher to a student using the same deep learning (DL) architecture, the student performance can surpass the teacher particularly when the network is…

Machine Learning · Computer Science 2025-06-25 Muhammad Haseeb Aslam , Clara Martinez , Marco Pedersoli , Alessandro Koerich , Ali Etemad , Eric Granger

We investigate whether knowledge distillation (KD) from multiple heterogeneous teacher models can enhance the generation of transferable adversarial examples. A lightweight student model is trained using two KD strategies: curriculum-based…

Machine Learning · Computer Science 2025-07-30 Siddhartha Pradhan , Shikshya Shiwakoti , Neha Bathuri

Knowledge distillation (KD), which can efficiently transfer knowledge from a cumbersome network (teacher) to a compact network (student), has demonstrated its advantages in some computer vision applications. The representation of knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Han Zhu , Zhenzhong Chen , Shan Liu

Knowledge distillation (KD) provides an effective way to improve the performance of a student network under the guidance of pre-trained teachers. However, this approach usually brings in a large capacity gap between teacher and student…

Machine Learning · Computer Science 2025-06-24 Tong Li , Long Liu , Yihang Hu , Hu Chen , Shifeng Chen

Human emotion is a complex phenomenon conveyed and perceived through facial expressions, vocal tones, body language, and physiological signals. Multimodal emotion recognition systems can perform well because they can learn complementary and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Muhammad Haseeb Aslam , Marco Pedersoli , Alessandro Lameiras Koerich , Eric Granger

Recently, deep learning-based models have been widely studied for click-through rate (CTR) prediction and lead to improved prediction accuracy in many industrial applications. However, current research focuses primarily on building complex…

Machine Learning · Computer Science 2023-07-06 Jieming Zhu , Jinyang Liu , Weiqi Li , Jincai Lai , Xiuqiang He , Liang Chen , Zibin Zheng

Knowledge distillation (KD) is an effective method for model compression and transferring knowledge between models. However, its effect on model's robustness against spurious correlations that degrade performance on out-of-distribution data…

Machine Learning · Computer Science 2025-10-31 Jiali Cheng , Chirag Agarwal , Hadi Amiri

Knowledge distillation (KD) is widely used in audio tasks, such as speaker verification (SV), by transferring knowledge from a well-trained large model (the teacher) to a smaller, more compact model (the student) for efficiency and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Wenhao Yang , Jianguo Wei , Wenhuan Lu , Xugang Lu , Lei Li

Multimodal video understanding plays a crucial role in tasks such as action recognition and emotion classification by combining information from different modalities. However, multimodal models are prone to overfitting strong modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Xiaoyu Ma , Ding Ding , Hao Chen

Knowledge distillation (KD) aims to transfer knowledge from a large-scale teacher model to a lightweight one, significantly reducing computational and storage requirements. However, the inherent learning capacity gap between the teacher and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Zhaoyi Yan , Binghui Chen , Yunfan Liu , Qixiang Ye

Knowledge distillation is normally used to compress a big network, or teacher, onto a smaller one, the student, by training it to match its outputs. Recently, some works have shown that robustness against adversarial attacks can also be…

Machine Learning · Computer Science 2022-03-15 Javier Maroto , Guillermo Ortiz-Jiménez , Pascal Frossard

Knowledge distillation as an efficient knowledge transfer technique, has achieved remarkable success in unimodal scenarios. However, in cross-modal settings, conventional distillation methods encounter significant challenges due to data and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Hui Li , Pengfei Yang , Juanyang Chen , Le Dong , Yanxin Chen , Quan Wang

Knowledge distillation (KD) has been widely used to transfer knowledge from large, accurate models (teachers) to smaller, efficient ones (students). Recent methods have explored enforcing consistency by incorporating causal interpretations…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Nikolaos Giakoumoglou , Tania Stathaki

In recent years, pre-trained multimodal large models have attracted widespread attention due to their outstanding performance in various multimodal applications. Nonetheless, the extensive computational resources and vast datasets required…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhengyang Liang , Meiyu Liang , Wei Huang , Yawen Li , Zhe Xue

Knowledge Distillation (KD) for object detection aims to train a compact detector by transferring knowledge from a teacher model. Since the teacher model perceives data in a way different from humans, existing KD methods only distill…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jiawei Liang , Siyuan Liang , Aishan Liu , Ke Ma , Jingzhi Li , Xiaochun Cao

Recent advances in representation learning have demonstrated an ability to represent information from different modalities such as video, text, and audio in a single high-level embedding vector. In this work we present a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Alexander H. Liu , SouYoung Jin , Cheng-I Jeff Lai , Andrew Rouditchenko , Aude Oliva , James Glass

Knowledge Distillation (KD) emerges as one of the most promising compression technologies to run advanced deep neural networks on resource-limited devices. In order to train a small network (student) under the guidance of a large network…

Machine Learning · Computer Science 2023-12-15 Yi Guo , Yiqian He , Xiaoyang Li , Haotong Qin , Van Tung Pham , Yang Zhang , Shouda Liu

Recent advances in 3D object detection (3DOD) have obtained remarkably strong results for LiDAR-based models. In contrast, surround-view 3DOD models based on multiple camera images underperform due to the necessary view transformation of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Marvin Klingner , Shubhankar Borse , Varun Ravi Kumar , Behnaz Rezaei , Venkatraman Narayanan , Senthil Yogamani , Fatih Porikli