English
Related papers

Related papers: CMKD: CNN/Transformer-Based Cross-Model Knowledge …

200 papers

Self-supervised learning (SSL) has made remarkable progress in visual representation learning. Some studies combine SSL with knowledge distillation (SSL-KD) to boost the representation learning performance of small models. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Kaiyou Song , Jin Xie , Shan Zhang , Zimeng Luo

Over the past two decades, CNN architectures have produced compelling models of sound perception and cognition, learning hierarchical organizations of features. Analogous to successes in computer vision, audio feature classification can be…

Sound · Computer Science 2025-05-13 Prateek Verma , Jonathan Berger

Audio classification models, particularly the Audio Spectrogram Transformer (AST), play a crucial role in efficient audio analysis. However, optimizing their efficiency without compromising accuracy remains a challenge. In this paper, we…

Sound · Computer Science 2024-06-13 Swarup Ranjan Behera , Abhishek Dhiman , Karthik Gowda , Aalekhya Satya Narayani

Mutual knowledge distillation (MKD) improves a model by distilling knowledge from another model. However, \textit{not all knowledge is certain and correct}, especially under adverse conditions. For example, label noise usually leads to less…

Machine Learning · Computer Science 2022-11-17 Ziyun Li , Xinshao Wang , Di Hu , Neil M. Robertson , David A. Clifton , Christoph Meinel , Haojin Yang

Knowledge distillation (KD) is an effective model compression technique that transfers knowledge from a high-performance teacher to a lightweight student, reducing computational and storage costs while maintaining competitive accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Fengming Yu , Haiwei Pan , Kejia Zhang , Jian Guan , Haiying Jiang

With the improvement of AI chips (e.g., GPU, TPU, and NPU) and the fast development of the Internet of Things (IoT), some robust deep neural networks (DNNs) are usually composed of millions or even hundreds of millions of parameters. Such a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Jun-Teng Yang , Sheng-Che Kao , Scott C. -H. Huang

Small CNN-based models usually require transferring knowledge from a large model before they are deployed in computationally resource-limited edge devices. Masked image modeling (MIM) methods achieve great success in various visual tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Ziming Wang , Shumin Han , Xiaodi Wang , Jing Hao , Xianbin Cao , Baochang Zhang

Most teacher-student frameworks based on knowledge distillation (KD) depend on a strong congruent constraint on instance level. However, they usually ignore the correlation between multiple instances, which is also valuable for knowledge…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Baoyun Peng , Xiao Jin , Jiaheng Liu , Shunfeng Zhou , Yichao Wu , Yu Liu , Dongsheng Li , Zhaoning Zhang

Distilled self-supervised models have shown competitive performance and efficiency in recent years. However, there is a lack of experience in jointly distilling multiple self-supervised speech models. In our work, we performed Ensemble…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-27 Kuan-Po Huang , Tzu-hsun Feng , Yu-Kuan Fu , Tsu-Yuan Hsu , Po-Chieh Yen , Wei-Cheng Tseng , Kai-Wei Chang , Hung-yi Lee

In this paper, we propose a model for the Environment Sound Classification Task (ESC) that consists of multiple feature channels given as input to a Deep Convolutional Neural Network (CNN) with Attention mechanism. The novelty of the paper…

Sound · Computer Science 2020-12-09 Jivitesh Sharma , Ole-Christoffer Granmo , Morten Goodwin

Large pretrained language models have achieved state-of-the-art results on a variety of downstream tasks. Knowledge Distillation (KD) into a smaller student model addresses their inefficiency, allowing for deployment in resource-constrained…

Computation and Language · Computer Science 2023-10-17 Aashka Trivedi , Takuma Udagawa , Michele Merler , Rameswar Panda , Yousef El-Kurdi , Bishwaranjan Bhattacharjee

The smaller memory bandwidth in smart devices prompts development of smaller Automatic Speech Recognition (ASR) models. To obtain a smaller model, one can employ the model compression techniques. Knowledge distillation (KD) is a popular…

Sound · Computer Science 2022-10-04 Jash Rathod , Nauman Dawalatabad , Shatrughan Singh , Dhananjaya Gowda

Significant memory and computational requirements of large deep neural networks restrict their application on edge devices. Knowledge distillation (KD) is a prominent model compression technique for deep neural networks in which the…

Computation and Language · Computer Science 2021-04-16 Aref Jafari , Mehdi Rezagholizadeh , Pranav Sharma , Ali Ghodsi

Knowledge distillation aims at transferring the knowledge from a large teacher model to a small student model with great improvements of the performance of the student model. Therefore, the student network can replace the teacher network to…

Machine Learning · Computer Science 2021-12-28 Jinhong Lin , Zhaoyang Li

The ability of deep convolutional neural networks (CNN) to learn discriminative spectro-temporal patterns makes them well suited to environmental sound classification. However, the relative scarcity of labeled data has impeded the…

Sound · Computer Science 2017-04-05 Justin Salamon , Juan Pablo Bello

Convolutional neural networks (CNNs) are highly successful for super-resolution (SR) but often require sophisticated architectures with heavy memory cost and computational overhead, significantly restricts their practical deployments on…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Yanbo Wang , Shaohui Lin , Yanyun Qu , Haiyan Wu , Zhizhong Zhang , Yuan Xie , Angela Yao

Convolutional Neural Networks (CNNs) are prone to overfit small training datasets. We present a novel two-phase pipeline that leverages self-supervised learning and knowledge distillation to improve the generalization ability of CNN models…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Bingchen Zhao , Xin Wen

Knowledge Distillation (KD) is a powerful approach for compressing a large model into a smaller, more efficient model, particularly beneficial for latency-sensitive applications like recommender systems. However, current KD research…

Information Retrieval · Computer Science 2024-08-28 Nikhil Khani , Shuo Yang , Aniruddh Nath , Yang Liu , Pendo Abbo , Li Wei , Shawn Andrews , Maciej Kula , Jarrod Kahn , Zhe Zhao , Lichan Hong , Ed Chi

In this work we propose approaches to effectively transfer knowledge from weakly labeled web audio data. We first describe a convolutional neural network (CNN) based framework for sound event detection and classification using weakly…

Sound · Computer Science 2018-09-10 Anurag Kumar , Maksim Khadkevich , Christian Fugen

Knowledge distillation (KD) compresses deep neural networks by transferring task-related knowledge from cumbersome pre-trained teacher models to compact student models. However, current KD methods for super-resolution (SR) networks overlook…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yun Zhang , Wei Li , Simiao Li , Hanting Chen , Zhijun Tu , Wenjia Wang , Bingyi Jing , Shaohui Lin , Jie Hu