English
Related papers

Related papers: Sub-Band Knowledge Distillation Framework for Spee…

200 papers

Learning style refers to a type of training mechanism adopted by an individual to gain new knowledge. As suggested by the VARK model, humans have different learning preferences, like Visual (V), Auditory (A), Read/Write (R), and Kinesthetic…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Usma Niyaz , Abhishek Singh Sambyal , Deepti R. Bathula

This paper proposes a model that integrates sub-band processing and deep filtering to fully exploit information from the target time-frequency (TF) bin and its surrounding TF bins for single-channel speech enhancement. The sub-band module…

Sound · Computer Science 2025-06-03 Shenghui Lu , Hukai Huang , Jinanglong Yao , Kaidi Wang , Qingyang Hong , Lin Li

There is increasing interest in distilling task-specific knowledge from large language models (LLM) to smaller student models. Nonetheless, LLM distillation presents a dual challenge: 1) there is a high cost associated with querying the…

Computation and Language · Computer Science 2024-06-11 Yuhang Zhou , Wei Ai

In this paper, we propose an intra-set and inter-set recursive fusion framework with time-frequency calibrated knowledge distillation (I$^2$SRF-TFCKD) for SE. Different from previous distillation strategies for SE, the proposed framework…

Sound · Computer Science 2026-05-18 Jiaming Cheng , Ruiyu Liang , Ye Ni , Chao Xu , Jing Li , Wei Zhou , Rui Liu , Björn W. Schuller , Xiaoshuai Hao

Feature regression is a simple way to distill large neural network models to smaller ones. We show that with simple changes to the network architecture, regression can outperform more complex state-of-the-art approaches for knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 K L Navaneet , Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash

Knowledge distillation is an effective method to transfer the knowledge from the cumbersome teacher model to the lightweight student model. Online knowledge distillation uses the ensembled prediction results of multiple student models as…

Computer Vision and Pattern Recognition · Computer Science 2020-11-16 Zheng Li , Ying Huang , Defang Chen , Tianren Luo , Ning Cai , Zhigeng Pan

Speech enhancement methods based on deep learning have surpassed traditional methods. While many of these new approaches are operating on the wideband (16kHz) sample rate, a new fullband (48kHz) speech enhancement system is proposed in this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-31 Xu Zhang , Lianwu Chen , Xiguang Zheng , Xinlei Ren , Chen Zhang , Liang Guo , Bing Yu

Purpose: Advances in surgical phase recognition are generally led by training deeper networks. Rather than going further with a more complex solution, we believe that current models can be exploited better. We propose a self-knowledge…

Image and Video Processing · Electrical Eng. & Systems 2023-06-16 Jinglu Zhang , Santiago Barbarisi , Abdolrahim Kadkhodamohammadi , Danail Stoyanov , Imanol Luengo

Knowledge distillation (KD) is used to enhance automatic speaker verification performance by ensuring consistency between large teacher networks and lightweight student networks at the embedding level or label level. However, the…

Sound · Computer Science 2024-06-28 Duc-Tuan Truong , Ruijie Tao , Jia Qi Yip , Kong Aik Lee , Eng Siong Chng

The quantization of deep neural networks (QDNNs) has been actively studied for deployment in edge devices. Recent studies employ the knowledge distillation (KD) method to improve the performance of quantized networks. In this study, we…

Machine Learning · Computer Science 2020-10-01 Yoonho Boo , Sungho Shin , Jungwook Choi , Wonyong Sung

As the cornerstone of other important technologies, such as speech recognition and speech synthesis, speech enhancement is a critical area in audio signal processing. In this paper, a new deep learning structure for speech enhancement is…

Sound · Computer Science 2021-08-30 Yuzi Yan , Wei-Qiang Zhang , Michael T. Johnson

Recent advances in knowledge distillation (KD) have enabled smaller student models to approach the performance of larger teacher models. However, popular methods such as supervised KD and on-policy KD, are adversely impacted by the…

Computation and Language · Computer Science 2025-04-29 Wenda Xu , Rujun Han , Zifeng Wang , Long T. Le , Dhruv Madeka , Lei Li , William Yang Wang , Rishabh Agarwal , Chen-Yu Lee , Tomas Pfister

In this work, we propose a technique to transfer speech recognition capabilities from audio speech recognition systems to visual speech recognizers, where our goal is to utilize audio data during lipreading model training. Impressive…

Multimedia · Computer Science 2022-07-13 Hadeel Mabrouk , Omar Abugabal , Nourhan Sakr , Hesham M. Eraqi

It is very challenging for speech enhancement methods to achieves robust performance under both high signal-to-noise ratio (SNR) and low SNR simultaneously. In this paper, we propose a method that integrates an SNR-based teachers-student…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-30 Xiang Hao , Xiangdong Su , Zhiyu Wang , Qiang Zhang , Huali Xu , Guanglai Gao

Several methods of knowledge distillation have been developed for neural network compression. While they all use the KL divergence loss to align the soft outputs of the student model more closely with that of the teacher, the various…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Huan Wang , Suhas Lohit , Michael Jones , Yun Fu

In this study, we propose a modulation decoupling based single channel speech enhancement subspace framework, in which the spectrogram of noisy speech is decoupled as the product of a spectral envelop subspace and a spectral details…

Sound · Computer Science 2017-02-24 Pengfei Sun , Jun Qin

The detection of spoofing speech generated by unseen algorithms remains an unresolved challenge. One reason for the lack of generalization ability is traditional detecting systems follow the binary classification paradigm, which inherently…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Jingze Lu , Yuxiang Zhang , Wenchao Wang , Zengqiang Shang , Pengyuan Zhang

The paper introduces Diff-Filter, a multichannel speech enhancement approach based on the diffusion probabilistic model, for improving speaker verification performance under noisy and reverberant conditions. It also presents a new two-step…

Sound · Computer Science 2023-07-06 Sandipana Dowerah , Ajinkya Kulkarni , Romain Serizel , Denis Jouvet

Lack of specialized data makes building a multi-domain neural machine translation tool challenging. Although emerging literature dealing with low resource languages starts to show promising results, most state-of-the-art models used…

Computation and Language · Computer Science 2020-04-17 Idriss Mghabbar , Pirashanth Ratnamogan

Knowledge distillation is one of the most effective methods for model compression. Previous studies have focused on the student model effectively training the predictive distribution of the teacher model. However, during training, the…

Computation and Language · Computer Science 2026-01-29 Junseok Lee , Nahoon Kim , Sangyong Lee , Chang-Jae Chun