English
Related papers

Related papers: deHuBERT: Disentangling Noise in a Self-supervised…

200 papers

In a realistic dialogue system, the input information from users is often subject to various types of input perturbations, which affects the slot-filling task. Although rule-based data augmentation methods have achieved satisfactory…

Computation and Language · Computer Science 2024-03-07 Jinxu Zhao , Guanting Dong , Yueyan Qiu , Tingfeng Hui , Xiaoshuai Song , Daichi Guo , Weiran Xu

Environmental noises and reverberation have a detrimental effect on the performance of automatic speech recognition (ASR) systems. Multi-condition training of neural network-based acoustic models is used to deal with this problem, but it…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-03 Desh Raj , Jesus Villalba , Daniel Povey , Sanjeev Khudanpur

This paper introduces an end-to-end neural speech restoration model, HD-DEMUCS, demonstrating efficacy across multiple distortion environments. Unlike conventional approaches that employ cascading frameworks to remove undesirable noise…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-05 Doyeon Kim , Soo-Whan Chung , Hyewon Han , Youna Ji , Hong-Goo Kang

Reduction of unwanted environmental noises is an important feature of today's hearing aids (HA), which is why noise reduction is nowadays included in almost every commercially available device. The majority of these algorithms, however, is…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-26 Marc Aubreville , Kai Ehrensperger , Tobias Rosenkranz , Benjamin Graf , Henning Puder , Andreas Maier

Speech signals are inherently complex as they encompass both global acoustic characteristics and local semantic information. However, in the task of target speech extraction, certain elements of global and local semantic information in the…

Sound · Computer Science 2024-08-27 Zhaoxi Mu , Xinyu Yang , Sining Sun , Qing Yang

Speech data collected in real-world scenarios often encounters two issues. First, multiple sources may exist simultaneously, and the number of sources may vary with time. Second, the existence of background noise in recording is inevitable.…

Sound · Computer Science 2020-05-21 Yuan-Kuei Wu , Chao-I Tuan , Hung-yi Lee , Yu Tsao

Self-supervised learning (SSL) has grown in interest within the speech processing community, since it produces representations that are useful for many downstream tasks. SSL uses global and contextual methods to produce robust…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-08 Subrina Sultana , Donald S. Williamson

Speech enhancement (SE) is usually required as a front end to improve the speech quality in noisy environments, while the enhanced speech might not be optimal for automatic speech recognition (ASR) systems due to speech distortion. On the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-27 Qiu-Shi Zhu , Jie Zhang , Zi-Qiang Zhang , Li-Rong Dai

Despite the large progress in supervised learning with neural networks, there are significant challenges in obtaining high-quality, large-scale and accurately labelled datasets. In such a context, how to learn in the presence of noisy…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Chen Feng , Georgios Tzimiropoulos , Ioannis Patras

Self-Supervised Learning (SSL) has become a powerful solution to extract rich representations from unlabeled data. Yet, SSL research is mostly focused on clean, curated and high-quality datasets. As a result, applying SSL on noisy data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Wenquan Lu , Jiaqi Zhang , Hugues Van Assel , Randall Balestriero

Signal denoising is a key preprocessing step for many applications, as the performance of a learning task is closely related to the quality of the input data. In this paper, we apply a signal processing based deep neural network…

Sound · Computer Science 2022-11-16 Gaetan Frusque , Olga Fink

This paper investigates self-supervised pre-training for audio-visual speaker representation learning where a visual stream showing the speaker's mouth area is used alongside speech as inputs. Our study focuses on the Audio-Visual Hidden…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-18 Bowen Shi , Abdelrahman Mohamed , Wei-Ning Hsu

The popular frameworks for self-supervised learning of speech representations have largely focused on frame-level masked prediction of speech regions. While this has shown promising downstream task performance for speech recognition and…

Computation and Language · Computer Science 2025-07-22 Varun Krishna , Sriram Ganapathy

Addressing the detrimental impact of non-stationary environmental noise on automatic speech recognition (ASR) has been a persistent and significant research focus. Despite advancements, this challenge continues to be a major concern.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-06 Noussaiba Djeffal , Djamel Addou , Hamza Kheddar , Sid Ahmed Selouani

Recent advances in neural-network based generative modeling of speech has shown great potential for speech coding. However, the performance of such models drops when the input is not clean speech, e.g., in the presence of background noise,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-25 Tom Denton , Alejandro Luebs , Felicia S. C. Lim , Andrew Storus , Hengchin Yeh , W. Bastiaan Kleijn , Jan Skoglund

Speech pre-training has shown great success in learning useful and general latent representations from large-scale unlabeled data. Based on a well-designed self-supervised learning pattern, pre-trained models can be used to serve lots of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-08 Pengcheng Li , Genshun Wan , Fenglin Ding , Hang Chen , Jianqing Gao , Jia Pan , Cong Liu

AV-HuBERT, a multi-modal self-supervised learning model, has been shown to be effective for categorical problems such as automatic speech recognition and lip-reading. This suggests that useful audio-visual speech representations can be…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 I-Chun Chern , Kuo-Hsuan Hung , Yi-Ting Chen , Tassadaq Hussain , Mandar Gogate , Amir Hussain , Yu Tsao , Jen-Cheng Hou

We describe a novel method for training high-quality image denoising models based on unorganized collections of corrupted images. The training does not need access to clean reference images, or explicit pairs of corrupted images, and can…

Machine Learning · Computer Science 2019-10-29 Samuli Laine , Tero Karras , Jaakko Lehtinen , Timo Aila

Speech 'in-the-wild' is a handicap for speaker recognition systems due to the variability induced by real-life conditions, such as environmental noise and the emotional state of the speaker. Taking advantage of the principles of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-17 Esther Rituerto-González , Carmen Peláez-Moreno

We report a self-supervised deep learning framework for Rydberg sensors that enables single-shot noise suppression matching the accuracy of multi-measurement averaging. The framework eliminates the need for clean reference signals (hardly…