English
Related papers

Related papers: Scalable Speech Enhancement with Dynamic Channel P…

200 papers

Attention mechanisms, such as local and non-local attention, play a fundamental role in recent deep learning based speech enhancement (SE) systems. However, natural speech contains many fast-changing and relatively brief acoustic events,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-16 Xinmeng Xu , Weiping Tu , Yuhong Yang

The recent success of Automatic Speech Recognition (ASR) is largely attributed to the ever-growing amount of training data. However, this trend has made model training prohibitively costly and imposed computational demands. While data…

Recently, more and more personalized speech enhancement systems (PSE) with excellent performance have been proposed. However, two critical issues still limit the performance and generalization ability of the model: 1) Acoustic environment…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Xiaofeng Ge , Jiangyu Han , Haixin Guan , Yanhua Long

As more speech technologies rely on a supervised deep learning approach with clean speech as the ground truth, a methodology to onboard said speech at scale is needed. However, this approach needs to minimize the dependency on human…

Sound · Computer Science 2024-02-21 Adam Sabra , Cyprian Wronka , Michelle Mao , Samer Hijazi

Speech enhancement aims to improve speech quality and intelligibility, especially in noisy environments where background noise degrades speech signals. Currently, deep learning methods achieve great success in speech enhancement, e.g. the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-23 Changjiang Zhao , Shulin He , Xueliang Zhang

Speech enhancement algorithms based on deep learning have greatly surpassed their traditional counterparts and are now being considered for the task of removing acoustic echo from hands-free communication systems. This is a challenging…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-11 Jean-Marc Valin , Srikanth Tenneti , Karim Helwani , Umut Isik , Arvindh Krishnaswamy

Speech enhancement (SE) aims to extract the clean waveform from noise-contaminated measurements to improve the speech quality and intelligibility. Although learning-based methods can perform much better than traditional counterparts, the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-23 Haoyin Yan , Jie Zhang , Cunhang Fan , Yeping Zhou , Peiqi Liu

In recent years, deep learning-based single-channel speech separation has improved considerably, in large part driven by increasingly compute- and parameter-efficient neural network architectures. Most such architectures are, however,…

Personalised speech enhancement (PSE), which extracts only the speech of a target user and removes everything else from a recorded audio clip, can potentially improve users' experiences of audio AI modules deployed in the wild. To support a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-09 Shucong Zhang , Malcolm Chadwick , Alberto Gil C. P. Ramos , Sourav Bhattacharya

Due to the lack of target speech annotations in real-recorded far-field conversational datasets, speech enhancement (SE) models are typically trained on simulated data. However, the trained models often perform poorly in real-world…

Sound · Computer Science 2025-06-24 Longjie Luo , Lin Li , Qingyang Hong

Speech enhancement is widely used as a front-end to improve the speech quality in many audio systems, while it is hard to extract the target speech in multi-talker conditions without prior information on the speaker identity. It was shown…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-26 Jie Zhang , Qing-Tian Xu , Zhen-Hua Ling , Haizhou Li

Conventional deep neural network (DNN)-based speech enhancement (SE) approaches aim to minimize the mean square error (MSE) between enhanced speech and clean reference. The MSE-optimized model may not directly improve the performance of an…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-13 Yih-Liang Shen , Chao-Yuan Huang , Syu-Siang Wang , Yu Tsao , Hsin-Min Wang , Tai-Shih Chi

Speech enhancement (SE) recovers clean speech from noisy signals and is vital for applications such as telecommunications and automatic speech recognition (ASR). While generative approaches achieve strong perceptual quality, they often rely…

Sound · Computer Science 2025-10-01 Yike Zhu , Boyi Kang , Ziqian Wang , Xingchen Li , Zihan Zhang , Wenjie Li , Longshuai Xiao , Wei Xue , Lei Xie

We address the problem of speech enhancement generalisation to unseen environments by performing two manipulations. First, we embed an additional recording from the environment alone, and use this embedding to alter activations in the main…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-31 Gil Keren , Jing Han , Björn Schuller

Eliminating the negative effect of non-stationary environmental noise is a long-standing research topic for automatic speech recognition that stills remains an important challenge. Data-driven supervised approaches, including ones based on…

Varying-size models are often required to deploy ASR systems under different hardware and/or application constraints such as memory and latency. To avoid redundant training and optimization efforts for individual models of different sizes,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-30 Jingjing Xu , Wei Zhou , Zijian Yang , Eugen Beck , Ralf Schlueter

This paper focuses on leveraging deep representation learning (DRL) for speech enhancement (SE). In general, the performance of the deep neural network (DNN) is heavily dependent on the learning of data representation. However, the DRL's…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-28 Yang Xiang , Jesper Lisby Højvang , Morten Højfeldt Rasmussen , Mads Græsbøll Christensen

Conventional speech enhancement (SE) aims to improve speech perception and intelligibility by suppressing noise without requiring enrollment speech as reference, whereas personalized SE (PSE) addresses the cocktail party problem by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-20 Ziling Huang , Haixin Guan , Yanhua Long

This paper proposes a speech enhancement method which exploits the high potential of residual connections in a Wide Residual Network architecture. This is supported on single dimensional convolutions computed alongside the time domain,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-11 Jorge Llombart , Dayana Ribas , Antonio Miguel , Luis Vicente , Alfonso Ortega , Eduardo Lleida

Deep learning-based speech enhancement (SE) methods often face significant computational challenges when needing to meet low-latency requirements because of the increased number of frames to be processed. This paper introduces the SlowFast…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-07 Longbiao Cheng , Ashutosh Pandey , Buye Xu , Tobi Delbruck , Vamsi Krishna Ithapu , Shih-Chii Liu