English
Related papers

Related papers: Restorative Speech Enhancement: A Progressive Appr…

200 papers

Audio-visual feature synchronization for real-time speech enhancement in hearing aids represents a progressive approach to improving speech intelligibility and user experience, particularly in strong noisy backgrounds. This approach…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-28 Nasir Saleem , Mandar Gogate , Kia Dashtipour , Adeel Hussain , Usman Anwar , Adewale Adetomi , Tughrul Arslan , Amir Hussain

Monaural speech enhancement has achieved remarkable progress recently. However, its performance has been constrained by the limited spatial cues available at a single microphone. To overcome this limitation, we introduce a strategy to map…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-05 Xinmeng Xu , Yuhong Yang , Weiping Tu

Removing background noise from speech audio has been the subject of considerable effort, especially in recent years due to the rise of virtual communication and amateur recordings. Yet background noise is not the only unpleasant disturbance…

Sound · Computer Science 2022-09-19 Joan Serrà , Santiago Pascual , Jordi Pons , R. Oguz Araz , Davide Scaini

For deep learning-based speech enhancement (SE) systems, the training-test acoustic mismatch can cause notable performance degradation. To address the mismatch issue, numerous noise adaptation strategies have been derived. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Chi-Chang Lee , Cheng-Hung Hu , Yu-Chen Lin , Chu-Song Chen , Hsin-Min Wang , Yu Tsao

Time-domain speech enhancement (SE) has recently been intensively investigated. Among recent works, DEMUCS introduces multi-resolution STFT loss to enhance performance. However, some resolutions used for STFT contain non-stationary signals,…

Sound · Computer Science 2023-03-28 Hao Shi , Masato Mimura , Longbiao Wang , Jianwu Dang , Tatsuya Kawahara

The past decade has witnessed substantial growth of data-driven speech enhancement (SE) techniques thanks to deep learning. While existing approaches have shown impressive performance in some common datasets, most of them are designed only…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-19 Wangyou Zhang , Kohei Saijo , Zhong-Qiu Wang , Shinji Watanabe , Yanmin Qian

Speech codec enhancement methods are designed to remove distortions added by speech codecs. While classical methods are very low in complexity and add zero delay, their effectiveness is rather limited. Compared to that, DNN-based methods…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-15 Jan Büthe , Ahmed Mustafa , Jean-Marc Valin , Karim Helwani , Michael M. Goodwin

Studies have shown that in noisy acoustic environments, providing binaural signals to the user of an assistive listening device may improve speech intelligibility and spatial awareness. This paper presents a binaural speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-11 Vikas Tokala , Eric Grinstein , Mike Brookes , Simon Doclo , Jesper Jensen , Patrick A. Naylor

Audio classification and restoration are among major downstream tasks in audio signal processing. However, restoration derives less of a benefit from pretrained models compared to the overwhelming success of pretrained models in…

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement (SE) algorithms. However, monaural SE has not been established as an effective frontend for automatic speech recognition (ASR) in noisy…

Sound · Computer Science 2024-03-12 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

We present a self-supervised speech restoration method without paired speech corpora. Because the previous general speech restoration method uses artificial paired data created by applying various distortions to high-quality speech corpora,…

Deep learning algorithm are increasingly used for speech enhancement (SE). In supervised methods, global and local information is required for accurate spectral mapping. A key restriction is often poor capture of key contextual information.…

Sound · Computer Science 2022-10-28 Jianqiao Cui , Stefan Bleeck

State of the art speech enhancement (SE) models achieve strong performance on neurotypical speech, but their effectiveness is substantially reduced for pathological speech. In this paper, we investigate strategies to address this gap for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Mingchi Hou , Ante Jukic , Ina Kodrasi

Universal speech enhancement (USE) aims to restore speech signals from diverse distortions across multiple sampling rates. We propose UniPASE, an extension of the low-hallucination PASE framework tailored for USE. At its core is…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-17 Xiaobin Rong , Zheng Wang , Yushi Wang , Jun Gao , Jing Lu

Keyword spotting and in particular Wake-Up-Word (WUW) detection is a very important task for voice assistants. A very common issue of voice assistants is that they get easily activated by background noise like music, TV or background speech…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-01 David Bonet , Guillermo Cámbara , Fernando López , Pablo Gómez , Carlos Segura , Jordi Luque

Speech enhancement (SE) and neural vocoding are traditionally viewed as separate tasks. In this work, we observe them under a common thread: the rank behavior of these processes. This observation prompts two key questions: \textit{Can a…

Sound · Computer Science 2025-01-24 Andong Li , Zhihang Sun , Fengyuan Hao , Xiaodong Li , Chengshi Zheng

Isolating the desired speaker's voice amidst multiplespeakers in a noisy acoustic context is a challenging task. Per-sonalized speech enhancement (PSE) endeavours to achievethis by leveraging prior knowledge of the speaker's voice.Recent…

Sound · Computer Science 2024-04-15 Thomas Serre , Mathieu Fontaine , Éric Benhaim , Geoffroy Dutour , Slim Essid

Speech enhancement using artificial neural networks aims to remove noise from noisy speech signals while preserving the speech content. However, speech enhancement networks often introduce distortions to the speech signal, referred to as…

Sound · Computer Science 2025-08-15 Iksoon Jeong , Kyung-Joong Kim , Kang-Hun Ahn

There has been a growing effort to develop universal speech enhancement (SE) to handle inputs with various speech distortions and recording conditions. The URGENT Challenge series aims to foster such universal SE by embracing a broad range…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Kohei Saijo , Wangyou Zhang , Samuele Cornell , Robin Scheibler , Chenda Li , Zhaoheng Ni , Anurag Kumar , Marvin Sach , Yihui Fu , Wei Wang , Tim Fingscheidt , Shinji Watanabe

Audio-visual speech enhancement (AV-SE) aims to enhance degraded speech along with extra visual information such as lip videos, and has been shown to be more effective than audio-only speech enhancement. This paper proposes the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Rui-Chen Zheng , Yang Ai , Zhen-Hua Ling