English
Related papers

Related papers: TS-URGENet: A Three-stage Universal Robust and Gen…

200 papers

The last decade has witnessed significant advancements in deep learning-based speech enhancement (SE). However, most existing SE research has limitations on the coverage of SE sub-tasks, data diversity and amount, and evaluation metrics. To…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Wangyou Zhang , Robin Scheibler , Kohei Saijo , Samuele Cornell , Chenda Li , Zhaoheng Ni , Anurag Kumar , Jan Pirklbauer , Marvin Sach , Shinji Watanabe , Tim Fingscheidt , Yanmin Qian

Most deep learning-based models for speech enhancement have mainly focused on estimating the magnitude of spectrogram while reusing the phase from noisy speech for reconstruction. This is due to the difficulty of estimating the phase of…

Sound · Computer Science 2019-04-03 Hyeong-Seok Choi , Jang-Hyun Kim , Jaesung Huh , Adrian Kim , Jung-Woo Ha , Kyogu Lee

We propose a neural network-based speech enhancement (SE) method called the phase-aware recurrent two stage network (rTSN). The rTSN is an extension of our previously proposed two stage network (TSN) framework. This TSN framework was…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-28 Juntae Kim , Jaesung Bae

We propose UNIVERSE++, a universal speech enhancement method based on score-based diffusion and adversarial training. Specifically, we improve the existing UNIVERSE model that decouples clean speech feature extraction and diffusion. Our…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-19 Robin Scheibler , Yusuke Fujita , Yuma Shirahata , Tatsuya Komatsu

This paper introduces OmniGSE, a novel general speech enhancement (GSE) framework designed to mitigate the diverse distortions that speech signals encounter in real-world scenarios. These distortions include background noise, reverberation,…

Sound · Computer Science 2025-07-28 Zhaoxi Mu , Rilin Chen , Andong Li , Meng Yu , Xinyu Yang , Dong Yu

It remains a tough challenge to recover the speech signals contaminated by various noises under real acoustic environments. To this end, we propose a novel system for denoising in the complicated applications, which is mainly comprised of…

Sound · Computer Science 2021-03-02 Andong Li , Wenzhe Liu , Xiaoxue Luo , Chengshi Zheng , Xiaodong Li

End-to-end Text-to-speech (TTS) system can greatly improve the quality of synthesised speech. But it usually suffers form high time latency due to its auto-regressive structure. And the synthesised speech may also suffer from some error…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-11 Dabiao Ma , Zhiba Su , Wenxuan Wang , Yuhao Lu

Previously proposed FullSubNet has achieved outstanding performance in Deep Noise Suppression (DNS) Challenge and attracted much attention. However, it still encounters issues such as input-output mismatch and coarse processing for…

Sound · Computer Science 2022-03-29 Jun Chen , Zilin Wang , Deyi Tuo , Zhiyong Wu , Shiyin Kang , Helen Meng

We propose TF-GridNet for speech separation. The model is a novel deep neural network (DNN) integrating full- and sub-band modeling in the time-frequency (T-F) domain. It stacks several blocks, each consisting of an intra-frame full-band…

Speech enhancement is critical for improving speech intelligibility and quality in various audio devices. In recent years, deep learning-based methods have significantly improved speech enhancement performance, but they often come with a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Xiang Hao , Chenxiang Ma , Qu Yang , Jibin Wu , Kay Chen Tan

The Interspeech 2025 URGENT Challenge aimed to advance universal, robust, and generalizable speech enhancement by unifying speech enhancement tasks across a wide variety of conditions, including seven different distortion types and five…

Sound · Computer Science 2025-10-01 Rong Chao , Rauf Nasretdinov , Yu-Chiang Frank Wang , Ante Jukić , Szu-Wei Fu , Yu Tsao

The ICASSP 2026 URGENT Challenge advances the series by focusing on universal speech enhancement (SE) systems that handle diverse distortions, domains, and input conditions. This overview paper details the challenge's motivation, task…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Chenda Li , Wei Wang , Marvin Sach , Wangyou Zhang , Kohei Saijo , Samuele Cornell , Yihui Fu , Zhaoheng Ni , Tim Fingscheidt , Shinji Watanabe , Yanmin Qian

We propose a novel two-stage text-to-speech (TTS) framework with two types of discrete tokens, i.e., semantic and acoustic tokens, for high-fidelity speech synthesis. It features two core components: the Interpreting module, which processes…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-26 Joun Yeop Lee , Myeonghun Jeong , Minchan Kim , Ji-Hyun Lee , Hoon-Young Cho , Nam Soo Kim

In real acoustic environment, speech enhancement is an arduous task to improve the quality and intelligibility of speech interfered by background noise and reverberation. Over the past years, deep learning has shown great potential on…

Sound · Computer Science 2021-05-07 Kanghao Zhang , Shulin He , Hao Li , Xueliang Zhang

Generative Universal Speech Enhancement (USE) methods aim to leverage generative models to improve speech quality under various types of distortions. However, existing generative speech enhancement methods often suffer from semantic…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-07 Xingchen Li , Hanke Xie , Ziqian Wang , Zihan Zhang , Longshuai Xiao , Shuai Wang , Lei Xie

FullSubNet is our recently proposed real-time single-channel speech enhancement network that achieves outstanding performance on the Deep Noise Suppression (DNS) Challenge dataset. A number of variants of FullSubNet have been proposed, but…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-08 Xiang Hao , Xiaofei Li

Speech enhancement techniques based on deep learning have brought significant improvement on speech quality and intelligibility. Nevertheless, a large gain in speech quality measured by objective metrics, such as perceptual evaluation of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-06 Bo Wu , Meng Yu , Lianwu Chen , Yong Xu , Chao Weng , Dan Su , Dong Yu

Background noise, interfering speech and room reverberation frequently distort target speech in real listening environments. In this study, we address joint speech separation and dereverberation, which aims to separate target speech from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-15 Ke Tan , Yong Xu , Shi-Xiong Zhang , Meng Yu , Dong Yu

Speech enhancement (SE) improves communication in noisy environments, affecting areas such as automatic speech recognition, hearing aids, and telecommunications. With these domains typically being power-constrained and event-based while…

Sound · Computer Science 2024-08-15 Tao Sun , Sander Bohté

Speech signals in real-world environments are frequently affected by various distortions such as additive noise, reverberation, and bandwidth limitation, which may appear individually or in combination. Traditional speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-05 Doyeop Kwak , Youngjoon Jang , Seongyu Kim , Joon Son Chung