English
Related papers

Related papers: End-to-End Multi-Task Denoising for joint SDR and …

200 papers

In this paper we propose to use utterance-level Permutation Invariant Training (uPIT) for speaker independent multi-talker speech separation and denoising, simultaneously. Specifically, we train deep bi-directional Long Short-Term Memory…

Sound · Computer Science 2018-12-06 Morten Kolbæk , Dong Yu , Zheng-Hua Tan , Jesper Jensen

Feature mapping using deep neural networks is an effective approach for single-channel speech enhancement. Noisy features are transformed to the enhanced ones through a mapping network and the mean square errors between the enhanced and…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-02 Zhong Meng , Jinyu Li , Yifan Gong , Biing-Hwang , Juang

Recent studies in neural network-based monaural speech separation (SS) have achieved a remarkable success thanks to increasing ability of long sequence modeling. However, they would degrade significantly when put under realistic noisy…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-23 Yuchen Hu , Chen Chen , Heqing Zou , Xionghu Zhong , Eng Siong Chng

The majority of deep neural network (DNN) based speech enhancement algorithms rely on the mean-square error (MSE) criterion of short-time spectral amplitudes (STSA), which has no apparent link to human perception, e.g. speech…

Sound · Computer Science 2018-12-05 Morten Kolbæk , Zheng-Hua Tan , Jesper Jensen

Most recent studies on deep learning based speech enhancement (SE) focused on improving denoising performance. However, successful SE applications require striking a desirable balance between denoising performance and computational cost in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-08 Jyun-Yi Wu , Cheng Yu , Szu-Wei Fu , Chih-Ting Liu , Shao-Yi Chien , Yu Tsao

This paper proposes an end-to-end approach for single-channel speaker-independent multi-speaker speech separation, where time-frequency (T-F) masking, the short-time Fourier transform (STFT), and its inverse are represented as layers within…

Sound · Computer Science 2018-04-30 Zhong-Qiu Wang , Jonathan Le Roux , DeLiang Wang , John R. Hershey

Automatic speech recognition (ASR) systems degrade significantly under noisy conditions. Recently, speech enhancement (SE) is introduced as front-end to reduce noise for ASR, but it also suppresses some important speech information, i.e.,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Yuchen Hu , Nana Hou , Chen Chen , Eng Siong Chng

Deploying speech enhancement (SE) systems in wearable devices, such as smart glasses, is challenging due to the limited computational resources on the device. Although deep learning methods have achieved high-quality results, their…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-21 Heitor R. Guimarães , Ke Tan , Juan Azcarreta , Jesus Alvarez , Prabhav Agrawal , Ashutosh Pandey , Buye Xu

We propose an end-to-end model based on convolutional and recurrent neural networks for speech enhancement. Our model is purely data-driven and does not make any assumptions about the type or the stationarity of the noise. In contrast to…

Sound · Computer Science 2018-05-03 Han Zhao , Shuayb Zarar , Ivan Tashev , Chin-Hui Lee

To address the monaural speech enhancement problem, numerous research studies have been conducted to enhance speech via operations either in time-domain on the inner-domain learned from the speech mixture or in time--frequency domain on the…

Sound · Computer Science 2022-09-27 Xucheng Wan , Kai Liu , Ziqing Du , Huan Zhou

The end-to-end approach for single-channel speech separation has been studied recently and shown promising results. This paper extended the previous approach and proposed a new end-to-end model for multi-channel speech separation. The…

Sound · Computer Science 2019-05-29 Rongzhi Gu , Jian Wu , Shi-Xiong Zhang , Lianwu Chen , Yong Xu , Meng Yu , Dan Su , Yuexian Zou , Dong Yu

Background noise and room reverberation are regarded as two major factors to degrade the subjective speech quality. In this paper, we propose an integrated framework to address simultaneous denoising and dereverberation under complicated…

Sound · Computer Science 2021-06-25 Andong Li , Wenzhe Liu , Xiaoxue Luo , Guochen Yu , Chengshi Zheng , Xiaodong Li

Frequency modulation (FM) is a form of radio broadcasting which is widely used nowadays and has been for almost a century. We suggest a software-defined-radio (SDR) receiver for FM demodulation that adopts an end-to-end learning based…

Machine Learning · Computer Science 2017-10-10 Dan Elbaz , Michael Zibulevsky

The choice of an optimal time-frequency resolution is usually a difficult but important step in tasks involving speech signal classification, e.g., speech anti-spoofing. The variations of the performance with different choices of…

Sound · Computer Science 2021-10-12 Wei Liu , Meng Sun , Xiongwei Zhang , Hugo Van hamme , Thomas Fang Zheng

In recent years, the joint training of speech enhancement front-end and automatic speech recognition (ASR) back-end has been widely used to improve the robustness of ASR systems. Traditional joint training methods only use enhanced speech…

Sound · Computer Science 2023-05-31 Haoyu Lu , Nan Li , Tongtong Song , Longbiao Wang , Jianwu Dang , Xiaobao Wang , Shiliang Zhang

The use of deep learning has successfully solved several problems in the field of medical imaging. Deep learning has been applied to the CT denoising problem successfully. However, the use of deep learning requires large amounts of data to…

Image and Video Processing · Electrical Eng. & Systems 2022-04-04 Mayank Patwari , Ralf Gutjahr , Rainer Raupach , Andreas Maier

Speech enhancement model is used to map a noisy speech to a clean speech. In the training stage, an objective function is often adopted to optimize the model parameters. However, in most studies, there is an inconsistency between the model…

Machine Learning · Statistics 2018-03-16 Szu-Wei Fu , Tao-Wei Wang , Yu Tsao , Xugang Lu , Hisashi Kawai

A previous signal processing algorithm that aimed to enhance spectral changes (SCE) over time showed benefit for hearing-impaired (HI) listeners to recognize speech in background noise. In this work, the previous SCE was manipulated to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Xiang Li , Xin Tian , Henry Luo , Jinyu Qian , Xihong Wu , Dingsheng Luo , Jing Chen

Deep learning-based speech enhancement has shown unprecedented performance in recent years. The most popular mono speech enhancement frameworks are end-to-end networks mapping the noisy mixture into an estimate of the clean speech. With…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-02 Bahareh Tolooshams , Kazuhito Koishida

Current self-supervised denoising methods for paired noisy images typically involve mapping one noisy image through the network to the other noisy image. However, after measuring the spectral bias of such methods using our proposed Image…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Wang Zhang , Huaqiu Li , Xiaowan Hu , Tao Jiang , Zikang Chen , Haoqian Wang