English
Related papers

Related papers: Speech Enhancement via Deep Spectrum Image Transla…

200 papers

We study the use of the Wave-U-Net architecture for speech enhancement, a model introduced by Stoller et al for the separation of music vocals and accompaniment. This end-to-end learning method for audio source separation operates directly…

Sound · Computer Science 2018-11-29 Craig Macartney , Tillman Weyde

We propose an end-to-end model based on convolutional and recurrent neural networks for speech enhancement. Our model is purely data-driven and does not make any assumptions about the type or the stationarity of the noise. In contrast to…

Sound · Computer Science 2018-05-03 Han Zhao , Shuayb Zarar , Ivan Tashev , Chin-Hui Lee

Neural network applications generally benefit from larger-sized models, but for current speech enhancement models, larger scale networks often suffer from decreased robustness to the variety of real-world use cases beyond what is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-12 Umut Isik , Ritwik Giri , Neerad Phansalkar , Jean-Marc Valin , Karim Helwani , Arvindh Krishnaswamy

This paper studies the Speech Enhancement based on Deep Neural Networks. The proposed architecture gradually follows the signal transformation during enhancement by means of a visualization probe at each network block. Alongside the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-10 Jorge Llombart , Dayana Ribas , Antonio Miguel , Luis Vicente , Alfonso Ortega , Eduardo Lleida

We present aTENNuate, a simple deep state-space autoencoder configured for efficient online raw speech enhancement in an end-to-end fashion. The network's performance is primarily evaluated on raw speech denoising, with additional…

Sound · Computer Science 2025-06-17 Yan Ru Pei , Ritik Shrivastava , FNU Sidharth

The Transformer architecture has demonstrated a superior ability compared to recurrent neural networks in many different natural language processing applications. Therefore, our study applies a modified Transformer in a speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-04 Szu-Wei Fu , Chien-Feng Liao , Tsun-An Hsieh , Kuo-Hsuan Hung , Syu-Siang Wang , Cheng Yu , Heng-Cheng Kuo , Ryandhimas E. Zezario , You-Jin Li , Shang-Yi Chuang , Yen-Ju Lu , Yu Tsao

Speech enhancement (SE) methods mainly focus on recovering clean speech from noisy input. In real-world speech communication, however, noises often exist in not only speaker but also listener environments. Although SE methods can suppress…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-23 Haoyu Li , Yun Liu , Junichi Yamagishi

This research presents a novel approach to enhancing automatic speech recognition systems by integrating noise detection capabilities directly into the recognition architecture. Building upon the wav2vec2 framework, the proposed method…

Sound · Computer Science 2025-12-11 Karamvir Singh

Previous speech enhancement methods focus on estimating the short-time spectrum of speech signals due to its short-term stability. However, these methods often only estimate the clean magnitude spectrum and reuse the noisy phase when…

Sound · Computer Science 2019-10-23 Chuang Geng , Lei Wang

Despite the remarkable progress recently made in distant speech recognition, state-of-the-art technology still suffers from a lack of robustness, especially when adverse acoustic conditions characterized by non-stationary noises and…

Computation and Language · Computer Science 2017-03-24 Mirco Ravanelli , Philemon Brakel , Maurizio Omologo , Yoshua Bengio

When designing fully-convolutional neural network, there is a trade-off between receptive field size, number of parameters and spatial resolution of features in deeper layers of the network. In this work we present a novel network design…

Machine Learning · Computer Science 2018-11-19 Tomasz Grzywalski , Szymon Drgas

Consumer-grade music recordings such as those captured by mobile devices typically contain distortions in the form of background noise, reverb, and microphone-induced EQ. This paper presents a deep learning approach to enhance low-quality…

Sound · Computer Science 2022-04-29 Nikhil Kandpal , Oriol Nieto , Zeyu Jin

Noisy situations cause huge problems for suffers of hearing loss as hearing aids often make the signal more audible but do not always restore the intelligibility. In noisy settings, humans routinely exploit the audio-visual (AV) nature of…

Sound · Computer Science 2019-09-24 Mandar Gogate , Kia Dashtipour , Ahsan Adeel , Amir Hussain

Speech perception is key to verbal communication. For people with hearing loss, the capability to recognize speech is restricted, particularly in a noisy environment or the situations without visual cues, such as lip-reading unavailable via…

Sound · Computer Science 2020-12-21 Rung-Yu Tseng , Tao-Wei Wang , Szu-Wei Fu , Chia-Ying Lee , Yu Tsao

Audio-visual speech enhancement system is regarded as one of promising solutions for isolating and enhancing speech of desired speaker. Typical methods focus on predicting clean speech spectrum via a naive convolution neural network based…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-01 Xinmeng Xu , Yang Wang , Jie Jia , Binbin Chen , Dejun Li

In hearing aids, the presence of babble noise degrades hearing intelligibility of human speech greatly. However, removing the babble without creating artifacts in human speech is a challenging task in a low SNR environment. Here, we sought…

Machine Learning · Computer Science 2016-09-23 Se Rim Park , Jinwon Lee

Subband-based approaches process subbands in parallel through the model with shared parameters to learn the commonality of local spectrums for noise reduction. In this way, they have achieved remarkable results with fewer parameters.…

Sound · Computer Science 2023-05-10 Jun Chen , Wei Rao , Zilin Wang , Jiuxin Lin , Zhiyong Wu , Yannan Wang , Shidong Shang , Helen Meng

Speech enhancement (SE) aims to reduce noise in speech signals. Most SE techniques focus only on addressing audio information. In this work, inspired by multimodal learning, which utilizes data from different modalities, and the recent…

Sound · Computer Science 2022-04-19 Jen-Cheng Hou , Syu-Siang Wang , Ying-Hui Lai , Yu Tsao , Hsiu-Wen Chang , Hsin-Min Wang

Speech enhancement (SE) aims to reduce noise in speech signals. Most SE techniques focus only on addressing audio information. In this work, inspired by multimodal learning, which utilizes data from different modalities, and the recent…

Sound · Computer Science 2018-01-25 Jen-Cheng Hou , Syu-Siang Wang , Ying-Hui Lai , Yu Tsao , Hsiu-Wen Chang , Hsin-Min Wang

This paper proposes a deep speech enhancement method which exploits the high potential of residual connections in a wide neural network architecture, a topology known as Wide Residual Network. This is supported on single dimensional…

Sound · Computer Science 2019-01-04 Dayana Ribas , Jorge Llombart , Antonio Miguel , Luis Vicente