English
Related papers

Related papers: A Flow-Based Neural Network for Time Domain Speech…

200 papers

We propose a temporally coherent generative model addressing the super-resolution problem for fluid flows. Our work represents a first approach to synthesize four-dimensional physics fields with neural networks. Based on a conditional…

Machine Learning · Computer Science 2025-03-20 You Xie , Aleksandra Franz , Mengyu Chu , Nils Thuerey

Statistical signal processing based speech enhancement methods adopt expert knowledge to design the statistical models and linear filters, which is complementary to the deep neural network (DNN) based methods which are data-driven. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-19 Wei Xue , Gang Quan , Chao Zhang , Guohong Ding , Xiaodong He , Bowen Zhou

This paper proposes a framework for modeling sound change that combines deep learning and iterative learning. Acquisition and transmission of speech is modeled by training generations of Generative Adversarial Networks (GANs) on unannotated…

Computation and Language · Computer Science 2021-09-23 Gašper Beguš

In this study, we present an approach to train a single speech enhancement network that can perform both personalized and non-personalized speech enhancement. This is achieved by incorporating a frame-wise conditioning input that specifies…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-24 Zhepei Wang , Ritwik Giri , Devansh Shah , Jean-Marc Valin , Michael M. Goodwin , Paris Smaragdis

Advances in neural speech synthesis have brought us technology that is not only close to human naturalness, but is also capable of instant voice cloning with little data, and is highly accessible with pre-trained models available.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-03 Lauri Juvela , Xin Wang

Speech representation and modelling in high-dimensional spaces of acoustic waveforms, or a linear transformation thereof, is investigated with the aim of improving the robustness of automatic speech recognition to additive noise. The…

Computation and Language · Computer Science 2015-03-31 Matthew Ager , Zoran Cvetkovic , Peter Sollich

Improving speech system performance in noisy environments remains a challenging task, and speech enhancement (SE) is one of the effective techniques to solve the problem. Motivated by the promising results of generative adversarial networks…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-05 Daniel Michelsanti , Zheng-Hua Tan

Cross-domain speech enhancement (SE) is often faced with severe challenges due to the scarcity of noise and background information in an unseen target domain, leading to a mismatch between training and test conditions. This study puts…

Sound · Computer Science 2024-09-04 Chien-Chun Wang , Li-Wei Chen , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

Multi-frame algorithms for single-channel speech enhancement are able to take advantage from short-time correlations within the speech signal. Deep Filtering (DF) was proposed to directly estimate a complex filter in frequency domain to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-16 Hendrik Schröter , Tobias Rosenkranz , Alberto N. Escalante-B. , Andreas Maier

Recent neural waveform synthesizers such as WaveNet, WaveGlow, and the neural-source-filter (NSF) model have shown good performance in speech synthesis despite their different methods of waveform generation. The similarity between speech…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-20 Yi Zhao , Xin Wang , Lauri Juvela , Junichi Yamagishi

Classical parametric speech coding techniques provide a compact representation for speech signals. This affords a very low transmission rate but with a reduced perceptual quality of the reconstructed signals. Recently, autoregressive deep…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-02 Ahmed Mustafa , Arijit Biswas , Christian Bergler , Julia Schottenhamml , Andreas Maier

This paper presents a statistical method of single-channel speech enhancement that uses a variational autoencoder (VAE) as a prior distribution on clean speech. A standard approach to speech enhancement is to train a deep neural network…

A method for statistical parametric speech synthesis incorporating generative adversarial networks (GANs) is proposed. Although powerful deep neural networks (DNNs) techniques can be applied to artificially synthesize speech waveform, the…

Sound · Computer Science 2017-09-26 Yuki Saito , Shinnosuke Takamichi , Hiroshi Saruwatari

Recently, text-to-speech (TTS) models such as FastSpeech and ParaNet have been proposed to generate mel-spectrograms from text in parallel. Despite the advantage, the parallel TTS models cannot be trained without guidance from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-26 Jaehyeon Kim , Sungwon Kim , Jungil Kong , Sungroh Yoon

We propose an end-to-end model based on convolutional and recurrent neural networks for speech enhancement. Our model is purely data-driven and does not make any assumptions about the type or the stationarity of the noise. In contrast to…

Sound · Computer Science 2018-05-03 Han Zhao , Shuayb Zarar , Ivan Tashev , Chin-Hui Lee

Noise-robust automatic speech recognition (ASR) has been commonly addressed by applying speech enhancement (SE) at the waveform level before recognition. However, speech-level enhancement does not always translate into consistent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-09 Da-Hee Yang , Joon-Hyuk Chang

Modern audio generation predominantly relies on latent-space compression, introducing additional complexity and potential information loss. In this work, we challenge this paradigm with WavFlow, a framework that generates high-fidelity…

Generative speech enhancement methods based on generative adversarial networks (GANs) and diffusion models have shown promising results in various speech enhancement tasks. However, their performance in very low signal-to-noise ratio (SNR)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-29 Shrishti Saha Shetu , Emanuël A. P. Habets , Andreas Brendel

Speech enhancement (SE) recovers clean speech from noisy signals and is vital for applications such as telecommunications and automatic speech recognition (ASR). While generative approaches achieve strong perceptual quality, they often rely…

Sound · Computer Science 2025-10-01 Yike Zhu , Boyi Kang , Ziqian Wang , Xingchen Li , Zihan Zhang , Wenjie Li , Longshuai Xiao , Wei Xue , Lei Xie

Generative models are capable to address difficult problems with non-unique solutions like bandwidth extension and gap filling, removing highly non-linear artifacts from codecs, clipping and distortion, as opposed to removing linear…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-18 Sebastian Braun