English
Related papers

Related papers: Exploring Speech Enhancement with Generative Adver…

200 papers

Generative adversarial networks (GANs) are neural networks that learn data distributions through adversarial training. In intensive studies, recent GANs have shown promising results for reproducing training images. However, in spite of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Takuhiro Kaneko , Tatsuya Harada

Generative adversarial networks (GANs) have shown potential in learning emotional attributes and generating new data samples. However, their performance is usually hindered by the unavailability of larger speech emotion recognition (SER)…

Sound · Computer Science 2020-07-28 Siddique Latif , Muhammad Asim , Rajib Rana , Sara Khalifa , Raja Jurdak , Björn W. Schuller

Lately, the self-attention mechanism has marked a new milestone in the field of automatic speech recognition (ASR). Nevertheless, its performance is susceptible to environmental intrusions as the system predicts the next output symbol…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Lujun Li , Yikai Kang , Yuchen Shi , Ludwig Kürzinger , Tobias Watzel , Gerhard Rigoll

We enhance the vanilla adversarial training method for unsupervised Automatic Speech Recognition (ASR) by a diffusion-GAN. Our model (1) injects instance noises of various intensities to the generator's output and unlabeled reference text…

Computation and Language · Computer Science 2023-03-27 Xianchao Wu

Recent work has shown that it is feasible to use generative adversarial networks (GANs) for speech enhancement, however, these approaches have not been compared to state-of-the-art (SOTA) non GAN-based approaches. Additionally, many loss…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-29 Zhuohuang Zhang , Chengyun Deng , Yi Shen , Donald S. Williamson , Yongtao Sha , Yi Zhang , Hui Song , Xiangang Li

Adversarial training of end-to-end (E2E) ASR systems using generative adversarial networks (GAN) has recently been explored for low-resource ASR corpora. GANs help to learn the true data representation through a two-player min-max game.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-25 Md Akmal Haidar , Mehdi Rezagholizadeh

Deep learning has undoubtedly offered tremendous improvements in the performance of state-of-the-art speech emotion recognition (SER) systems. However, recent research on adversarial examples poses enormous challenges on the robustness of…

Machine Learning · Computer Science 2019-01-01 Siddique Latif , Rajib Rana , Junaid Qadir

The human brain contextually exploits heterogeneous sensory information to efficiently perform cognitive tasks including vision and hearing. For example, during the cocktail party situation, the human auditory cortex contextually integrates…

Sound · Computer Science 2021-12-17 Mandar Gogate , Kia Dashtipour , Amir Hussain

Classical parametric speech coding techniques provide a compact representation for speech signals. This affords a very low transmission rate but with a reduced perceptual quality of the reconstructed signals. Recently, autoregressive deep…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-02 Ahmed Mustafa , Arijit Biswas , Christian Bergler , Julia Schottenhamml , Andreas Maier

Speech enhancement at extremely low signal-to-noise ratio (SNR) condition is a very challenging problem and rarely investigated in previous works. This paper proposes a robust speech enhancement approach (UNetGAN) based on U-Net and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-30 Xiang Hao , Xiangdong Su , Zhiyu Wang , Hui Zhang , Batushiren

A method for statistical parametric speech synthesis incorporating generative adversarial networks (GANs) is proposed. Although powerful deep neural networks (DNNs) techniques can be applied to artificially synthesize speech waveform, the…

Sound · Computer Science 2017-09-26 Yuki Saito , Shinnosuke Takamichi , Hiroshi Saruwatari

Recent advancement in Generative Adversarial Networks in speech synthesis domain[3],[2] have shown, that it's possible to train GANs [8] in a reliable manner for high quality coherent waveform generation from mel-spectograms. We propose…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-16 Luka Chkhetiani , Levan Bejanidze

The classification of acoustic environments allows for machines to better understand the auditory world around them. The use of deep learning in order to teach machines to discriminate between different rooms is a new area of research.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-07 Constantinos Papayiannis , Christine Evers , Patrick A. Naylor

While pre-trained automatic speech recognition (ASR) systems demonstrate impressive performance on matched domains, their performance often degrades when confronted with channel mismatch stemming from unseen recording environments and…

Sound · Computer Science 2025-01-09 Chien-Chun Wang , Li-Wei Chen , Cheng-Kang Chou , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

Several recent work on speech synthesis have employed generative adversarial networks (GANs) to produce raw waveforms. Although such methods improve the sampling efficiency and memory usage, their sample quality has not yet reached that of…

Sound · Computer Science 2020-10-26 Jungil Kong , Jaehyeon Kim , Jaekyoung Bae

Automatic recognition of disordered speech remains a highly challenging task to date. The underlying neuro-motor conditions, often compounded with co-occurring physical disabilities, lead to the difficulty in collecting large quantities of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-21 Zengrui Jin , Xurong Xie , Mengzhe Geng , Tianzi Wang , Shujie Hu , Jiajun Deng , Guinan Li , Xunying Liu

Speech synthesis is used in a wide variety of industries. Nonetheless, it always sounds flat or robotic. The state of the art methods that allow for prosody control are very cumbersome to use and do not allow easy tuning. To tackle some of…

Sound · Computer Science 2021-10-08 Enrique Hortal , Rodrigo Brechard Alarcia

Enhancing speech quality under adverse SNR conditions remains a significant challenge for discriminative deep neural network (DNN)-based approaches. In this work, we propose DisCoGAN, which is a time-frequency-domain generative adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-18 Shrishti Saha Shetu , Emanuël A. P. Habets , Andreas Brendel

Generative speech enhancement methods based on generative adversarial networks (GANs) and diffusion models have shown promising results in various speech enhancement tasks. However, their performance in very low signal-to-noise ratio (SNR)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-29 Shrishti Saha Shetu , Emanuël A. P. Habets , Andreas Brendel

In this paper, we aim at improving the performance of synthesized speech in statistical parametric speech synthesis (SPSS) based on a generative adversarial network (GAN). In particular, we propose a novel architecture combining the…

Sound · Computer Science 2017-07-12 Shan Yang , Lei Xie , Xiao Chen , Xiaoyan Lou , Xuan Zhu , Dongyan Huang , Haizhou Li