English
Related papers

Related papers: Exploring Speech Enhancement with Generative Adver…

200 papers

A generative adversarial network (GAN)-based vocoder trained with an adversarial discriminator is commonly used for speech synthesis because of its fast, lightweight, and high-quality characteristics. However, this data-driven model…

Sound · Computer Science 2024-03-26 Takuhiro Kaneko , Hirokazu Kameoka , Kou Tanaka

Objective: Despite numerous studies proposed for audio restoration in the literature, most of them focus on an isolated restoration problem such as denoising or dereverberation, ignoring other artifacts. Moreover, assuming a noisy or…

Automatic Speech Recognition (ASR) systems must be robust to the myriad types of noises present in real-world environments including environmental noise, room impulse response, special effects as well as attacks by malicious actors…

Sound · Computer Science 2024-09-26 Muhammad A. Shah , Bhiksha Raj

Generative adversarial networks (GANs) have gained considerable attention owing to their ability to reproduce images. However, they can recreate training images faithfully despite image degradation in the form of blur, noise, and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Takuhiro Kaneko , Tatsuya Harada

In this work, we further develop the conformer-based metric generative adversarial network (CMGAN) model for speech enhancement (SE) in the time-frequency (TF) domain. This paper builds on our previous work but takes a more in-depth look by…

Sound · Computer Science 2024-05-07 Sherif Abdulatif , Ruizhe Cao , Bin Yang

Automatic Speaker Verification (ASV) technology has become commonplace in virtual assistants. However, its performance suffers when there is a mismatch between the train and test domains. Mixed bandwidth training, i.e., pooling training…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-07 Saurabh Kataria , Jesús Villalba , Laureano Moro-Velázquez , Piotr Żelasko , Najim Dehak

It is still a challenging task to learn a neural text generation model under the framework of generative adversarial networks (GANs) since the entire training process is not differentiable. The existing training strategies either suffer…

Computation and Language · Computer Science 2023-07-25 Liping Yuan , Jiehang Zeng , Xiaoqing Zheng

Generative adversarial networks (GAN) have been effective for learning generative models for real-world data. However, existing GANs (GAN and its variants) tend to suffer from training problems such as instability and mode collapse. In this…

Machine Learning · Computer Science 2018-03-05 Chaoyue Wang , Chang Xu , Xin Yao , Dacheng Tao

We propose a higher-level associative memory for learning adversarial networks. Generative adversarial network (GAN) framework has a discriminator and a generator network. The generator (G) maps white noise (z) to data samples while the…

Machine Learning · Computer Science 2016-11-23 Tarik Arici , Asli Celikyilmaz

Generative Adversarial Networks (GANs) is a novel class of deep generative models which has recently gained significant attention. GANs learns complex and high-dimensional distributions implicitly over images, audio, and data. However,…

Machine Learning · Computer Science 2023-04-06 Divya Saxena , Jiannong Cao

One of the frontier issues that severely hamper the development of automatic snore sound classification (ASSC) associates to the lack of sufficient supervised training data. To cope with this problem, we propose a novel data augmentation…

Machine Learning · Computer Science 2019-04-01 Zixing Zhang , Jing Han , Kun Qian , Christoph Janott , Yanan Guo , Bjoern Schuller

One way to expand the available dataset for training AI models in the medical field is through the use of Generative Adversarial Networks (GANs) for data augmentation. GANs work by employing a generator network to create new data samples…

Artificial Intelligence · Computer Science 2023-06-09 Angona Biswas , MD Abdullah Al Nasim , Al Imran , Anika Tabassum Sejuty , Fabliha Fairooz , Sai Puppala , Sajedul Talukder

We investigated an enhancement and a domain adaptation approach to make speaker verification systems robust to perturbations of far-field speech. In the enhancement approach, using paired (parallel) reverberant-clean speech, we trained a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Phani Sankar Nidadavolu , Saurabh Kataria , Paola García-Perera , Jesús Villalba , Najim Dehak

Recently, convolution-augmented transformer (Conformer) has achieved promising performance in automatic speech recognition (ASR) and time-domain speech enhancement (SE), as it can capture both local and global dependencies in the speech…

Sound · Computer Science 2024-05-07 Ruizhe Cao , Sherif Abdulatif , Bin Yang

Generative Adversarial Networks (GANs) are a promising approach to language generation. The latest works introducing novel GAN models for language generation use n-gram based metrics for evaluation and only report single scores of the best…

Computation and Language · Computer Science 2019-07-19 Stanislau Semeniuta , Aliaksei Severyn , Sylvain Gelly

This paper presents a configurable version of Extreme Bandwidth Extension Network (EBEN), a Generative Adversarial Network (GAN) designed to improve audio captured with body-conduction microphones. We show that although these microphones…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-18 Julien Hauret , Thomas Joubaud , Véronique Zimpfer , Éric Bavu

The prevailing method for neural speech enhancement predominantly utilizes fully-supervised deep learning with simulated pairs of far-field noisy-reverberant speech and clean speech. Nonetheless, these models frequently demonstrate…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-16 Tong Lei , Qinwen Hu , Ziyao Lin , Andong Li , Rilin Chen , Meng Yu , Dong Yu , Jing Lu

Generative Adversarial Networks (GAN) have demonstrated the potential to recover realistic details for single image super-resolution (SISR). To further improve the visual quality of super-resolved results, PIRM2018-SR Challenge employed…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Wenlong Zhang , Yihao Liu , Chao Dong , Yu Qiao

We propose to implement speech enhancement by the regeneration of clean speech from a salient representation extracted from the noisy signal. The network that extracts salient features is trained using a set of weight-sharing clones of the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-12 Michael Chinen , W. Bastiaan Kleijn , Felicia S. C. Lim , Jan Skoglund

Generative Adversarial Networks (GANs) for text generation have recently received many criticisms, as they perform worse than their MLE counterparts. We suspect previous text GANs' inferior performance is due to the lack of a reliable…

Computation and Language · Computer Science 2021-04-28 Qingyang Wu , Lei Li , Zhou Yu