English
Related papers

Related papers: Exploring Speech Enhancement with Generative Adver…

200 papers

Adversarial loss in a conditional generative adversarial network (GAN) is not designed to directly optimize evaluation metrics of a target task, and thus, may not always guide the generator in a GAN to generate data with improved metric…

Sound · Computer Science 2019-05-14 Szu-Wei Fu , Chien-Feng Liao , Yu Tsao , Shou-De Lin

In this paper we demonstrate that it is possible to generate more meaningful electroencephalography (EEG) features from raw EEG features using generative adversarial networks (GAN) to improve the performance of EEG based continuous speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-03 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement algorithms. However, speech enhancement has not been established as an effective frontend for robust automatic speech recognition (ASR) in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

Generative Adversarial Networks (GANs) have gained a lot of attention from machine learning community due to their ability to learn and mimic an input data distribution. GANs consist of a discriminator and a generator working in tandem…

Computation and Language · Computer Science 2018-06-19 Saurabh Sahu , Rahul Gupta , Carol Espy-Wilson

Generative Adversarial Networks (GANs) have become exceedingly popular in a wide range of data-driven research fields, due in part to their success in image generation. Their ability to generate new samples, often from only a small amount…

Computation and Language · Computer Science 2019-03-19 Thomas Wiest , Nicholas Cummins , Alice Baird , Simone Hantke , Judith Dineley , Björn Schuller

Generative adversarial networks (GANs) are a framework that learns a generative distribution through adversarial training. Recently, their class-conditional extensions (e.g., conditional GAN (cGAN) and auxiliary classifier GAN (AC-GAN))…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Takuhiro Kaneko , Yoshitaka Ushiku , Tatsuya Harada

Generative adversarial network (GAN) still exists some problems in dealing with speech enhancement (SE) task. Some GAN-based systems adopt the same structure from Pixel-to-Pixel directly without special optimization. The importance of the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-09 Huixiang Huang , Renjie Wu , Jingbiao Huang , Jucai Lin , Jun Yin

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

Machine Learning · Statistics 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

Generative adversarial networks (GAN) have recently been shown to be efficient for speech enhancement. However, most, if not all, existing speech enhancement GANs (SEGAN) make use of a single generator to perform one-stage enhancement…

Machine Learning · Computer Science 2020-10-28 Huy Phan , Ian V. McLoughlin , Lam Pham , Oliver Y. Chén , Philipp Koch , Maarten De Vos , Alfred Mertins

Recent advances in brain-computer interface (BCI) technology, particularly based on generative adversarial networks (GAN), have shown great promise for improving decoding performance for BCI. Within the realm of Brain-Computer Interfaces…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-01 Young-Eun Lee , Seo-Hyun Lee , Soowon Kim , Jung-Sun Lee , Deok-Seon Kim , Seong-Whan Lee

In this paper, we explore machine translation improvement via Generative Adversarial Network (GAN) architecture. We take inspiration from RelGAN, a model for text generation, and NMT-GAN, an adversarial machine translation model, to…

Computation and Language · Computer Science 2021-12-01 Jay Ahn , Hari Madhu , Viet Nguyen

In this study, we investigate whether noise-augmented training can concurrently improve adversarial robustness in automatic speech recognition (ASR) systems. We conduct a comparative analysis of the adversarial robustness of four different…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-10 Karla Pizzi , Matías Pizarro , Asja Fischer

The ubiquitous presence of machine learning systems in our lives necessitates research into their vulnerabilities and appropriate countermeasures. In particular, we investigate the effectiveness of adversarial attacks and defenses against…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-28 Piotr Żelasko , Sonal Joshi , Yiwen Shao , Jesus Villalba , Jan Trmal , Najim Dehak , Sanjeev Khudanpur

Audio signals are sampled at high temporal resolutions, and learning to synthesize audio requires capturing structure across a range of timescales. Generative adversarial networks (GANs) have seen wide success at generating images that are…

Sound · Computer Science 2019-02-12 Chris Donahue , Julian McAuley , Miller Puckette

Audio codecs are typically transform-domain based and efficiently code stationary audio signals, but they struggle with speech and signals containing dense transient events such as applause. Specifically, with these two classes of signals…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-28 Arijit Biswas , Dai Jia

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

In general, the performance of automatic speech recognition (ASR) systems is significantly degraded due to the mismatch between training and test environments. Recently, a deep-learning-based image-to-image translation technique to…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-15 Jong-Hyeon Park , Myungwoo Oh , Hyung-Min Park

We introduce EffiFusion-GAN (Efficient Fusion Generative Adversarial Network), a lightweight yet powerful model for speech enhancement. The model integrates depthwise separable convolutions within a multi-scale block to capture diverse…

Sound · Computer Science 2025-08-21 Bin Wen , Tien-Ping Tan

The research in Environmental Sound Classification (ESC) has been progressively growing with the emergence of deep learning algorithms. However, data scarcity poses a major hurdle for any huge advance in this domain. Data augmentation…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-16 Aswathy Madhu , Suresh K

Speech enhancement involves the distinction of a target speech signal from an intrusive background. Although generative approaches using Variational Autoencoders or Generative Adversarial Networks (GANs) have increasingly been used in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Martin Strauss , Bernd Edler