English
Related papers

Related papers: GAN-Based Speech Enhancement for Low SNR Using Lat…

200 papers

In this paper, we propose a single-channel speech dereverberation system (DeReGAT) based on convolutional, bidirectional long short-term memory and deep feed-forward neural network (CBLDNN) with generative adversarial training (GAT). In…

Sound · Computer Science 2018-06-26 Chenxing Li , Tieqiang Wang , Shuang Xu , Bo Xu

Recent studies have highlighted adversarial examples as ubiquitous threats to the deep neural network (DNN) based speech recognition systems. In this work, we present a U-Net based attention model, U-Net$_{At}$, to enhance adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-04 Chao-Han Huck Yang , Jun Qi , Pin-Yu Chen , Xiaoli Ma , Chin-Hui Lee

The GANs promote an adversarive game to approximate complex and jointed example probability. The networks driven by noise generate fake examples to approximate realistic data distributions. Later the conditional GAN merges prior-conditions…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Meng Wang , Huafeng Li , Fang Li

In this work, we exploit speech enhancement for improving a recurrent neural network transducer (RNN-T) based ASR system. We employ a dense convolutional recurrent network (DCRN) for complex spectral mapping based speech enhancement, and…

Sound · Computer Science 2020-11-10 Ashutosh Pandey , Chunxi Liu , Yun Wang , Yatharth Saraf

This paper introduces a new Dynamic Gated Recurrent Neural Network (DG-RNN) for compute-efficient speech enhancement models running on resource-constrained hardware platforms. It leverages the slow evolution characteristic of RNN hidden…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Longbiao Cheng , Ashutosh Pandey , Buye Xu , Tobi Delbruck , Shih-Chii Liu

Generative adversarial networks (GANs) have been indicated their superiority in usage of the real-time speech synthesis. Nevertheless, most of them make use of deep convolutional layers as their backbone, which may cause the absence of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-17 Zhenxing Lu , Mengnan He , Ruixiong Zhang , Caixia Gong

Recently, multi-channel speech enhancement has drawn much interest due to the use of spatial information to distinguish target speech from interfering signal. To make full use of spatial information and neural network based masking…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-18 Shubo Lv , Yihui Fu , Yukai Jv , Lei Xie , Weixin Zhu , Wei Rao , Yannan Wang

Image content is a predominant factor in marketing campaigns, websites and banners. Today, marketers and designers spend considerable time and money in generating such professional quality content. We take a step towards simplifying this…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Shradha Agrawal , Shankar Venkitachalam , Dhanya Raghu , Deepak Pai

Generative Adversarial Networks (GANs) have shown impressive results in various image synthesis tasks. Vast studies have demonstrated that GANs are more powerful in feature and expression learning compared to other generative models and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Omar De Mitri , Ruyu Wang , Marco F. Huber

Neuromorphic data carries information in spatio-temporal patterns encoded by spikes. Accordingly, a central problem in neuromorphic computing is training spiking neural networks (SNNs) to reproduce spatio-temporal spiking patterns in…

Machine Learning · Computer Science 2021-11-03 Bleema Rosenfeld , Osvaldo Simeone , Bipin Rajendran

We introduce effective training algorithms for Generative Adversarial Networks (GAN) to alleviate mode collapse and gradient vanishing. In our system, we constrain the generator by an Autoencoder (AE). We propose a formulation to consider…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

Existing generative models for unsupervised anomalous sound detection are limited by their inability to fully capture the complex feature distribution of normal sounds, while the potential of powerful diffusion models in this domain remains…

Sound · Computer Science 2026-02-03 Chengyuan Ma , Peng Jia , Hongyue Guo , Wenming Yang

In this work, we propose deep latent space clustering for speaker diarization using generative adversarial network (GAN) backprojection with the help of an encoder network. The proposed diarization system is trained jointly with GAN loss,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-28 Monisankha Pal , Manoj Kumar , Raghuveer Peri , Tae Jin Park , So Hyun Kim , Catherine Lord , Somer Bishop , Shrikanth Narayanan

Disentanglement, a critical concern in interpretable machine learning, has also garnered significant attention from the computer vision community. Many existing GAN-based class disentanglement (unsupervised) approaches, such as InfoGAN and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Jiangwei Zhao , Zejia Liu , Xiaohan Guo , Lili Pan

Intelligent Internet of Things (IoT) systems based on deep neural networks (DNNs) have been widely deployed in the real world. However, DNNs are found to be vulnerable to adversarial examples, which raises people's concerns about…

Machine Learning · Computer Science 2021-11-22 Tao Bai , Jun Zhao , Jinlin Zhu , Shoudong Han , Jiefeng Chen , Bo Li , Alex Kot

Pre-trained models have achieved remarkable success in natural language processing (NLP). However, existing pre-training methods underutilize the benefits of language understanding for generation. Inspired by the idea of Generative…

Computation and Language · Computer Science 2023-05-10 Jian Yang , Shuming Ma , Li Dong , Shaohan Huang , Haoyang Huang , Yuwei Yin , Dongdong Zhang , Liqun Yang , Furu Wei , Zhoujun Li

Generative Adversarial Networks (GANs) have become exceedingly popular in a wide range of data-driven research fields, due in part to their success in image generation. Their ability to generate new samples, often from only a small amount…

Computation and Language · Computer Science 2019-03-19 Thomas Wiest , Nicholas Cummins , Alice Baird , Simone Hantke , Judith Dineley , Björn Schuller

Generative adversarial network (GAN) has greatly improved the quality of unsupervised image generation. Previous GAN-based methods often require a large amount of high-quality training data while producing a small number (e.g., tens) of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chunpeng Wu , Wei Wen , Yiran Chen , Hai Li

Deep generative models have recently achieved impressive performance in speech and music synthesis. However, compared to the generation of those domain-specific sounds, generating general sounds (such as siren, gunshots) has received less…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-07 Xubo Liu , Turab Iqbal , Jinzheng Zhao , Qiushi Huang , Mark D. Plumbley , Wenwu Wang

Compensation for channel mismatch and noise interference is essential for robust automatic speech recognition. Enhanced speech has been introduced into the multi-condition training of acoustic models to improve their generalization ability.…

Sound · Computer Science 2022-11-24 Hung-Shin Lee , Pin-Yuan Chen , Yao-Fei Cheng , Yu Tsao , Hsin-Min Wang