English
Related papers

Related papers: Avocodo: Generative Adversarial Network for Artifa…

200 papers

Current two-stage TTS framework typically integrates an acoustic model with a vocoder -- the acoustic model predicts a low resolution intermediate representation such as Mel-spectrum while the vocoder generates waveform from the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-23 Jian Cong , Shan Yang , Lei Xie , Dan Su

Recent advances in brain-computer interface (BCI) technology, particularly based on generative adversarial networks (GAN), have shown great promise for improving decoding performance for BCI. Within the realm of Brain-Computer Interfaces…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-01 Young-Eun Lee , Seo-Hyun Lee , Soowon Kim , Jung-Sun Lee , Deok-Seon Kim , Seong-Whan Lee

Neural network-based methods have recently demonstrated state-of-the-art results on image synthesis and super-resolution tasks, in particular by using variants of generative adversarial networks (GANs) with supervised feature losses.…

Sound · Computer Science 2019-03-22 Sung Kim , Visvesh Sathe

Recently, mainstream mel-spectrogram-based neural vocoders rely on generative adversarial network (GAN) for high-fidelity speech generation, e.g., HiFi-GAN and BigVGAN. However, the use of GAN restricts training efficiency and model…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Hui-Peng Du , Yang Ai , Rui-Chen Zheng , Ye-Xin Lu , Zhen-Hua Ling

We investigate the use of generative adversarial networks (GANs) in speech dereverberation for robust speech recognition. GANs have been recently studied for speech enhancement to remove additive noises, but there still lacks of a work to…

Sound · Computer Science 2019-01-01 Ke Wang , Junbo Zhang , Sining Sun , Yujun Wang , Fei Xiang , Lei Xie

The generative adversarial networks (GANs) have facilitated the development of speech enhancement recently. Nevertheless, the performance advantage is still limited when compared with state-of-the-art models. In this paper, we propose a…

Sound · Computer Science 2020-06-16 Andong Li , Chengshi Zheng , Renhua Peng , Cunhang Fan , Xiaodong Li

Generative adversarial network (GAN)-based neural vocoders have been widely used in audio synthesis tasks due to their high generation quality, efficient inference, and small computation footprint. However, it is still challenging to train…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-15 Sipan Li , Songxiang Liu , Luwen Zhang , Xiang Li , Yanyao Bian , Chao Weng , Zhiyong Wu , Helen Meng

Today's generative neural networks allow the creation of high-quality synthetic speech at scale. While we welcome the creative use of this new technology, we must also recognize the risks. As synthetic speech is abused for monetary and…

Sound · Computer Science 2024-04-10 Konstantin Gasenzer , Moritz Wolter

Generative deep neural networks are widely used for speech synthesis, but most existing models directly generate waveforms or spectral outputs. Humans, however, produce speech by controlling articulators, which results in the production of…

Sound · Computer Science 2023-05-10 Gašper Beguš , Alan Zhou , Peter Wu , Gopala K Anumanchipalli

Voice conversion is to generate a new speech with the source content and a target voice style. In this paper, we focus on one general setting, i.e., non-parallel many-to-many voice conversion, which is close to the real-world scenario. As…

Sound · Computer Science 2022-07-28 Jian Ma , Zhedong Zheng , Hao Fei , Feng Zheng , Tat-seng Chua , Yi Yang

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

Recently, GAN based speech synthesis methods, such as MelGAN, have become very popular. Compared to conventional autoregressive based methods, parallel structures based generators make waveform generation process fast and stable. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-25 Qiao Tian , Yi Chen , Zewang Zhang , Heng Lu , Linghui Chen , Lei Xie , Shan Liu

Generative Adversarial Networks (GANs) have experienced a recent surge in popularity, performing competitively in a variety of tasks, especially in computer vision. However, GAN training has shown limited success in natural language…

Computation and Language · Computer Science 2019-01-03 David Donahue , Anna Rumshisky

We propose Parallel WaveGAN, a distillation-free, fast, and small-footprint waveform generation method using a generative adversarial network. In the proposed method, a non-autoregressive WaveNet is trained by jointly optimizing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-07 Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

The quality of speech coded by transform coding is affected by various artefacts especially when bitrates to quantize the frequency components become too low. In order to mitigate these coding artefacts and enhance the quality of coded…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-01 Srikanth Korse , Nicola Pia , Kishan Gupta , Guillaume Fuchs

The state-of-the-art in text-to-speech synthesis has recently improved considerably due to novel neural waveform generation methods, such as WaveNet. However, these methods suffer from their slow sequential inference process, while their…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-31 Lauri Juvela , Bajibabu Bollepalli , Junichi Yamagishi , Paavo Alku

We propose a learning-based filter that allows us to directly modify a synthetic speech waveform into a natural speech waveform. Speech-processing systems using a vocoder framework such as statistical parametric speech synthesis and voice…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-02 Kou Tanaka , Takuhiro Kaneko , Nobukatsu Hojo , Hirokazu Kameoka

A method for statistical parametric speech synthesis incorporating generative adversarial networks (GANs) is proposed. Although powerful deep neural networks (DNNs) techniques can be applied to artificially synthesize speech waveform, the…

Sound · Computer Science 2017-09-26 Yuki Saito , Shinnosuke Takamichi , Hiroshi Saruwatari

In the generator of typical Generative Adversarial Networks (GANs), a noise is inputted to generate fake samples via a series of convolutional operations. However, current noise generation models merely relies on the information from the…

Machine Learning · Computer Science 2020-05-15 Shaoning Zeng , Bob Zhang

Although recent works on neural vocoder have improved the quality of synthesized audio, there still exists a gap between generated and ground-truth audio in frequency space. This difference leads to spectral artifacts such as hissing noise…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-15 Ji-Hoon Kim , Sang-Hoon Lee , Ji-Hyun Lee , Seong-Whan Lee