English
Related papers

Related papers: Improve GAN-based Neural Vocoder using Pointwise R…

200 papers

We present a novel high-fidelity real-time neural vocoder called VocGAN. A recently developed GAN-based vocoder, MelGAN, produces speech waveforms in real-time. However, it often produces a waveform that is insufficient in quality or…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-31 Jinhyeok Yang , Junmo Lee , Youngik Kim , Hoonyoung Cho , Injung Kim

In recent years, neural vocoders have surpassed classical speech generation approaches in naturalness and perceptual quality of the synthesized speech. Computationally heavy models like WaveNet and WaveGlow achieve best results, while…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Ahmed Mustafa , Nicola Pia , Guillaume Fuchs

Recently, GAN based speech synthesis methods, such as MelGAN, have become very popular. Compared to conventional autoregressive based methods, parallel structures based generators make waveform generation process fast and stable. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-25 Qiao Tian , Yi Chen , Zewang Zhang , Heng Lu , Linghui Chen , Lei Xie , Shan Liu

GAN vocoders are currently one of the state-of-the-art methods for building high-quality neural waveform generative models. However, most of their architectures require dozens of billion floating-point operations per second (GFLOPS) to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-03 Ahmed Mustafa , Jean-Marc Valin , Jan Büthe , Paris Smaragdis , Mike Goodwin

Recent advancement in Generative Adversarial Networks in speech synthesis domain[3],[2] have shown, that it's possible to train GANs [8] in a reliable manner for high quality coherent waveform generation from mel-spectograms. We propose…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-16 Luka Chkhetiani , Levan Bejanidze

We propose Parallel WaveGAN, a distillation-free, fast, and small-footprint waveform generation method using a generative adversarial network. In the proposed method, a non-autoregressive WaveNet is trained by jointly optimizing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-07 Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Recent studies have shown that neural vocoders based on generative adversarial network (GAN) can generate audios with high quality. While GAN based neural vocoders have shown to be computationally much more efficient than those based on…

Sound · Computer Science 2021-06-28 Zhengxi Liu , Yanmin Qian

Recently, generative speech enhancement has garnered considerable interest; however, existing approaches are hindered by excessive complexity, limited efficiency, and suboptimal speech quality. To overcome these challenges, this paper…

Sound · Computer Science 2026-02-03 Fei Liu , Yang Ai

Generative Adversarial Networks (GANs) have become exceedingly popular in a wide range of data-driven research fields, due in part to their success in image generation. Their ability to generate new samples, often from only a small amount…

Computation and Language · Computer Science 2019-03-19 Thomas Wiest , Nicholas Cummins , Alice Baird , Simone Hantke , Judith Dineley , Björn Schuller

Recent development of neural vocoders based on the generative adversarial neural network (GAN) has shown obvious advantages of generating raw waveform conditioned on mel-spectrogram with fast inference speed and lightweight networks.…

Sound · Computer Science 2023-05-30 Kun Song , Yongmao Zhang , Yi Lei , Jian Cong , Hanzhao Li , Lei Xie , Gang He , Jinfeng Bai

Most GAN(Generative Adversarial Network)-based approaches towards high-fidelity waveform generation heavily rely on discriminators to improve their performance. However, GAN methods introduce much uncertainty into the generation process and…

Sound · Computer Science 2022-03-22 Shengyuan Xu , Wenxiao Zhao , Jing Guo

This paper proposes a spectral-domain perceptual weighting technique for Parallel WaveGAN-based text-to-speech (TTS) systems. The recently proposed Parallel WaveGAN vocoder successfully generates waveform sequences using a fast…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-20 Eunwoo Song , Ryuichi Yamamoto , Min-Jae Hwang , Jin-Seob Kim , Ohsung Kwon , Jae-Min Kim

Recently, GAN vocoders have seen rapid progress in speech synthesis, starting to outperform autoregressive models in perceptual quality with much higher generation speed. However, autoregressive vocoders are still the common choice for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-10 Ahmed Mustafa , Jan Büthe , Srikanth Korse , Kishan Gupta , Guillaume Fuchs , Nicola Pia

In this paper, we propose multi-band MelGAN, a much faster waveform generation model targeting to high-quality text-to-speech. Specifically, we improve the original MelGAN by the following aspects. First, we increase the receptive field of…

Sound · Computer Science 2020-11-18 Geng Yang , Shan Yang , Kai Liu , Peng Fang , Wei Chen , Lei Xie

Generative adversarial network (GAN)-based vocoders have been intensively studied because they can synthesize high-fidelity audio waveforms faster than real-time. However, it has been reported that most GANs fail to obtain the optimal…

Sound · Computer Science 2024-03-26 Takashi Shibuya , Yuhta Takida , Yuki Mitsufuji

Neural vocoders are now being used in a wide range of speech processing applications. In many of those applications, the vocoder can be the most complex component, so finding lower complexity algorithms can lead to significant practical…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-06 Jean-Marc Valin , Ahmed Mustafa , Jan Büthe

We propose a new Generative Adversarial Network for Compressed Video quality Enhancement (CVEGAN). The CVEGAN generator benefits from the use of a novel Mul2Res block (with multiple levels of residual learning branches), an enhanced…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Di Ma , Fan Zhang , David R. Bull

Current two-stage TTS framework typically integrates an acoustic model with a vocoder -- the acoustic model predicts a low resolution intermediate representation such as Mel-spectrum while the vocoder generates waveform from the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-23 Jian Cong , Shan Yang , Lei Xie , Dan Su

In this paper, we propose a parallel WaveGAN (PWG)-like neural vocoder with a quasi-periodic (QP) architecture to improve the pitch controllability of PWG. PWG is a compact non-autoregressive (non-AR) speech generation model, whose…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Yi-Chiao Wu , Tomoki Hayashi , Takuma Okamoto , Hisashi Kawai , Tomoki Toda

Unsupervised learning with generative adversarial networks (GANs) has proven to be hugely successful. Regular GANs hypothesize the discriminator as a classifier with the sigmoid cross entropy loss function. However, we found that this loss…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Xudong Mao , Qing Li , Haoran Xie , Raymond Y. K. Lau , Zhen Wang , Stephen Paul Smolley
‹ Prev 1 2 3 10 Next ›