English
Related papers

Related papers: Is GAN Necessary for Mel-Spectrogram-based Neural …

200 papers

Recent development of neural vocoders based on the generative adversarial neural network (GAN) has shown obvious advantages of generating raw waveform conditioned on mel-spectrogram with fast inference speed and lightweight networks.…

Sound · Computer Science 2023-05-30 Kun Song , Yongmao Zhang , Yi Lei , Jian Cong , Hanzhao Li , Lei Xie , Gang He , Jinfeng Bai

Despite recent progress in generative adversarial network (GAN)-based vocoders, where the model generates raw waveform conditioned on acoustic features, it is challenging to synthesize high-fidelity audio for numerous speakers across…

Sound · Computer Science 2023-02-17 Sang-gil Lee , Wei Ping , Boris Ginsburg , Bryan Catanzaro , Sungroh Yoon

Recent studies have shown that neural vocoders based on generative adversarial network (GAN) can generate audios with high quality. While GAN based neural vocoders have shown to be computationally much more efficient than those based on…

Sound · Computer Science 2021-06-28 Zhengxi Liu , Yanmin Qian

We present a novel high-fidelity real-time neural vocoder called VocGAN. A recently developed GAN-based vocoder, MelGAN, produces speech waveforms in real-time. However, it often produces a waveform that is insufficient in quality or…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-31 Jinhyeok Yang , Junmo Lee , Youngik Kim , Hoonyoung Cho , Injung Kim

Generative adversarial network (GAN) models can synthesize highquality audio signals while ensuring fast sample generation. However, they are difficult to train and are prone to several issues including mode collapse and divergence. In this…

Sound · Computer Science 2024-02-06 Teysir Baoueb , Haocheng Liu , Mathieu Fontaine , Jonathan Le Roux , Gael Richard

Generative adversarial network (GAN) based vocoders have achieved significant attention in speech synthesis with high quality and fast inference speed. However, there still exist many noticeable spectral artifacts, resulting in the quality…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 Rubing Shen , Yanzhen Ren , Zongkun Sun

Recent advancement in Generative Adversarial Networks in speech synthesis domain[3],[2] have shown, that it's possible to train GANs [8] in a reliable manner for high quality coherent waveform generation from mel-spectograms. We propose…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-16 Luka Chkhetiani , Levan Bejanidze

Generative adversarial network (GAN)-based vocoders have been intensively studied because they can synthesize high-fidelity audio waveforms faster than real-time. However, it has been reported that most GANs fail to obtain the optimal…

Sound · Computer Science 2024-03-26 Takashi Shibuya , Yuhta Takida , Yuki Mitsufuji

Since the introduction of Generative Adversarial Networks (GANs) in speech synthesis, remarkable achievements have been attained. In a thorough exploration of vocoders, it has been discovered that audio waveforms can be generated at speeds…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-14 Yubing Cao , Yongming Li , Liejun Wang , Yinfeng Yu

Neural vocoders based on the generative adversarial neural network (GAN) have been widely used due to their fast inference speed and lightweight networks while generating high-quality speech waveforms. Since the perceptually important…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-04 Taejun Bak , Junmo Lee , Hanbin Bae , Jinhyeok Yang , Jae-Sung Bae , Young-Sun Joo

Recent advances in neural network -based text-to-speech have reached human level naturalness in synthetic speech. The present sequence-to-sequence models can directly map text to mel-spectrogram acoustic features, which are convenient for…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-27 Lauri Juvela , Bajibabu Bollepalli , Junichi Yamagishi , Paavo Alku

We propose Universal MelGAN, a vocoder that synthesizes high-fidelity speech in multiple domains. To preserve sound quality when the MelGAN-based structure is trained with a dataset of hundreds of speakers, we added multi-resolution…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-05 Won Jang , Dan Lim , Jaesam Yoon

The generative adversarial network (GAN) has shown its outstanding capability in improving Non-Autoregressive TTS (NAR-TTS) by adversarially training it with an extra model that discriminates between the real and the generated speech. To…

Sound · Computer Science 2022-03-23 Haohan Guo , Hui Lu , Xixin Wu , Helen Meng

Generative adversarial network (GAN)-based neural vocoders have been widely used in audio synthesis tasks due to their high generation quality, efficient inference, and small computation footprint. However, it is still challenging to train…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-15 Sipan Li , Songxiang Liu , Luwen Zhang , Xiang Li , Yanyao Bian , Chao Weng , Zhiyong Wu , Helen Meng

Recently, GAN based speech synthesis methods, such as MelGAN, have become very popular. Compared to conventional autoregressive based methods, parallel structures based generators make waveform generation process fast and stable. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-25 Qiao Tian , Yi Chen , Zewang Zhang , Heng Lu , Linghui Chen , Lei Xie , Shan Liu

In a recent paper, we have presented a generative adversarial network (GAN)-based model for unconditional generation of the mel-spectrograms of singing voices. As the generator of the model is designed to take a variable-length sequence of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-13 Jen-Yu Liu , Yu-Hua Chen , Yin-Cheng Yeh , Yi-Hsuan Yang

This paper presents a speaking-rate-controllable HiFi-GAN neural vocoder. Original HiFi-GAN is a high-fidelity, computationally efficient, and tiny-footprint neural vocoder. We attempt to incorporate a speaking rate control function into…

Sound · Computer Science 2022-04-25 Detai Xin , Shinnosuke Takamichi , Takuma Okamoto , Hisashi Kawai , Hiroshi Saruwatari

This paper proposes a source-filter-based generative adversarial neural vocoder named SF-GAN, which achieves high-fidelity waveform generation from input acoustic features by introducing F0-based source excitation signals to a neural filter…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Ye-Xin Lu , Yang Ai , Zhen-Hua Ling

Most GAN(Generative Adversarial Network)-based approaches towards high-fidelity waveform generation heavily rely on discriminators to improve their performance. However, GAN methods introduce much uncertainty into the generation process and…

Sound · Computer Science 2022-03-22 Shengyuan Xu , Wenxiao Zhao , Jing Guo

Previous works (Donahue et al., 2018a; Engel et al., 2019a) have found that generating coherent raw audio waveforms with GANs is challenging. In this paper, we show that it is possible to train GANs reliably to generate high quality…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-10 Kundan Kumar , Rithesh Kumar , Thibault de Boissiere , Lucas Gestin , Wei Zhen Teoh , Jose Sotelo , Alexandre de Brebisson , Yoshua Bengio , Aaron Courville
‹ Prev 1 2 3 10 Next ›