English
Related papers

Related papers: TFGAN: Time and Frequency Domain Based Generative …

200 papers

Our previous work, the unified source-filter GAN (uSFGAN) vocoder, introduced a novel architecture based on the source-filter theory into the parallel waveform generative adversarial network to achieve high voice quality and pitch…

Sound · Computer Science 2023-02-28 Reo Yoneyama , Yi-Chiao Wu , Tomoki Toda

Autoregressive neural vocoders have achieved outstanding performance in speech synthesis tasks such as text-to-speech and voice conversion. An autoregressive vocoder predicts a sample at some time step conditioned on those at previous time…

Sound · Computer Science 2024-06-06 Po-chun Hsu , Da-rong Liu , Andy T. Liu , Hung-yi Lee

GAN-based neural vocoders, such as Parallel WaveGAN and MelGAN have attracted great interest due to their lightweight and parallel structures, enabling them to generate high fidelity waveform in a real-time manner. In this paper, inspired…

Sound · Computer Science 2021-03-30 Congyi Wang , Yu Chen , Bin Wang , Yi Shi

We propose a temporally coherent generative model addressing the super-resolution problem for fluid flows. Our work represents a first approach to synthesize four-dimensional physics fields with neural networks. Based on a conditional…

Machine Learning · Computer Science 2025-03-20 You Xie , Aleksandra Franz , Mengyu Chu , Nils Thuerey

The generative adversarial network (GAN) has shown its outstanding capability in improving Non-Autoregressive TTS (NAR-TTS) by adversarially training it with an extra model that discriminates between the real and the generated speech. To…

Sound · Computer Science 2022-03-23 Haohan Guo , Hui Lu , Xixin Wu , Helen Meng

The generative adversarial networks (GANs) have facilitated the development of speech enhancement recently. Nevertheless, the performance advantage is still limited when compared with state-of-the-art models. In this paper, we propose a…

Sound · Computer Science 2020-06-16 Andong Li , Chengshi Zheng , Renhua Peng , Cunhang Fan , Xiaodong Li

This paper proposes voicing-aware conditional discriminators for Parallel WaveGAN-based waveform synthesis systems. In this framework, we adopt a projection-based conditioning method that can significantly improve the discriminator's…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-27 Ryuichi Yamamoto , Eunwoo Song , Min-Jae Hwang , Jae-Min Kim

We propose AudioStyleGAN (ASGAN), a new generative adversarial network (GAN) for unconditional speech synthesis. As in the StyleGAN family of image synthesis models, ASGAN maps sampled noise to a disentangled latent vector which is then…

Sound · Computer Science 2022-10-12 Matthew Baas , Herman Kamper

Current two-stage TTS framework typically integrates an acoustic model with a vocoder -- the acoustic model predicts a low resolution intermediate representation such as Mel-spectrum while the vocoder generates waveform from the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-23 Jian Cong , Shan Yang , Lei Xie , Dan Su

Time series synthesis is an effective approach to ensuring the secure circulation of time series data. Existing time series synthesis methods typically perform temporal modeling based on random sequences to generate target sequences, which…

Machine Learning · Computer Science 2025-09-01 Xuan Hou , Shuhan Liu , Zhaohui Peng , Yaohui Chu , Yue Zhang , Yining Wang

While generative adversarial networks (GANs) based neural text-to-speech (TTS) systems have shown significant improvement in neural speech synthesis, there is no TTS system to learn to synthesize speech from text sequences with only…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-15 Sang-Hoon Lee , Hyun-Wook Yoon , Hyeong-Rae Noh , Ji-Hoon Kim , Seong-Whan Lee

We propose a unified approach to data-driven source-filter modeling using a single neural network for developing a neural vocoder capable of generating high-quality synthetic speech waveforms while retaining flexibility of the source-filter…

Sound · Computer Science 2021-06-29 Reo Yoneyama , Yi-Chiao Wu , Tomoki Toda

In the generator of typical Generative Adversarial Networks (GANs), a noise is inputted to generate fake samples via a series of convolutional operations. However, current noise generation models merely relies on the information from the…

Machine Learning · Computer Science 2020-05-15 Shaoning Zeng , Bob Zhang

The diffusion model is capable of generating high-quality data through a probabilistic approach. However, it suffers from the drawback of slow generation speed due to the requirement of a large number of time steps. To address this…

Sound · Computer Science 2024-04-30 Myeongjin Ko , Yong-Hoon Choi

Generative adversarial network (GAN) has achieved impressive success on cross-domain generation, but it faces difficulty in cross-modal generation due to the lack of a common distribution between heterogeneous data. Most existing methods of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Wen-Cheng Chen , Chien-Wen Chen , Min-Chun Hu

Conditional waveform synthesis models learn a distribution of audio waveforms given conditioning such as text, mel-spectrograms, or MIDI. These systems employ deep generative models that model the waveform via either sequential…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-07 Max Morrison , Rithesh Kumar , Kundan Kumar , Prem Seetharaman , Aaron Courville , Yoshua Bengio

Generative Adversarial Networks (GAN) is a model for data synthesis, which creates plausible data through the competition of generator and discriminator. Although GAN application to image synthesis is extensively studied, it has inherent…

Computation and Language · Computer Science 2025-01-07 Jun-Min Lee , Tae-Bin Ha

Labeled handwriting data is often scarce, limiting the effectiveness of recognition systems that require diverse, style-consistent training samples. Handwriting synthesis offers a promising solution by generating artificial data to augment…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Huynh Tong Dang Khoa , Dang Hoai Nam , Vo Nguyen Le Duy

Existing dominant methods for audio generation include Generative Adversarial Networks (GANs) and diffusion-based methods like Flow Matching. GANs suffer from slow convergence during training, while diffusion methods require multi-step…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-10 Zengwei Yao , Wei Kang , Han Zhu , Liyong Guo , Lingxuan Ye , Fangjun Kuang , Weiji Zhuang , Zhaoqing Li , Zhifeng Han , Long Lin , Daniel Povey

Generative Adversarial Network (GAN) based vocoders are superior in both inference speed and synthesis quality when reconstructing an audible waveform from an acoustic representation. This study focuses on improving the discriminator for…

Sound · Computer Science 2024-04-29 Yicheng Gu , Xueyao Zhang , Liumeng Xue , Haizhou Li , Zhizheng Wu