English
Related papers

Related papers: Voice Conversion with Denoising Diffusion Probabil…

200 papers

Generative adversarial network (GAN) is a framework for generating fake data using a set of real examples. However, GAN is unstable in the training stage. In order to stabilize GANs, the noise injection has been used to enlarge the overlap…

Machine Learning · Computer Science 2022-08-02 Kensuke Nakamura , Simon Korman , Byung-Woo Hong

We propose a parallel-data-free voice-conversion (VC) method that can learn a mapping from source to target speech without relying on parallel data. The proposed method is general purpose, high quality, and parallel-data free and works…

Machine Learning · Statistics 2017-12-21 Takuhiro Kaneko , Hirokazu Kameoka

Non-parallel voice conversion (VC) is a technique for learning the mapping from source to target speech without relying on parallel data. This is an important task, but it has been challenging due to the disadvantages of the training…

Sound · Computer Science 2019-04-10 Takuhiro Kaneko , Hirokazu Kameoka , Kou Tanaka , Nobukatsu Hojo

Generative models are a popular choice for adult-to-adult voice conversion (VC) because of their efficient way of modelling unlabelled data. To this point their usefulness in producing children speech and in particular adult to child VC has…

Sound · Computer Science 2025-12-16 Protima Nomo Sudro , Anton Ragni , Thomas Hain

We propose MAD-GAN, an intuitive generalization to the Generative Adversarial Networks (GANs) and its conditional variants to address the well known problem of mode collapse. First, MAD-GAN is a multi-agent GAN architecture incorporating…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Arnab Ghosh , Viveka Kulharia , Vinay Namboodiri , Philip H. S. Torr , Puneet K. Dokania

In recent years, diffusion-based generative models have demonstrated remarkable performance in speech conversion, including Denoising Diffusion Probabilistic Models (DDPM) and others. However, the advantages of these models come at the cost…

Sound · Computer Science 2025-06-03 Pengyu Ren , Wenhao Guan , Kaidi Wang , Peijie Chen , Qingyang Hong , Lin Li

Previously, we introduced VoiceGrad, a nonparallel voice conversion (VC) technique enabling mel-spectrogram conversion from source to target speakers using a score-based diffusion model. The concept involves training a score network to…

Sound · Computer Science 2025-09-11 Hirokazu Kameoka , Takuhiro Kaneko , Kou Tanaka , Yuto Kondo

Expressive voice conversion (VC) conducts speaker identity conversion for emotional speakers by jointly converting speaker identity and emotional style. Emotional style modeling for arbitrary speakers in expressive VC has not been…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-06 Zongyang Du , Junchen Lu , Kun Zhou , Lakshmish Kaushik , Berrak Sisman

Generative diffusion processes are an emerging and effective tool for image and speech generation. In the existing methods, the underlying noise distribution of the diffusion process is Gaussian noise. However, fitting distributions with…

Signal Processing · Electrical Eng. & Systems 2021-10-13 Eliya Nachmani , Robin San Roman , Lior Wolf

Since the introduction of Generative Adversarial Networks (GANs) in speech synthesis, remarkable achievements have been attained. In a thorough exploration of vocoders, it has been discovered that audio waveforms can be generated at speeds…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-14 Yubing Cao , Yongming Li , Liejun Wang , Yinfeng Yu

Diffusion Probabilistic Models (DPMs) have emerged as the de facto approach for high-fidelity image synthesis, operating diffusion processes on continuous VAE latent, which significantly differ from the text generation methods employed by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xiaoping Wu , Jie Hu , Xiaoming Wei

In this work, we propose DiffWave, a versatile diffusion probabilistic model for conditional and unconditional waveform generation. The model is non-autoregressive, and converts the white noise signal into structured waveform through a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-01 Zhifeng Kong , Wei Ping , Jiaji Huang , Kexin Zhao , Bryan Catanzaro

We propose Parallel WaveGAN, a distillation-free, fast, and small-footprint waveform generation method using a generative adversarial network. In the proposed method, a non-autoregressive WaveNet is trained by jointly optimizing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-07 Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Generative adversarial network (GAN) still exists some problems in dealing with speech enhancement (SE) task. Some GAN-based systems adopt the same structure from Pixel-to-Pixel directly without special optimization. The importance of the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-09 Huixiang Huang , Renjie Wu , Jingbiao Huang , Jucai Lin , Jun Yin

After demonstrating significant success in image synthesis, Generative Adversarial Network (GAN) models have likewise made significant progress in the field of speech synthesis, leveraging their capacity to adapt the precise distribution of…

Sound · Computer Science 2025-04-21 Sandipan Dhar , Md. Tousin Akhter , Nanda Dulal Jana , Swagatam Das

Despite recent progress in generative adversarial network (GAN)-based vocoders, where the model generates raw waveform conditioned on acoustic features, it is challenging to synthesize high-fidelity audio for numerous speakers across…

Sound · Computer Science 2023-02-17 Sang-gil Lee , Wei Ping , Boris Ginsburg , Bryan Catanzaro , Sungroh Yoon

Recently, cycle-consistent adversarial network (Cycle-GAN) has been successfully applied to voice conversion to a different speaker without parallel data, although in those approaches an individual model is needed for each target speaker.…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-26 Ju-chieh Chou , Cheng-chieh Yeh , Hung-yi Lee , Lin-shan Lee

Despite the ever-increasing interest in applying deep learning (DL) models to medical imaging, the typical scarcity and imbalance of medical datasets can severely impact the performance of DL models. The generation of synthetic data that…

Image and Video Processing · Electrical Eng. & Systems 2023-04-03 Pouria Rouzrokh , Bardia Khosravi , Shahriar Faghani , Mana Moassefi , Sanaz Vahdati , Bradley J. Erickson

Generative adversial network (GAN) is a type of generative model that maps a high-dimensional noise to samples in target distribution. However, the dimension of noise required in GAN is not well understood. Previous approaches view GAN as a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Ziran Zhu , Tongda Xu , Ling Li , Yan Wang

Non-parallel voice conversion aims to convert voice from a source domain to a target domain without paired training data. Cycle-Consistent Generative Adversarial Networks (CycleGAN) and Variational Autoencoders (VAE) have been used for this…

Sound · Computer Science 2025-10-16 Maharnab Saikia