中文
相关论文

相关论文: Voice Conversion with Denoising Diffusion Probabil…

200 篇论文

Generative adversarial network (GAN) is a framework for generating fake data using a set of real examples. However, GAN is unstable in the training stage. In order to stabilize GANs, the noise injection has been used to enlarge the overlap…

机器学习 · 计算机科学 2022-08-02 Kensuke Nakamura , Simon Korman , Byung-Woo Hong

We propose a parallel-data-free voice-conversion (VC) method that can learn a mapping from source to target speech without relying on parallel data. The proposed method is general purpose, high quality, and parallel-data free and works…

机器学习 · 统计学 2017-12-21 Takuhiro Kaneko , Hirokazu Kameoka

Non-parallel voice conversion (VC) is a technique for learning the mapping from source to target speech without relying on parallel data. This is an important task, but it has been challenging due to the disadvantages of the training…

声音 · 计算机科学 2019-04-10 Takuhiro Kaneko , Hirokazu Kameoka , Kou Tanaka , Nobukatsu Hojo

Generative models are a popular choice for adult-to-adult voice conversion (VC) because of their efficient way of modelling unlabelled data. To this point their usefulness in producing children speech and in particular adult to child VC has…

声音 · 计算机科学 2025-12-16 Protima Nomo Sudro , Anton Ragni , Thomas Hain

We propose MAD-GAN, an intuitive generalization to the Generative Adversarial Networks (GANs) and its conditional variants to address the well known problem of mode collapse. First, MAD-GAN is a multi-agent GAN architecture incorporating…

计算机视觉与模式识别 · 计算机科学 2018-07-17 Arnab Ghosh , Viveka Kulharia , Vinay Namboodiri , Philip H. S. Torr , Puneet K. Dokania

In recent years, diffusion-based generative models have demonstrated remarkable performance in speech conversion, including Denoising Diffusion Probabilistic Models (DDPM) and others. However, the advantages of these models come at the cost…

声音 · 计算机科学 2025-06-03 Pengyu Ren , Wenhao Guan , Kaidi Wang , Peijie Chen , Qingyang Hong , Lin Li

Previously, we introduced VoiceGrad, a nonparallel voice conversion (VC) technique enabling mel-spectrogram conversion from source to target speakers using a score-based diffusion model. The concept involves training a score network to…

声音 · 计算机科学 2025-09-11 Hirokazu Kameoka , Takuhiro Kaneko , Kou Tanaka , Yuto Kondo

Expressive voice conversion (VC) conducts speaker identity conversion for emotional speakers by jointly converting speaker identity and emotional style. Emotional style modeling for arbitrary speakers in expressive VC has not been…

音频与语音处理 · 电气工程与系统科学 2024-05-06 Zongyang Du , Junchen Lu , Kun Zhou , Lakshmish Kaushik , Berrak Sisman

Generative diffusion processes are an emerging and effective tool for image and speech generation. In the existing methods, the underlying noise distribution of the diffusion process is Gaussian noise. However, fitting distributions with…

信号处理 · 电气工程与系统科学 2021-10-13 Eliya Nachmani , Robin San Roman , Lior Wolf

Since the introduction of Generative Adversarial Networks (GANs) in speech synthesis, remarkable achievements have been attained. In a thorough exploration of vocoders, it has been discovered that audio waveforms can be generated at speeds…

音频与语音处理 · 电气工程与系统科学 2024-08-14 Yubing Cao , Yongming Li , Liejun Wang , Yinfeng Yu

Diffusion Probabilistic Models (DPMs) have emerged as the de facto approach for high-fidelity image synthesis, operating diffusion processes on continuous VAE latent, which significantly differ from the text generation methods employed by…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Xiaoping Wu , Jie Hu , Xiaoming Wei

In this work, we propose DiffWave, a versatile diffusion probabilistic model for conditional and unconditional waveform generation. The model is non-autoregressive, and converts the white noise signal into structured waveform through a…

音频与语音处理 · 电气工程与系统科学 2021-04-01 Zhifeng Kong , Wei Ping , Jiaji Huang , Kexin Zhao , Bryan Catanzaro

We propose Parallel WaveGAN, a distillation-free, fast, and small-footprint waveform generation method using a generative adversarial network. In the proposed method, a non-autoregressive WaveNet is trained by jointly optimizing…

音频与语音处理 · 电气工程与系统科学 2020-02-07 Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Generative adversarial network (GAN) still exists some problems in dealing with speech enhancement (SE) task. Some GAN-based systems adopt the same structure from Pixel-to-Pixel directly without special optimization. The importance of the…

音频与语音处理 · 电气工程与系统科学 2021-03-09 Huixiang Huang , Renjie Wu , Jingbiao Huang , Jucai Lin , Jun Yin

After demonstrating significant success in image synthesis, Generative Adversarial Network (GAN) models have likewise made significant progress in the field of speech synthesis, leveraging their capacity to adapt the precise distribution of…

声音 · 计算机科学 2025-04-21 Sandipan Dhar , Md. Tousin Akhter , Nanda Dulal Jana , Swagatam Das

Despite recent progress in generative adversarial network (GAN)-based vocoders, where the model generates raw waveform conditioned on acoustic features, it is challenging to synthesize high-fidelity audio for numerous speakers across…

声音 · 计算机科学 2023-02-17 Sang-gil Lee , Wei Ping , Boris Ginsburg , Bryan Catanzaro , Sungroh Yoon

Recently, cycle-consistent adversarial network (Cycle-GAN) has been successfully applied to voice conversion to a different speaker without parallel data, although in those approaches an individual model is needed for each target speaker.…

音频与语音处理 · 电气工程与系统科学 2018-06-26 Ju-chieh Chou , Cheng-chieh Yeh , Hung-yi Lee , Lin-shan Lee

Despite the ever-increasing interest in applying deep learning (DL) models to medical imaging, the typical scarcity and imbalance of medical datasets can severely impact the performance of DL models. The generation of synthetic data that…

图像与视频处理 · 电气工程与系统科学 2023-04-03 Pouria Rouzrokh , Bardia Khosravi , Shahriar Faghani , Mana Moassefi , Sanaz Vahdati , Bradley J. Erickson

Generative adversial network (GAN) is a type of generative model that maps a high-dimensional noise to samples in target distribution. However, the dimension of noise required in GAN is not well understood. Previous approaches view GAN as a…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Ziran Zhu , Tongda Xu , Ling Li , Yan Wang

Non-parallel voice conversion aims to convert voice from a source domain to a target domain without paired training data. Cycle-Consistent Generative Adversarial Networks (CycleGAN) and Variational Autoencoders (VAE) have been used for this…

声音 · 计算机科学 2025-10-16 Maharnab Saikia