中文
相关论文

相关论文: DiffGAN-TTS: High-Fidelity and Efficient Text-to-S…

200 篇论文

Diffusion-based Generative AI gains significant attention for its superior performance over other generative techniques like Generative Adversarial Networks and Variational Autoencoders. While it has achieved notable advancements in fields…

声音 · 计算机科学 2024-12-12 Haowei Lou , Helen Paik , Pari Delir Haghighi , Wen Hu , Lina Yao

Parallel text-to-speech (TTS) models have recently enabled fast and highly-natural speech synthesis. However, they typically require external alignment models, which are not necessarily optimized for the decoder as they are not jointly…

声音 · 计算机科学 2023-03-08 Bac Nguyen , Fabien Cardinaux , Stefan Uhlich

Diffusion models have emerged as a popular family of deep generative models (DGMs). In the literature, it has been claimed that one class of diffusion models -- denoising diffusion probabilistic models (DDPMs) -- demonstrate superior image…

图像与视频处理 · 电气工程与系统科学 2023-09-20 Rucha Deshpande , Muzaffer Özbey , Hua Li , Mark A. Anastasio , Frank J. Brooks

We propose Guided-TTS, a high-quality text-to-speech (TTS) model that does not require any transcript of target speaker using classifier guidance. Guided-TTS combines an unconditional diffusion probabilistic model with a separately trained…

声音 · 计算机科学 2022-06-13 Heeseung Kim , Sungwon Kim , Sungroh Yoon

Recently, Denoising Diffusion Probabilistic Models (DDPMs) have attained leading performances across a diverse range of generative tasks. However, in the field of speech synthesis, although DDPMs exhibit impressive performance, their long…

音频与语音处理 · 电气工程与系统科学 2024-09-25 Xiangyu Zhang , Daijiao Liu , Hexin Liu , Qiquan Zhang , Hanyu Meng , Leibny Paola Garcia , Eng Siong Chng , Lina Yao

Denoising diffusion probabilistic models (DDPMs) have achieved unprecedented success in computer vision. However, they remain underutilized in medical imaging, a field crucial for disease diagnosis and treatment planning. This is primarily…

图像与视频处理 · 电气工程与系统科学 2025-08-22 Hongxu Jiang , Muhammad Imran , Teng Zhang , Yuyin Zhou , Muxuan Liang , Kuang Gong , Wei Shao

Generative artificial intelligence (AI) has been playing an important role in various domains. Leveraging its high capability to generate high-fidelity and diverse synthetic data, generative AI is widely applied in diagnostic tasks, such as…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Yifan Jiang , Ahmad Shariftabrizi , Venkata SK. Manem

Denoising Diffusion Probabilistic Models (DDPMs) have achieved impressive performance on various generation tasks. By modeling the reverse process of gradually diffusing the data distribution into a Gaussian distribution, generating a…

计算机视觉与模式识别 · 计算机科学 2022-05-31 Zhaoyang Lyu , Xudong XU , Ceyuan Yang , Dahua Lin , Bo Dai

Denoising diffusion probabilistic models (DDPMs) (Ho et al. 2020) have shown impressive results on image and waveform generation in continuous state spaces. Here, we introduce Discrete Denoising Diffusion Probabilistic Models (D3PMs),…

机器学习 · 计算机科学 2023-02-23 Jacob Austin , Daniel D. Johnson , Jonathan Ho , Daniel Tarlow , Rianne van den Berg

Expressive Text-to-Speech (TTS) using reference speech has been studied extensively to synthesize natural speech, but there are limitations to obtaining well-represented styles and improving model generalization ability. In this study, we…

音频与语音处理 · 电气工程与系统科学 2024-06-28 Hyun Joon Park , Jin Sob Kim , Wooseok Shin , Sung Won Han

Diffusion probabilistic models (DPMs) and their extensions have emerged as competitive generative models yet confront challenges of efficient sampling. We propose a new bilateral denoising diffusion model (BDDM) that parameterizes both the…

音频与语音处理 · 电气工程与系统科学 2022-03-28 Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu

Recently, there has been a growing interest in text-to-speech (TTS) methods that can be trained with minimal supervision by combining two types of discrete speech representations and using two sequence-to-sequence tasks to decouple TTS.…

声音 · 计算机科学 2023-12-19 Chunyu Qiang , Hao Li , Hao Ni , He Qu , Ruibo Fu , Tao Wang , Longbiao Wang , Jianwu Dang

While Diffusion Generative Models have achieved great success on image generation tasks, how to efficiently and effectively incorporate them into speech generation especially translation tasks remains a non-trivial problem. Specifically,…

计算与语言 · 计算机科学 2023-10-27 Yongxin Zhu , Zhujin Gao , Xinyuan Zhou , Zhongyi Ye , Linli Xu

Interpreting EEG signals linked to spoken language presents a complex challenge, given the data's intricate temporal and spatial attributes, as well as the various noise factors. Denoising diffusion probabilistic models (DDPMs), which have…

计算与语言 · 计算机科学 2023-11-15 Soowon Kim , Seo-Hyun Lee , Young-Eun Lee , Ji-Won Lee , Ji-Ha Park , Seong-Whan Lee

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard…

统计力学 · 物理学 2024-08-15 Luke Causer , Grant M. Rotskoff , Juan P. Garrahan

This paper introduces F5-TTS, a fully non-autoregressive text-to-speech system based on flow matching with Diffusion Transformer (DiT). Without requiring complex designs such as duration model, text encoder, and phoneme alignment, the text…

音频与语音处理 · 电气工程与系统科学 2025-05-21 Yushen Chen , Zhikang Niu , Ziyang Ma , Keqi Deng , Chunhui Wang , Jian Zhao , Kai Yu , Xie Chen

Denoising diffusion probabilistic models (DDPMs) have emerged as competitive generative models yet brought challenges to efficient sampling. In this paper, we propose novel bilateral denoising diffusion models (BDDMs), which take…

机器学习 · 计算机科学 2021-09-15 Max W. Y. Lam , Jun Wang , Rongjie Huang , Dan Su , Dong Yu

In this work, we address the challenge of multi-task image generation with limited data for denoising diffusion probabilistic models (DDPM), a class of generative models that produce high-quality images by reversing a noisy diffusion…

机器学习 · 计算机科学 2023-11-29 Delaram Pirhayatifard , Mohammad Taha Toghani , Guha Balakrishnan , César A. Uribe

In this paper, we present the Directly Denoising Diffusion Model (DDDM): a simple and generic approach for generating realistic images with few-step sampling, while multistep sampling is still preserved for better performance. DDDMs require…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Dan Zhang , Jingjing Wang , Feng Luo

Denoising diffusion probabilistic models (DDPMs) have been proven capable of synthesizing high-quality images with remarkable diversity when trained on large amounts of data. However, to our knowledge, few-shot image generation tasks have…

计算机视觉与模式识别 · 计算机科学 2023-03-08 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan