English
Related papers

Related papers: ResGrad: Residual Denoising Diffusion Probabilisti…

200 papers

Expressive text-to-speech (TTS) can synthesize a new speaking style by imiating prosody and timbre from a reference audio, which faces the following challenges: (1) The highly dynamic prosody information in the reference audio is difficult…

Sound · Computer Science 2022-11-07 Dongchao Yang , Songxiang Liu , Jianwei Yu , Helin Wang , Chao Weng , Yuexian Zou

Benefiting from the development of deep learning, text-to-speech (TTS) techniques using clean speech have achieved significant performance improvements. The data collected from real scenes often contains noise and generally needs to be…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Qiushi Zhu , Yu Gu , Rilin Chen , Chao Weng , Yuchen Hu , Lirong Dai , Jie Zhang

Despite imperfect score-matching causing drift in training and sampling distributions of diffusion models, recent advances in diffusion-based acoustic models have revolutionized data-sufficient single-speaker Text-to-Speech (TTS)…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-01 Heyang Xue , Shuai Guo , Pengcheng Zhu , Mengxiao Bi

In recent years, the field of image generation has been revolutionized by the application of autoregressive transformers and DDPMs. These approaches model the process of image generation as a step-wise probabilistic processes and leverage…

Sound · Computer Science 2023-05-25 James Betker

The incorporation of Denoising Diffusion Models (DDMs) in the Text-to-Speech (TTS) domain is rising, providing great value in synthesizing high quality speech. Although they exhibit impressive audio quality, the extent of their semantic…

Sound · Computer Science 2024-06-05 Miri Varshavsky-Hassid , Roy Hirsch , Regev Cohen , Tomer Golany , Daniel Freedman , Ehud Rivlin

Remote sensing image super-resolution (SR) is a crucial task to restore high-resolution (HR) images from low-resolution (LR) observations. Recently, the Denoising Diffusion Probabilistic Model (DDPM) has shown promising performance in image…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Jialu Sui , Xianping Ma , Xiaokang Zhang , Man-On Pun

The implementation of diffusion-based pansharpening task is predominantly constrained by its slow inference speed, which results from numerous sampling steps. Despite the existing techniques aiming to accelerate sampling, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Shiqi Cao , Liangjian Deng , Shangqi Deng

The efficient Test-Time Scaling (TTS) paradigm offers a promising perspective for enhancing the generation performance of diffusion models. However, current solutions are limited to a static, pre-defined noise pool and suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Gang Dai , Yining Huang , Yiming Xia , Guohao Chen , Shuaicheng Niu

In this paper, conditional denoising diffusion probabilistic models (DDPMs) are proposed to enhance the data transmission and reconstruction over wireless channels. The underlying mechanism of DDPM is to decompose the data generation…

Information Theory · Computer Science 2024-11-21 Mehdi Letafati , Samad Ali , Matti Latva-aho

Denoising Diffusion Probabilistic Models (DDPMs) can generate synthetic timeseries data to help improve the performance of a classifier, but their sampling process is computationally expensive. We address this by combining implicit…

Machine Learning · Computer Science 2025-11-27 Heiko Oppel , Andreas Spilz , Michael Munz

Inference-time compute has re-emerged as a practical way to improve LLM reasoning. Most test-time scaling (TTS) algorithms rely on autoregressive decoding, which is ill-suited to discrete diffusion language models (dLLMs) due to their…

Machine Learning · Computer Science 2026-05-06 Jinbin Bai , Yixuan Li , Yuchen Zhu , Yi Xin , Qingyu Shi , Aosong Feng , Xiaohong Liu , Molei Tao , Jianru Xue , Xiangtai Li , Ming-Hsuan Yang

Scaling text-to-speech (TTS) to large-scale, multi-speaker, and in-the-wild datasets is important to capture the diversity in human speech such as speaker identities, prosodies, and styles (e.g., singing). Current large TTS systems usually…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Kai Shen , Zeqian Ju , Xu Tan , Yanqing Liu , Yichong Leng , Lei He , Tao Qin , Sheng Zhao , Jiang Bian

Diffusion Probabilistic Models (DPMs) are a well-established class of diffusion models for unconditional image generation, while SGMSE+ is a well-established conditional diffusion model for speech enhancement. One of the downsides of…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Bunlong Lay , Timo Gerkmann

Diffusion models produce high-fidelity speech but are inefficient for real-time use due to long denoising steps and challenges in modeling intonation and rhythm. To improve this, we propose Diffusion Loss-Guided Policy Optimization (DLPO),…

Sound · Computer Science 2025-08-06 Jingyi Chen , Ju Seung Byun , Micha Elsner , Pichao Wang , Andrew Perrault

Diffusion models have demonstrated remarkable performance in speech synthesis, but typically require multi-step sampling, resulting in low inference efficiency. Recent studies address this issue by distilling diffusion models into…

Sound · Computer Science 2025-10-08 Tao Zhu , Yinfeng Yu , Liejun Wang , Fuchun Sun , Wendong Zheng

Diffusion Probabilistic Models have demonstrated remarkable performance across a wide range of generative tasks. However, we have observed that these models often suffer from a Signal-to-Noise Ratio-timestep (SNR-t) bias. This bias refers…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Meng Yu , Lei Sun , Jianhao Zeng , Xiangxiang Chu , Kun Zhan

Diffusion models produce high-quality synthetic data but suffer from slow inference. We propose 3D Variable-Step Denoising Diffusion Probabilistic Model (VS-DDPM) a framework engineered to maintain generative quality while accelerating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nikoo Moradi , Gijs Luijten , Behrus Hinrichs-Puladi , Jens Kleesiek , Victor Alves , Jan Egger , André Ferreira

Denoising Diffusion Probabilistic Models (DDPMs) have achieved impressive performance on various generation tasks. By modeling the reverse process of gradually diffusing the data distribution into a Gaussian distribution, generating a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Zhaoyang Lyu , Xudong XU , Ceyuan Yang , Dahua Lin , Bo Dai

Diffusion models have shown a great ability at bridging the performance gap between predictive and generative approaches for speech enhancement. We have shown that they may even outperform their predictive counterparts for non-additive…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-13 Jean-Marie Lemercier , Julius Richter , Simon Welker , Timo Gerkmann

With the popularity of deep neural network, speech synthesis task has achieved significant improvements based on the end-to-end encoder-decoder framework in the recent days. More and more applications relying on speech synthesis technology…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Dongyang Dai , Li Chen , Yuping Wang , Mu Wang , Rui Xia , Xuchen Song , Zhiyong Wu , Yuxuan Wang