English
Related papers

Related papers: Optimal Convergence Analysis of DDPM for General D…

200 papers

Denoising Diffusion Probabilistic Model (DDPM) is able to make flexible conditional image generation from prior noise to real data, by introducing an independent noise-aware classifier to provide conditional gradient guidance at each time…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Shengming Li , Guangcong Zheng , Hui Wang , Taiping Yao , Yang Chen , Shoudong Ding , Xi Li

Methods for out-of-distribution (OOD) detection that scale to 3D data are crucial components of any real-world clinical deep learning system. Classic denoising diffusion probabilistic models (DDPMs) have been recently proposed as a robust…

Diffusion Probabilistic Models (DPMs) have shown remarkable potential in image generation, but their sampling efficiency is hindered by the need for numerous denoising steps. Most existing solutions accelerate the sampling process by…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Guangyi Wang , Yuren Cai , Lijiang Li , Wei Peng , Songzhi Su

Recent works have shown that diffusion models can learn essentially any distribution provided one can perform score estimation. Yet it remains poorly understood under what settings score estimation is possible, let alone when practical…

Data Structures and Algorithms · Computer Science 2023-07-04 Kulin Shah , Sitan Chen , Adam Klivans

Diffusion models have recently outperformed alternative approaches to model the distribution of natural images, such as GANs. Such diffusion models allow for deterministic sampling via the probability flow ODE, giving rise to a latent space…

Machine Learning · Statistics 2022-12-06 Valentin Khrulkov , Gleb Ryzhakov , Andrei Chertkov , Ivan Oseledets

Step distillation has become a leading technique for accelerating diffusion models, among which Distribution Matching Distillation (DMD) and Consistency Distillation are two representative paradigms. While consistency methods enforce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Tao Liu , Hao Yan , Mengting Chen , Taihang Hu , Zhengrong Yue , Zihao Pan , Jinsong Lan , Xiaoyong Zhu , Ming-Ming Cheng , Bo Zheng , Yaxing Wang

For image inpainting, the existing Denoising Diffusion Probabilistic Model (DDPM) based method i.e. RePaint can produce high-quality images for any inpainting form. It utilizes a pre-trained DDPM as a prior and generates inpainting results…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Lintao Zhang , Xiangcheng Du , LeoWu TomyEnrique , Yiqun Wang , Yingbin Zheng , Cheng Jin

Denoising diffusion probabilistic models (DDPMs) have recently achieved leading performances in many generative tasks. However, the inherited iterative sampling process costs hindered their applications to speech synthesis. This paper…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-22 Rongjie Huang , Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu , Yi Ren , Zhou Zhao

In this paper, we explore provable acceleration of diffusion models without any additional retraining. Focusing on the task of approximating a target data distribution in $\mathbb{R}^d$ to within $\varepsilon$ total-variation distance, we…

Machine Learning · Computer Science 2025-08-14 Gen Li , Yuchen Zhou , Yuting Wei , Yuxin Chen

Score-based diffusion models are a powerful class of generative models, but their practical use often depends on training neural networks to approximate the score function. Training-free diffusion models provide an attractive alternative by…

Numerical Analysis · Mathematics 2026-01-28 Pengjun Wang , Zezhong Zhang , Minglei Yang , Feng Bao , Yanzhao Cao , Guannan Zhang

Denoising diffusion probabilistic models (DDPMs) have achieved unprecedented success in computer vision. However, they remain underutilized in medical imaging, a field crucial for disease diagnosis and treatment planning. This is primarily…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Hongxu Jiang , Muhammad Imran , Teng Zhang , Yuyin Zhou , Muxuan Liang , Kuang Gong , Wei Shao

Diffusion models have demonstrated state-of-the-art performance across vision, language, and scientific domains. Despite their empirical success, prior theoretical analyses of the sample complexity suffer from poor scaling with input data…

Machine Learning · Computer Science 2026-04-14 Mudit Gaur , Prashant Trivedi , Sasidhar Kunapuli , Amrit Singh Bedi , Vaneet Aggarwal

Normative modeling estimates reference distributions of biological measures conditional on covariates, enabling centiles and clinically interpretable deviation scores to be derived. Most neuroimaging pipelines fit one model per…

Machine Learning · Computer Science 2026-02-06 Luke Whitbread , Lyle J. Palmer , Mark Jenkinson

Diffusion models have emerged as a dominant framework for generative modeling, but their mathematical foundations are often presented separately through diffusion probabilistic models, score-based modeling, stochastic differential…

Machine Learning · Computer Science 2026-05-29 Jiayi Fu , Yuxia Wang

In this paper, we study a method to sample from a target distribution $\pi$ over $\mathbb{R}^d$ having a positive density with respect to the Lebesgue measure, known up to a normalisation factor. This method is based on the Euler…

Statistics Theory · Mathematics 2016-12-20 Alain Durmus , Eric Moulines

Generative AI has received significant attention among a spectrum of diverse industrial and academic domains, thanks to the magnificent results achieved from deep generative models such as generative pre-trained transformers (GPT) and…

Information Theory · Computer Science 2023-10-06 Mehdi Letafati , Samad Ali , Matti Latva-aho

To sample from a general target distribution $p_*\propto e^{-f_*}$ beyond the isoperimetric condition, Huang et al. (2023) proposed to perform sampling through reverse diffusion, giving rise to Diffusion-based Monte Carlo (DMC).…

Machine Learning · Statistics 2024-01-15 Xunpeng Huang , Difan Zou , Hanze Dong , Yian Ma , Tong Zhang

Recent approaches have shown promises distilling diffusion models into efficient one-step generators. Among them, Distribution Matching Distillation (DMD) produces one-step generators that match their teacher in distribution, without…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Tianwei Yin , Michaël Gharbi , Taesung Park , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman

Denoising diffusion probabilistic models (DDPMs) employ a sequence of white Gaussian noise samples to generate an image. In analogy with GANs, those noise maps could be considered as the latent code associated with the generated image.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Inbar Huberman-Spiegelglas , Vladimir Kulikov , Tomer Michaeli

By learning the gradient of smoothed data distributions, diffusion models can iteratively generate samples from complex distributions. The learned score function enables their generalization capabilities, but how the learned score relates…

Machine Learning · Computer Science 2024-12-16 Binxu Wang , John J. Vastola