English
Related papers

Related papers: Faster Training of Diffusion Models and Improved D…

200 papers

Imperfect score-matching leads to a shift between the training and the sampling distribution of diffusion models. Due to the recursive nature of the generation process, errors in previous steps yield sampling iterates that drift away from…

Machine Learning · Computer Science 2023-02-20 Giannis Daras , Yuval Dagan , Alexandros G. Dimakis , Constantinos Daskalakis

Known for their impressive performance in generative modeling, diffusion models are attractive candidates for density-based anomaly detection. This paper investigates different variations of diffusion modeling for unsupervised and…

Machine Learning · Computer Science 2026-05-11 Victor Livernoche , Vineet Jain , Yashar Hezaveh , Siamak Ravanbakhsh

Medical image segmentation is a challenging task, made more difficult by many datasets' limited size and annotations. Denoising diffusion probabilistic models (DDPM) have recently shown promise in modelling the distribution of natural…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Margherita Rosnati , Melanie Roschewitz , Ben Glocker

Purpose: To develop a data-efficient strategy for accelerated MRI reconstruction with Diffusion Probabilistic Generative Models (DPMs) that enables faster scan times in clinical stroke MRI when only limited fully-sampled data samples are…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Yamin Arefeen , Sidharth Kumar , Steven Warach , Hamidreza Saber , Jonathan Tamir

Denoising diffusion models (DDMs) have recently attracted increasing attention by showing impressive synthesis quality. DDMs are built on a diffusion process that pushes data to the noise distribution and the models learn to denoise. In…

Machine Learning · Computer Science 2023-05-16 Jaemoo Choi , Yesom Park , Myungjoo Kang

Text-to-image diffusion models pre-trained on billions of image-text pairs have recently enabled 3D content creation by optimizing a randomly initialized differentiable 3D representation with score distillation. However, the optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Yukun Huang , Jianan Wang , Yukai Shi , Boshi Tang , Xianbiao Qi , Lei Zhang

Diffusion Probabilistic Models (DPMs) have emerged as the de facto approach for high-fidelity image synthesis, operating diffusion processes on continuous VAE latent, which significantly differ from the text generation methods employed by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xiaoping Wu , Jie Hu , Xiaoming Wei

The Diffusion Probabilistic Model (DPM) has demonstrated remarkable performance across a variety of generative tasks. The inherent randomness in diffusion models helps address issues such as blurring at the edges of medical images and…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Yilong Hu , Shijie Chang , Lihe Zhang , Feng Tian , Weibing Sun , Huchuan Lu

Diffusion models have become a leading method for generative modeling of both image and scientific data. As these models are costly to train and \emph{evaluate}, reducing the inference cost for diffusion models remains a major goal.…

Machine Learning · Computer Science 2025-12-01 Haoxuan Chen , Yinuo Ren , Lexing Ying , Grant M. Rotskoff

Diffusion models have demonstrated remarkable efficacy in various generative tasks with the predictive prowess of denoising model. Currently, diffusion models employ a uniform denoising model across all timesteps. However, the inherent…

Machine Learning · Computer Science 2024-12-30 Wenhao Li , Xiu Su , Yu Han , Shan You , Tao Huang , Chang Xu

We investigate the approximation efficiency of score functions by deep neural networks in diffusion-based generative modeling. While existing approximation theories utilize the smoothness of score functions, they suffer from the curse of…

Machine Learning · Computer Science 2023-09-21 Song Mei , Yuchen Wu

The number of parameters in large-scale language models based on transformers is gradually increasing, and the scale of computing clusters is also growing. The technology of quickly mobilizing large amounts of computing resources for…

Artificial Intelligence · Computer Science 2025-01-03 Zongbiao Li , Xiezhao Li , Yinghao Cui , Yijun Chen , Zhixuan Gu , Yuxuan Liu , Wenbo Zhu , Fei Jia , Ke Liu , Qifeng Li , Junyao Zhan , Jiangtao Zhou , Chenxi Zhang , Qike Liu

We study the problem of training neural stochastic differential equations, or diffusion models, to sample from a Boltzmann distribution without access to target samples. Existing methods for training such models enforce time-reversal of the…

Machine Learning · Computer Science 2026-02-05 Julius Berner , Lorenz Richter , Marcin Sendera , Jarrid Rector-Brooks , Nikolay Malkin

Recent advancements in diffusion models (DMs) have been propelled by alignment methods that post-train models to better conform to human preferences. However, these approaches typically require computation-intensive training of a base model…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zejian Li , Yize Li , Chenye Meng , Zhongni Liu , Yang Ling , Shengyuan Zhang , Guang Yang , Changyuan Yang , Zhiyuan Yang , Lingyun Sun

Diffusion and flow matching models have achieved remarkable success in text-to-image generation. However, these models typically rely on the predetermined denoising schedules for all prompts. The multi-step reverse diffusion process can be…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Zilyu Ye , Zhiyang Chen , Tiancheng Li , Zemin Huang , Weijian Luo , Guo-Jun Qi

Denoising diffusion probabilistic models (DDPMs) have emerged as competitive generative models yet brought challenges to efficient sampling. In this paper, we propose novel bilateral denoising diffusion models (BDDMs), which take…

Machine Learning · Computer Science 2021-09-15 Max W. Y. Lam , Jun Wang , Rongjie Huang , Dan Su , Dong Yu

Diffusion models are powerful generative models that can produce highly realistic samples for various tasks. Typically, these models are constructed using centralized, independently and identically distributed (IID) training data. However,…

Machine Learning · Computer Science 2025-03-14 Zihao Peng , Xijun Wang , Shengbo Chen , Hong Rao , Cong Shen

Machine learning models, and deep neural networks in particular, are increasingly deployed in risk-sensitive domains such as healthcare, environmental forecasting, and finance, where reliable quantification of predictive uncertainty is…

Machine Learning · Computer Science 2026-04-07 Asena Karolin Özdemir , Lars H. Heyen , Arvid Weyrauch , Achim Streit , Markus Götz , Charlotte Debus

Based on the Denoising Diffusion Probabilistic Model (DDPM), medical image segmentation can be described as a conditional image generation task, which allows to compute pixel-wise uncertainty maps of the segmentation and allows an implicit…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Xutao Guo , Yanwu Yang , Chenfei Ye , Shang Lu , Yang Xiang , Ting Ma

Diffusion Probabilistic Models stand as a critical tool in generative modelling, enabling the generation of complex data distributions. This family of generative models yields record-breaking performance in tasks such as image synthesis,…