English
Related papers

Related papers: Learning to Efficiently Sample from Diffusion Prob…

200 papers

Generative AI has received significant attention among a spectrum of diverse industrial and academic domains, thanks to the magnificent results achieved from deep generative models such as generative pre-trained transformers (GPT) and…

Information Theory · Computer Science 2023-10-06 Mehdi Letafati , Samad Ali , Matti Latva-aho

Diffusion models have recently exhibited remarkable abilities to synthesize striking image samples since the introduction of denoising diffusion probabilistic models (DDPMs). Their key idea is to disrupt images into noise through a fixed…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zijian Zhang , Zhou Zhao , Jun Yu , Qi Tian

This article provides a mathematically rigorous introduction to denoising diffusion probabilistic models (DDPMs), sometimes also referred to as diffusion probabilistic models or diffusion models, for generative artificial intelligence. We…

Machine Learning · Computer Science 2024-12-03 Davide Gallon , Arnulf Jentzen , Philippe von Wurstemberger

Diffusion probabilistic models (DPMs) represent a class of powerful generative models. Despite their success, the inference of DPMs is expensive since it generally needs to iterate over thousands of timesteps. A key problem in the inference…

Machine Learning · Computer Science 2022-05-04 Fan Bao , Chongxuan Li , Jun Zhu , Bo Zhang

Denoising Diffusion Probabilistic Models (DDPMs) have established a new state-of-the-art in generative image synthesis, yet their deployment is hindered by significant computational overhead during inference, often requiring up to 1,000…

Machine Learning · Computer Science 2025-11-25 Srishti Gupta , Yashasvee Taiwade

We introduce Efficient Motion Diffusion Model (EMDM) for fast and high-quality human motion generation. Current state-of-the-art generative diffusion models have produced impressive results but struggle to achieve fast generation without…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Wenyang Zhou , Zhiyang Dou , Zeyu Cao , Zhouyingcheng Liao , Jingbo Wang , Wenjia Wang , Yuan Liu , Taku Komura , Wenping Wang , Lingjie Liu

Denoising Diffusion Probabilistic Models (DDPMs) represent a contemporary class of generative models with exceptional qualities in both synthesis and maximizing the data likelihood. These models work by traversing a forward Markov Chain…

Machine Learning · Computer Science 2024-09-16 Hang Li , Wei Jin , Geri Skenderi , Harry Shomer , Wenzhuo Tang , Wenqi Fan , Jiliang Tang

Computational fluid dynamics (CFD) is a powerful tool for modeling turbulent flow and is commonly used for urban microclimate simulations. However, traditional CFD methods are computationally intensive, requiring substantial hardware…

Due to the high complexity and technical requirements of industrial production processes, surface defects will inevitably appear, which seriously affects the quality of products. Although existing lightweight detection networks are highly…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xuyi Yu

Remote sensing change detection is crucial for understanding the dynamics of our planet's surface, facilitating the monitoring of environmental changes, evaluating human impact, predicting future trends, and supporting decision-making. In…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Wele Gedara Chaminda Bandara , Nithin Gopalakrishnan Nair , Vishal M. Patel

Diffusion models are a class of flexible generative models trained with an approximation to the log-likelihood objective. However, most use cases of diffusion models are not concerned with likelihoods, but instead with downstream objectives…

Machine Learning · Computer Science 2024-01-08 Kevin Black , Michael Janner , Yilun Du , Ilya Kostrikov , Sergey Levine

Diffusion language models (DLMs) enable parallel, order-agnostic generation with iterative refinement, offering a flexible alternative to autoregressive large language models (LLMs). However, adapting reinforcement learning (RL) fine-tuning…

Machine Learning · Computer Science 2026-02-12 Kevin Rojas , Jiahe Lin , Kashif Rasul , Anderson Schneider , Yuriy Nevmyvaka , Molei Tao , Wei Deng

Diffusion probabilistic models (DPMs) have shown remarkable performance in high-resolution image synthesis, but their sampling efficiency is still to be desired due to the typically large number of sampling steps. Recent advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Shuchen Xue , Zhaoqiang Liu , Fei Chen , Shifeng Zhang , Tianyang Hu , Enze Xie , Zhenguo Li

Diffusion probabilistic models (DPMs) have achieved impressive success in visual generation. While, they suffer from slow inference speed due to iterative sampling. Employing fewer sampling steps is an intuitive solution, but this will also…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Hu Yu , Hao Luo , Fan Wang , Feng Zhao

Diffusion models have achieved remarkable progress in the field of image generation due to their outstanding capabilities. However, these models require substantial computing resources because of the multi-step denoising process during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Haowei Zhu , Dehua Tang , Ji Liu , Mingjie Lu , Jintu Zheng , Jinzhang Peng , Dong Li , Yu Wang , Fan Jiang , Lu Tian , Spandan Tiwari , Ashish Sirasao , Jun-Hai Yong , Bin Wang , Emad Barsoum

Recently, convolutional networks have achieved remarkable development in remote sensing image Super-Resoltuion (SR) by minimizing the regression objectives, e.g., MSE loss. However, despite achieving impressive performance, these methods…

Image and Video Processing · Electrical Eng. & Systems 2023-10-31 Yi Xiao , Qiangqiang Yuan , Kui Jiang , Jiang He , Xianyu Jin , Liangpei Zhang

Diffusion probabilistic models (DPMs) are emerging powerful generative models. Despite their high-quality generation performance, DPMs still suffer from their slow sampling as they generally need hundreds or thousands of sequential function…

Machine Learning · Computer Science 2022-10-17 Cheng Lu , Yuhao Zhou , Fan Bao , Jianfei Chen , Chongxuan Li , Jun Zhu

Diffusion Probabilistic Models (DPMs) are powerful generative models that have achieved unparalleled success in a number of generative tasks. In this work, we aim to build inductive biases into the training and sampling of diffusion models…

Machine Learning · Computer Science 2025-03-14 Thomas Jiralerspong , Berton Earnshaw , Jason Hartford , Yoshua Bengio , Luca Scimeca

Denoising diffusion probabilistic models (DDPMs) have recently achieved leading performances in many generative tasks. However, the inherited iterative sampling process costs hindered their applications to speech synthesis. This paper…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-22 Rongjie Huang , Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu , Yi Ren , Zhou Zhao

Diffusion probabilistic models can generate high-quality samples. Yet, their sampling process requires numerous denoising steps, making it slow and computationally intensive. We propose to reduce the sampling cost by pruning a pretrained…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Alireza Ganjdanesh , Yan Kang , Yuchen Liu , Richard Zhang , Zhe Lin , Heng Huang