English
Related papers

Related papers: Fast Sampling of Diffusion Models with Exponential…

200 papers

Continuous normalizing flows (CNFs) and diffusion models (DMs) generate high-quality data from a noise distribution. However, their sampling process demands multiple iterations to solve an ordinary differential equation (ODE) with high…

Machine Learning · Computer Science 2025-11-19 Denis Gudovskiy , Wenzhao Zheng , Tomoyuki Okuno , Yohei Nakata , Kurt Keutzer

Discrete diffusion models have emerged as a powerful generative modeling framework for discrete data with successful applications spanning from text generation to image synthesis. However, their deployment faces challenges due to the high…

Machine Learning · Computer Science 2025-12-01 Yinuo Ren , Haoxuan Chen , Yuchen Zhu , Wei Guo , Yongxin Chen , Grant M. Rotskoff , Molei Tao , Lexing Ying

Diffusion models have demonstrated remarkable capabilities in visual content generation but remain challenging to deploy due to their high computational cost during inference. This computational burden primarily arises from the quadratic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Ye Tian , Xin Xia , Yuxi Ren , Shanchuan Lin , Xing Wang , Xuefeng Xiao , Yunhai Tong , Ling Yang , Bin Cui

Distilled diffusion models accelerate image generation by reducing the number of denoising steps, but often suffer from degraded image quality. To mitigate this trade-off, test-time optimization methods improve quality, yet their iterative…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Haewon Jeon , Si-Hyeon Lee

Recent advances in diffusion transformers (DiTs) have set new standards in image generation, yet remain impractical for on-device deployment due to their high computational and memory costs. In this work, we present an efficient DiT…

Diffusion and flow-matching models achieve remarkable generative performance but at the cost of many sampling steps, this slows inference and limits applicability to time-critical tasks. The ReFlow procedure can accelerate sampling by…

Machine Learning · Computer Science 2024-10-11 Beomsu Kim , Yu-Guan Hsieh , Michal Klein , Marco Cuturi , Jong Chul Ye , Bahjat Kawar , James Thornton

The diffusion model has recently emerged as a potent approach in computer vision, demonstrating remarkable performances in the field of generative artificial intelligence. Capable of producing high-quality synthetic images, diffusion models…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Abdullah , Tao Huang , Ickjai Lee , Euijoon Ahn

Discrete diffusion models have recently shown significant progress in modeling complex data, such as natural languages and DNA sequences. However, unlike diffusion models for continuous data, which can generate high-quality samples in just…

Machine Learning · Computer Science 2025-03-20 Anji Liu , Oliver Broadrick , Mathias Niepert , Guy Van den Broeck

The rare-event sampling problem has long been the central limiting factor in molecular dynamics (MD), especially in biomolecular simulation. Recently, diffusion models such as BioEmu have emerged as powerful equilibrium samplers that…

Diffusion models have demonstrated excellent performance for real-world image super-resolution (Real-ISR), albeit at high computational costs. Most existing methods are trying to derive one-step diffusion models from multi-step counterparts…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jianze Li , Jiezhang Cao , Zichen Zou , Xiongfei Su , Xin Yuan , Yulun Zhang , Yong Guo , Xiaokang Yang

Diffusion models and Flow Matching generate high-quality samples but are slow at inference, and distilling them into few-step models often leads to instability and extensive tuning. To resolve these trade-offs, we propose Inductive Moment…

Machine Learning · Computer Science 2025-05-16 Linqi Zhou , Stefano Ermon , Jiaming Song

We present a class of diffusion-based algorithms to draw samples from high-dimensional probability distributions given their unnormalized densities. Ideally, our methods can transport samples from a Gaussian distribution to a specified…

Machine Learning · Computer Science 2025-02-04 Anand Jerry George , Nicolas Macris

Diffusion-based generative models (DBGMs) perturb data to a target noise distribution and reverse this process to generate samples. The choice of noising process, or inference diffusion process, affects both likelihoods and sample quality.…

Machine Learning · Computer Science 2023-03-06 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

Foundation models enable prompt-based classifiers for zero-shot and few-shot learning. Nonetheless, the conventional method of employing fixed prompts suffers from distributional shifts that negatively impact generalizability to unseen…

Machine Learning · Computer Science 2024-10-29 Yingjun Du , Gaowen Liu , Yuzhang Shang , Yuguang Yao , Ramana Kompella , Cees G. M. Snoek

Diffusion models have recently gained unprecedented attention in the field of image synthesis due to their remarkable generative capabilities. Notwithstanding their prowess, these models often incur substantial computational costs,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xinyin Ma , Gongfan Fang , Xinchao Wang

Diffusion models have gained popularity for generating images from textual descriptions. Nonetheless, the substantial need for computational resources continues to present a noteworthy challenge, contributing to time-consuming processes.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Hanwen Chang , Haihao Shen , Yiyang Cai , Xinyu Ye , Zhenzhong Xu , Wenhua Cheng , Kaokao Lv , Weiwei Zhang , Yintong Lu , Heng Guo

Diffusion models have proven to be highly effective in generating high-quality images. However, adapting large pre-trained diffusion models to new domains remains an open challenge, which is critical for real-world applications. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Enze Xie , Lewei Yao , Han Shi , Zhili Liu , Daquan Zhou , Zhaoqiang Liu , Jiawei Li , Zhenguo Li

Diffusion models represent a powerful family of generative models widely used for image and video generation. However, the time-consuming deployment, long inference time, and requirements on large memory hinder their applications on…

Machine Learning · Computer Science 2025-04-18 Kafeng Wang , Jianfei Chen , He Li , Zhenpeng Mi , Jun Zhu

Denoising diffusion probabilistic models (DDPMs) have achieved high quality image generation without adversarial training, yet they require simulating a Markov chain for many steps to produce a sample. To accelerate sampling, we present…

Machine Learning · Computer Science 2022-10-07 Jiaming Song , Chenlin Meng , Stefano Ermon

We aim to leverage diffusion to address the challenging image matting task. However, the presence of high computational overhead and the inconsistency of noise sampling between the training and inference processes pose significant obstacles…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Yihan Hu , Yiheng Lin , Wei Wang , Yao Zhao , Yunchao Wei , Humphrey Shi