English
Related papers

Related papers: Few-Step Diffusion Sampling Through Instance-Aware…

200 papers

Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie, position space), and using a neural network to reverse it.…

Machine Learning · Computer Science 2024-05-14 Tianrong Chen , Jiatao Gu , Laurent Dinh , Evangelos A. Theodorou , Joshua Susskind , Shuangfei Zhai

There have been many attempts to leverage multiple diffusion models for collaborative generation, extending beyond the original domain. A prominent approach involves synchronizing multiple diffusion trajectories by mixing the estimated…

Machine Learning · Computer Science 2025-06-04 Hyunjun Lee , Hyunsoo Lee , Sookwan Han

Consistency models have recently been introduced to accelerate sampling from diffusion models by directly predicting the solution (i.e., data) of the probability flow ODE (PF ODE) from initial noise. However, the training of consistency…

Machine Learning · Computer Science 2025-01-24 Sangyun Lee , Yilun Xu , Tomas Geffner , Giulia Fanti , Karsten Kreis , Arash Vahdat , Weili Nie

Recent diffusion distillation methods have achieved remarkable progress, enabling high-quality ${\sim}4$-step sampling for large-scale text-conditional image and video diffusion models. However, further reducing the number of sampling steps…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Nikita Starodubcev , Ilya Drobyshevskiy , Denis Kuznedelev , Artem Babenko , Dmitry Baranchuk

Recently, diffusion models (DMs) have made significant strides in high-quality image generation. However, the multi-step denoising process often results in considerable computational overhead, impeding deployment on resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yu-Shan Tai , An-Yeu , Wu

Autonomous driving requires reasoning about interactions with surrounding traffic. A prevailing approach is large-scale imitation learning on expert driving datasets, aimed at generalizing across diverse real-world scenarios. For online…

Diffusion models (DMs) excel in image generation but suffer from slow inference and training-inference discrepancies. Although gradient-based solvers for DMs accelerate denoising inference, they often lack theoretical foundations in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Shigui Li , Wei Chen , Delu Zeng

Recently, the rectified flow (RF) has emerged as the new state-of-the-art among flow-based diffusion models due to its high efficiency advantage in straight path sampling, especially with the amazing images generated by a series of RF…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Zhiyuan Ma , Ruixun Liu , Sixian Liu , Jianjun Li , Bowen Zhou

In ecological studies of pattern formation, models of the competitive-diffusion type are generally singularly perturbed, and the numerical approximation of such models is challenging. In this paper, we present finite element discretization…

Numerical Analysis · Mathematics 2026-04-15 Xianping Li , Woinshet D. Mergia , Kailash C. Patidar

Ordinary differential equations (ODEs), via their induced flow maps, provide a powerful framework to parameterize invertible transformations for the purpose of representing complex probability distributions. While such models have achieved…

Statistics Theory · Mathematics 2023-09-06 Youssef Marzouk , Zhi Ren , Sven Wang , Jakob Zech

Distillation addresses the slow sampling problem in diffusion models by creating models with smaller size or fewer steps that approximate the behavior of high-step teachers. In this work, we propose a reinforcement learning based…

Machine Learning · Computer Science 2025-12-30 Amirhossein Tighkhorshid , Zahra Dehghanian , Gholamali Aminian , Chengchun Shi , Hamid R. Rabiee

Diffusion Purification, purifying noised images with diffusion models, has been widely used for enhancing certified robustness via randomized smoothing. However, existing frameworks often grapple with the balance between efficiency and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yiquan Li , Zhongzhu Chen , Kun Jin , Jiongxiao Wang , Bo Li , Chaowei Xiao

Diffusion frameworks have achieved comparable performance with previous state-of-the-art image generation models. Researchers are curious about its variants in discriminative tasks because of its powerful noise-to-image denoising pipeline.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Zhangxuan Gu , Haoxing Chen , Zhuoer Xu , Jun Lan , Changhua Meng , Weiqiang Wang

Denoising diffusion probabilistic models have brought tremendous advances in generative tasks, achieving state-of-the-art performance thus far. Current diffusion model-based applications exploit the power of learned visual representations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Changgyoon Oh , Jongoh Jeong , Jegyeong Cho , Kuk-Jin Yoon

Each training step for a variational autoencoder (VAE) requires us to sample from the approximate posterior, so we usually choose simple (e.g. factorised) approximate posteriors in which sampling is an efficient computation that fully…

Machine Learning · Statistics 2018-05-29 Laurence Aitchison , Vincent Adam , Srinivas C. Turaga

Score-based diffusion models, while achieving remarkable empirical performance, often suffer from low sampling speed, due to extensive function evaluations needed during the sampling phase. Despite a flurry of recent activities towards…

Machine Learning · Computer Science 2024-03-07 Gen Li , Yu Huang , Timofey Efimov , Yuting Wei , Yuejie Chi , Yuxin Chen

Continuous-time generative models, such as Flow Matching (FM), construct probability paths to transport between one distribution and another through the simulation-free learning of the neural ordinary differential equations (ODEs). During…

Machine Learning · Computer Science 2024-05-24 Qunxi Zhu , Wei Lin

Diffusion-based generative models employ stochastic differential equations (SDEs) and their equivalent probability flow ordinary differential equations (ODEs) to establish a smooth transformation between complex high-dimensional data…

Machine Learning · Computer Science 2025-12-12 Defang Chen , Zhenyu Zhou , Can Wang , Siwei Lyu

Diffusion models produce high-quality text-to-image results, but their iterative denoising is computationally expensive.Distribution Matching Distillation (DMD) emerges as a promising path to few-step distillation, but suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haoyu Li , Tingyan Wen , Lin Qi , Zhe Wu , Yihuang Chen , Xing Zhou , Lifei Zhu , Xueqian Wang , Kai Zhang

Spatial reaction-diffusion models have been employed to describe many emergent phenomena in biological systems. The modelling technique most commonly adopted in the literature implements systems of partial differential equations (PDEs),…

Quantitative Methods · Quantitative Biology 2015-10-05 Christian A. Yates , Mark B. Flegg