English
Related papers

Related papers: $\textit{Jump Your Steps}$: Optimizing Sampling Sc…

200 papers

The increased model capacity of Diffusion Transformers (DiTs) and the demand for generating higher resolutions of images and videos have led to a significant rise in inference latency, impacting real-time performance adversely. While prior…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Xibo Sun , Jiarui Fang , Aoyu Li , Jinzhe Pan

This paper introduces Discrete Markov Probabilistic Models (DMPMs), a novel discrete diffusion algorithm for discrete data generation. The algorithm operates in discrete bit space, where the noising process is a continuous-time Markov chain…

Machine Learning · Statistics 2025-10-09 Le-Tuyet-Nhi Pham , Dario Shariatian , Antonio Ocello , Giovanni Conforti , Alain Durmus

Distribution Matching Distillation (DMD) distills score-based generative models into efficient one-step generators, without requiring a one-to-one correspondence with the sampling trajectories of their teachers. Yet, the limited capacity of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xiangyu Fan , Zesong Qiu , Zhuguanyu Wu , Fanzhou Wang , Zhiqian Lin , Tianxiang Ren , Dahua Lin , Ruihao Gong , Lei Yang

The multi-step sampling mechanism, a key feature of visual diffusion models, has significant potential to replicate the success of OpenAI's Strawberry in enhancing performance by increasing the inference computational cost. Sufficient prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Shitong Shao , Zikai Zhou , Lichen Bai , Haoyi Xiong , Zeke Xie

Diffusion Language Models (DLMs) offer a promising parallel generation paradigm but suffer from slow inference due to numerous refinement steps and the inability to use standard KV caching. We introduce CDLM (Consistency Diffusion Language…

Machine Learning · Computer Science 2026-02-23 Minseo Kim , Chenfeng Xu , Coleman Hooper , Harman Singh , Ben Athiwaratkun , Ce Zhang , Kurt Keutzer , Amir Gholami

Sampling from diffusion probabilistic models (DPMs) is often expensive for high-quality image generation and typically requires many steps with a large model. In this paper, we introduce sampling Trajectory Stitching T-Stitch, a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Zizheng Pan , Bohan Zhuang , De-An Huang , Weili Nie , Zhiding Yu , Chaowei Xiao , Jianfei Cai , Anima Anandkumar

Discrete diffusion models offer a promising alternative to autoregressive generation through parallel decoding, but they suffer from a sampling wall: once categorical sampling occurs, rich distributional information collapses into one-hot…

Machine Learning · Computer Science 2026-05-14 Mingyu Jo , Jaesik Yoon , Justin Deschenaux , Caglar Gulcehre , Sungjin Ahn

Recent advancements in diffusion models have positioned them at the forefront of image generation. Despite their superior performance, diffusion models are not without drawbacks; they are characterized by complex architectures and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Yuda Song , Zehao Sun , Xuanwu Yin

Guidance provides a simple and effective framework for posterior sampling by steering the generation process towards the desired distribution. When modeling discrete data, existing approaches mostly focus on guidance with the first-order…

Machine Learning · Computer Science 2026-04-16 Zhengyan Wan , Yidong Ouyang , Liyan Xie , Fang Fang , Hongyuan Zha , Guang Cheng

Denoising Diffusion Probabilistic Models (DDPMs) have achieved impressive performance on various generation tasks. By modeling the reverse process of gradually diffusing the data distribution into a Gaussian distribution, generating a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Zhaoyang Lyu , Xudong XU , Ceyuan Yang , Dahua Lin , Bo Dai

Denoising diffusion probabilistic models (DDPMs) have recently achieved leading performances in many generative tasks. However, the inherited iterative sampling process costs hinder their applications to text-to-speech deployment. Through…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-14 Rongjie Huang , Zhou Zhao , Huadai Liu , Jinglin Liu , Chenye Cui , Yi Ren

Diffusion models excel at producing high-quality samples but naively require hundreds of iterations, prompting multiple attempts to distill the generation process into a faster network. However, many existing approaches suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zhengyang Geng , Ashwini Pokle , J. Zico Kolter

We present a mechanism to steer the sampling diversity of denoising diffusion and flow matching models, allowing users to sample from a sharper or broader distribution than the training distribution. We build on the observation that these…

Machine Learning · Computer Science 2026-05-26 Yanbo Xu , Yu Wu , Sungjae Park , Zhizhuo Zhou , Shubham Tulsiani

Score distillation sampling~(SDS) has been widely adopted to overcome the absence of unseen views in reconstructing 3D objects from a \textbf{single} image. It leverages pre-trained 2D diffusion models as teacher to guide the reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Xuanyu Yi , Zike Wu , Qingshan Xu , Pan Zhou , Joo-Hwee Lim , Hanwang Zhang

We consider the situation where we have a limited number of denoising steps, i.e., of evaluations of a diffusion model. We show that two parallel processors or samplers under such limitation can improve the quality of the sampled image.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Pedro Cisneros-Velarde

Sampling from diffusion models can be treated as solving the corresponding ordinary differential equations (ODEs), with the aim of obtaining an accurate solution with as few number of function evaluations (NFE) as possible. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Zhenyu Zhou , Defang Chen , Can Wang , Chun Chen

Continuous normalizing flows (CNFs) and diffusion models (DMs) generate high-quality data from a noise distribution. However, their sampling process demands multiple iterations to solve an ordinary differential equation (ODE) with high…

Machine Learning · Computer Science 2025-11-19 Denis Gudovskiy , Wenzhao Zheng , Tomoyuki Okuno , Yohei Nakata , Kurt Keutzer

Diffusion models have demonstrated remarkable success in image and video generation, yet their practical deployment remains hindered by the substantial computational overhead of multi-step iterative sampling. Among acceleration strategies,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Bowen Cui , Yuanbin Wang , Huajiang Xu , Biaolong Chen , Aixi Zhang , Hao Jiang , Zhengzheng Jin , Xu Liu , Pipei Huang

Diffusion models have achieved unprecedented performance in image generation, yet they suffer from slow inference due to their iterative sampling process. To address this, early-exiting has recently been proposed, where the depth of the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Daniel Gallo Fernández , Răzvan-Andrei Matişan , Alejandro Monroy Muñoz , Ana-Maria Vasilcoiu , Janusz Partyka , Tin Hadži Veljković , Metod Jazbec

Diffusion models have shown remarkable success in text-to-image generation, making preference alignment for these models increasingly important. The preference labels are typically available only at the terminal of denoising trajectories,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Dingyuan Shi , Yong Wang , Hangyu Li , Xiangxiang Chu