English
Related papers

Related papers: SCott: Accelerating Diffusion Models with Stochast…

200 papers

The slow inference process of image diffusion models significantly degrades interactive user experiences. To address this, we introduce Diffusion Preview, a novel paradigm employing rapid, low-step sampling to generate preliminary outputs…

Machine Learning · Computer Science 2026-04-08 Fu-Yun Wang , Hao Zhou , Liangzhe Yuan , Sanghyun Woo , Boqing Gong , Bohyung Han , Ming-Hsuan Yang , Han Zhang , Yukun Zhu , Ting Liu , Long Zhao

Diffusion models excel at producing high-quality samples but naively require hundreds of iterations, prompting multiple attempts to distill the generation process into a faster network. However, many existing approaches suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zhengyang Geng , Ashwini Pokle , J. Zico Kolter

Consistency distillation methods have demonstrated significant success in accelerating generative tasks of diffusion models. However, since previous consistency distillation methods use simple and straightforward strategies in selecting…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Cunzheng Wang , Ziyuan Guo , Yuxuan Duan , Huaxia Li , Nemo Chen , Xu Tang , Yao Hu

The intensive computational burden of Stable Diffusion (SD) for text-to-image generation poses a significant hurdle for its practical application. To tackle this challenge, recent research focuses on methods to reduce sampling steps, such…

Despite their ability to generate high-resolution and diverse images from text prompts, text-to-image diffusion models often suffer from slow iterative sampling processes. Model distillation is one of the most effective directions to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Thuan Hoang Nguyen , Anh Tran

We introduce Adversarial Diffusion Distillation (ADD), a novel training approach that efficiently samples large-scale foundational image diffusion models in just 1-4 steps while maintaining high image quality. We use score distillation to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Axel Sauer , Dominik Lorenz , Andreas Blattmann , Robin Rombach

Diffusion models have significantly advanced the fields of image, audio, and video generation, but they depend on an iterative sampling process that causes slow generation. To overcome this limitation, we propose consistency models, a new…

Machine Learning · Computer Science 2023-06-01 Yang Song , Prafulla Dhariwal , Mark Chen , Ilya Sutskever

Diffusion-based image super-resolution (SR) methods have shown promise in reconstructing high-resolution images with fine details from low-resolution counterparts. However, these approaches typically require tens or even hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Xiao He , Huaao Tang , Zhijun Tu , Junchao Zhang , Kun Cheng , Hanting Chen , Yong Guo , Mingrui Zhu , Nannan Wang , Xinbo Gao , Jie Hu

In large-scale time series forecasting, one often encounters the situation where the temporal patterns of time series, while drifting over time, differ from one another in the same dataset. In this paper, we provably show under such…

Machine Learning · Computer Science 2021-06-14 Yucheng Lu , Youngsuk Park , Lifan Chen , Yuyang Wang , Christopher De Sa , Dean Foster

Sampling from unnormalized target distributions is a fundamental yet challenging task in machine learning and statistics. Existing sampling algorithms typically require many iterative steps to produce high-quality samples, leading to high…

Machine Learning · Computer Science 2025-02-17 Pascal Jutras-Dubé , Patrick Pynadath , Ruqi Zhang

Diffusion models (DMs) have been adopted across diverse fields with its remarkable abilities in capturing intricate data distributions. In this paper, we propose a Fast Diffusion Model (FDM) to significantly speed up DMs from a stochastic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Zike Wu , Pan Zhou , Kenji Kawaguchi , Hanwang Zhang

Distilling video generation models to extremely low inference budgets (e.g., 2--4 NFEs) is crucial for real-time deployment, yet remains challenging. Trajectory-style consistency distillation often becomes conservative under complex video…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Xingtong Ge , Yi Zhang , Yushi Huang , Dailan He , Xiahong Wang , Bingqi Ma , Guanglu Song , Yu Liu , Jun Zhang

Consistency models imitate the multi-step sampling of score-based diffusion in a single forward pass of a neural network. They can be learned in two ways: consistency distillation and consistency training. The former relies on the true…

Machine Learning · Computer Science 2025-07-03 Thibaut Issenhuth , Sangchul Lee , Ludovic Dos Santos , Jean-Yves Franceschi , Chansoo Kim , Alain Rakotomamonjy

Diffusion models (DMs) have become the dominant paradigm of generative modeling in a variety of domains by learning stochastic processes from noise to data. Recently, diffusion denoising bridge models (DDBMs), a new formulation of…

Machine Learning · Computer Science 2024-11-01 Guande He , Kaiwen Zheng , Jianfei Chen , Fan Bao , Jun Zhu

Distribution Matching Distillation (DMD) distills score-based generative models into efficient one-step generators, without requiring a one-to-one correspondence with the sampling trajectories of their teachers. Yet, the limited capacity of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xiangyu Fan , Zesong Qiu , Zhuguanyu Wu , Fanzhou Wang , Zhiqian Lin , Tianxiang Ren , Dahua Lin , Ruihao Gong , Lei Yang

Diffusion Models have achieved remarkable results in video synthesis but require iterative denoising steps, leading to substantial computational overhead. Consistency Models have made significant progress in accelerating diffusion models.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zhengyao Lv , Chenyang Si , Tianlin Pan , Zhaoxi Chen , Kwan-Yee K. Wong , Yu Qiao , Ziwei Liu

Text-guided image and 3D editing have advanced with diffusion-based models, yet methods like Delta Denoising Score often struggle with stability, spatial control, and editing strength. These limitations stem from reliance on complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Haiming Zhu , Yangyang Xu , Chenshu Xu , Tingrui Shen , Wenxi Liu , Yong Du , Jun Yu , Shengfeng He

The Stable Diffusion Model (SDM) is a popular and efficient text-to-image (t2i) generation and image-to-image (i2i) generation model. Although there have been some attempts to reduce sampling steps, model distillation, and network…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Jinchao Zhu , Yuxuan Wang , Xiaobing Tu , Siyuan Pan , Pengfei Wan , Gao Huang

Image tokenization plays a central role in modern generative modeling by mapping visual inputs into compact representations that serve as an intermediate signal between pixels and generative models. Diffusion-based decoders have recently…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chuhan Wang , Hao Chen

Knowledge Distillation (KD) aims to transfer knowledge from a large teacher model to a smaller student model. While contrastive learning has shown promise in self-supervised learning by creating discriminative representations, its…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Nikolaos Giakoumoglou , Tania Stathaki