English
Related papers

Related papers: Multistep Consistency Models

200 papers

Consistency models (CMs) offer faster sampling than traditional diffusion models, but their training is resource-intensive. For example, as of 2024, training a state-of-the-art CM on CIFAR-10 takes one week on 8 GPUs. In this work, we…

Machine Learning · Computer Science 2024-10-14 Zhengyang Geng , Ashwini Pokle , William Luo , Justin Lin , J. Zico Kolter

Diffusion models (DMs) are a powerful generative framework that have attracted significant attention in recent years. However, the high computational cost of training DMs limits their practical applications. In this paper, we start with a…

Machine Learning · Computer Science 2024-04-12 Tianshuo Xu , Peng Mi , Ruilin Wang , Yingcong Chen

Diffusion models have shown strong performance in speech enhancement, but their real-time applicability has been limited by multi-step iterative sampling. Consistency distillation has recently emerged as a promising alternative by…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-19 Liang Xu , Longfei Felix Yan , W. Bastiaan Kleijn

Diffusion Models (DMs) have achieved great success in image generation and other fields. By fine sampling through the trajectory defined by the SDE/ODE solver based on a well-trained score model, DMs can generate remarkable high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Bowen Zheng , Tianming Yang

In medical image segmentation tasks, diffusion models have shown significant potential. However, mainstream diffusion models suffer from drawbacks such as multiple sampling times and slow prediction results. Recently, consistency models, as…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Kejia Zhang , Lan Zhang , Haiwei Pan , Baolong Yu

Multi-step prediction models, such as diffusion and rectified flow models, have emerged as state-of-the-art solutions for generation tasks. However, these models exhibit higher latency in sampling new frames compared to single-step methods.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Gaurav Shrivastava , Abhinav Shrivastava

Consistency distillation methods have demonstrated significant success in accelerating generative tasks of diffusion models. However, since previous consistency distillation methods use simple and straightforward strategies in selecting…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Cunzheng Wang , Ziyuan Guo , Yuxuan Duan , Huaxia Li , Nemo Chen , Xu Tang , Yao Hu

Diffusion distillation is a widely used technique to reduce the sampling cost of diffusion models, yet it often requires extensive training, and the student performance tends to be degraded. Recent studies show that incorporating a GAN…

Machine Learning · Computer Science 2025-06-12 Bowen Zheng , Tianming Yang

The slow iterative sampling nature remains a major bottleneck for the practical deployment of diffusion and flow-based generative models. While consistency models (CMs) represent a state-of-the-art distillation-based approach for efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Linwei Dong , Ruoyu Guo , Ge Bai , Zehuan Yuan , Yawei Luo , Changqing Zou

Distilling latent diffusion models (LDMs) into ones that are fast to sample from is attracting growing research interest. However, the majority of existing methods face two critical challenges: (1) They hinge on long training using a huge…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Qingsong Xie , Zhenyi Liao , Zhijie Deng , Chen chen , Haonan Lu

The recently introduced Consistency models pose an efficient alternative to diffusion algorithms, enabling rapid and good quality image synthesis. These methods overcome the slowness of diffusion models by directly mapping noise to data,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Shelly Golan , Roy Ganz , Michael Elad

Pre-trained diffusion models are commonly used to generate clean data (e.g., images) from random noises, effectively forming pairs of noises and corresponding clean images. Distillation on these pre-trained models can be viewed as the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Zhangkai Wu , Xuhui Fan , Hongyu Wu , Longbing Cao

The iterative sampling procedure employed by diffusion models (DMs) often leads to significant inference latency. To address this, we propose Stochastic Consistency Distillation (SCott) to enable accelerated text-to-image generation, where…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Hongjian Liu , Qingsong Xie , TianXiang Ye , Zhijie Deng , Chen Chen , Shixiang Tang , Xueyang Fu , Haonan Lu , Zheng-jun Zha

Timestep distillation is an effective approach for improving the generation efficiency of diffusion models. The Consistency Model (CM), as a trajectory-based framework, demonstrates significant potential due to its strong theoretical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Bao Tang , Shuai Zhang , Yueting Zhu , Jijun Xiang , Xin Yang , Li Yu , Wenyu Liu , Xinggang Wang

The wide application of flow-matching methods has greatly promoted the development of robot imitation learning. However, these methods all face the problem of high inference time. To address this issue, researchers have proposed…

Robotics · Computer Science 2025-10-23 Yu Fang , Xinyu Wang , Xuehe Zhang , Wanli Xue , Mingwei Zhang , Shengyong Chen , Jie Zhao

Consistency models are a new family of generative models capable of producing high-quality samples in either a single step or multiple steps. Recently, consistency models have demonstrated impressive performance, achieving results on par…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Quan Dao , Khanh Doan , Di Liu , Trung Le , Dimitris Metaxas

Diffusion models achieve high-quality sample generation at the cost of a lengthy multistep inference procedure. To overcome this, diffusion distillation techniques produce student generators capable of matching or surpassing the teacher in…

Machine Learning · Computer Science 2024-12-04 Yanke Song , Jonathan Lorraine , Weili Nie , Karsten Kreis , James Lucas

We propose a new score-based model with one-step sampling. Previously, score-based models were burdened with heavy computations due to iterative sampling. For substituting the iterative process, we train a standalone generator to compress…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Senmao Ye , Fei Liu

Recently, diffusion models have achieved significant advances in vision, text, and robotics. However, they still face slow generation speeds due to sequential denoising processes. To address this, a parallel sampling method based on Picard…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Junhyuk So , Jiwoong Shin , Chaeyeon Jang , Eunhyeok Park

Recent approaches have shown promises distilling diffusion models into efficient one-step generators. Among them, Distribution Matching Distillation (DMD) produces one-step generators that match their teacher in distribution, without…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Tianwei Yin , Michaël Gharbi , Taesung Park , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman