English
Related papers

Related papers: DistillKac: Few-Step Image Generation via Damped W…

200 papers

In this paper, we present the Directly Denoising Diffusion Model (DDDM): a simple and generic approach for generating realistic images with few-step sampling, while multistep sampling is still preserved for better performance. DDDMs require…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Dan Zhang , Jingjing Wang , Feng Luo

Diffusion models excel at producing high-quality samples but naively require hundreds of iterations, prompting multiple attempts to distill the generation process into a faster network. However, many existing approaches suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zhengyang Geng , Ashwini Pokle , J. Zico Kolter

Diffusion-based stylization methods typically denoise from a specific partial noise state for image-to-image and video-to-video tasks. This multi-step diffusion process is computationally expensive and hinders real-world application. A…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sijie Xu , Runqi Wang , Wei Zhu , Dejia Song , Nemo Chen , Xu Tang , Yao Hu

Dataset distillation reduces the storage and computational consumption of training a network by generating a small surrogate dataset that encapsulates rich information of the original large-scale one. However, previous distillation methods…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Jianyang Gu , Saeed Vahidian , Vyacheslav Kungurtsev , Haonan Wang , Wei Jiang , Yang You , Yiran Chen

Diffusion- and flow-based models have emerged as state-of-the-art generative modeling approaches, but they require many sampling steps. Consistency models can distill these models into efficient one-step generators; however, unlike flow-…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis

We propose a method to distill a complex multistep diffusion model into a single-step conditional GAN student model, dramatically accelerating inference, while preserving image quality. Our approach interprets diffusion distillation as a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Minguk Kang , Richard Zhang , Connelly Barnes , Sylvain Paris , Suha Kwak , Jaesik Park , Eli Shechtman , Jun-Yan Zhu , Taesung Park

Recent advancements in human image animation have been propelled by video diffusion models, yet their reliance on numerous iterative denoising steps results in high inference costs and slow speeds. An intuitive solution involves adopting…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Xiang Wang , Shiwei Zhang , Hangjie Yuan , Yujie Wei , Yingya Zhang , Changxin Gao , Yuehuan Wang , Nong Sang

Diffusion distillation is a widely used technique to reduce the sampling cost of diffusion models, yet it often requires extensive training, and the student performance tends to be degraded. Recent studies show that incorporating a GAN…

Machine Learning · Computer Science 2025-06-12 Bowen Zheng , Tianming Yang

Distribution matching distillation (DMD) facilitates few-step image generation by aligning a distilled student with a reference multi-step teacher. In practice, however, optimizing DMD can reduce sample diversity in few-step synthesis, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Tianhe Wu , Ruibin Li , Lei Zhang , Kede Ma

Diffusion models (DMs) produce high-quality images, yet their sampling remains costly when adapted to new domains. Distilled DMs are faster but typically remain confined within their teacher's domain. Thus, fast and high-quality generation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yara Bahram , Mélodie Desbos , Mohammadhadi Shateri , Eric Granger

Photorealistic style transfer entails transferring the style of a reference image to another image so the result seems like a plausible photo. Our work is inspired by the observation that existing models are slow due to their large sizes.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Tai-Yin Chiu , Danna Gurari

Videos shot by laymen using hand-held cameras contain undesirable shaky motion. Estimating the global motion between successive frames, in a manner not influenced by moving objects, is central to many video stabilization techniques, but…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Jerin Geo James , Devansh Jain , Ajit Rajwade

Preprocessing is a well-established technique for optimizing compression, yet existing methods are predominantly Rate-Distortion (R-D) optimized and constrained by pixel-level fidelity. This work pioneers a shift towards Rate-Perception…

Image and Video Processing · Electrical Eng. & Systems 2025-12-18 Mengxi Guo , Shijie Zhao , Junlin Li , Li Zhang

We present SD3.5-Flash, an efficient few-step distillation framework that brings high-quality image generation to accessible consumer devices. Our approach distills computationally prohibitive rectified flow models through a reformulated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Hmrishav Bandyopadhyay , Rahim Entezari , Jim Scott , Reshinth Adithyan , Yi-Zhe Song , Varun Jampani

Image Auto-regressive (AR) models have emerged as a powerful paradigm of visual generative models. Despite their promising performance, they suffer from slow generation speed due to the large number of sampling steps required. Although…

Machine Learning · Computer Science 2025-10-27 Enshu Liu , Qian Chen , Xuefei Ning , Shengen Yan , Guohao Dai , Zinan Lin , Yu Wang

Following our previous work (J. Phys. Chem. Lett., 2026, 17, 5, 1288-1295), we propose the DMTS-NC approach, a distilled multi-time-step (DMTS) strategy using non-conservative (NC) forces to further accelerate atomistic molecular dynamics…

Video diffusion generation suffers from critical sampling efficiency bottlenecks, particularly for large-scale models and long contexts. Existing video acceleration methods, adapted from image-based techniques, lack a single-step…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Jiaxiang Cheng , Bing Ma , Xuhua Ren , Hongyi Henry Jin , Kai Yu , Peng Zhang , Wenyue Li , Yuan Zhou , Tianxiang Zheng , Qinglin Lu

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

Recently, diffusion-based object removal models have achieved impressive results in eliminating objects and their associated visual effects. However, they indiscriminately denoise all tokens across all timesteps, ignoring that removal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yixin Tang , Jiawei Guo , Junxian Li , Zhiteng Li , Jixin Zhao , Bingya Zhang , Chenbo Wang , Yulun Zhang , Shangchen Zhou

Diffusion models, as a type of generative model, have achieved impressive results in generating images and videos conditioned on textual conditions. However, the generation process of diffusion models involves denoising dozens of steps to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Hui Zhang , Zuxuan Wu , Zhen Xing , Jie Shao , Yu-Gang Jiang