English
Related papers

Related papers: Stream-R1: Reliability-Perplexity Aware Reward Dis…

200 papers

Diffusion models achieve state-of-the-art generative performance but are fundamentally bottlenecked by their slow, iterative sampling process. While diffusion distillation techniques enable high-fidelity, few-step generation, traditional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Linqian Fan , Peiqin Sun , Tiancheng Wen , Shun Lu , Chengru Song

Diffusion-based video super-resolution (VSR) has recently achieved remarkable fidelity but still suffers from prohibitive sampling costs. While distribution matching distillation (DMD) can accelerate diffusion models toward one-step…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhengyao Lv , Menghan Xia , Xintao Wang , Kwan-Yee K. Wong

Efficient streaming video generation is critical for simulating interactive and dynamic worlds. Existing methods distill few-step video diffusion models with sliding window attention, using initial frames as sink tokens to maintain…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yunhong Lu , Yanhong Zeng , Haobo Li , Hao Ouyang , Qiuyu Wang , Ka Leong Cheng , Jiapeng Zhu , Hengyuan Cao , Zhipeng Zhang , Xing Zhu , Yujun Shen , Min Zhang

Diffusion distillation, exemplified by Distribution Matching Distillation (DMD), has shown great promise in few-step generation but often sacrifices quality for sampling speed. While integrating Reinforcement Learning (RL) into distillation…

Machine Learning · Computer Science 2026-04-22 Linwei Dong , Ruoyu Guo , Ge Bai , Zehuan Yuan , Yawei Luo , Changqing Zou

Diffusion Models have emerged as a leading class of generative models, yet their iterative sampling process remains computationally expensive. Timestep distillation is a promising technique to accelerate generation, but it often requires…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Guanjie Chen , Shirui Huang , Kai Liu , Jianchen Zhu , Xiaoye Qu , Peng Chen , Yu Cheng , Yifu Sun

Distillation addresses the slow sampling problem in diffusion models by creating models with smaller size or fewer steps that approximate the behavior of high-step teachers. In this work, we propose a reinforcement learning based…

Machine Learning · Computer Science 2025-12-30 Amirhossein Tighkhorshid , Zahra Dehghanian , Gholamali Aminian , Chengchun Shi , Hamid R. Rabiee

Distribution matching distillation (DMD) facilitates few-step image generation by aligning a distilled student with a reference multi-step teacher. In practice, however, optimizing DMD can reduce sample diversity in few-step synthesis, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Tianhe Wu , Ruibin Li , Lei Zhang , Kede Ma

Diffusion-based image super-resolution (SR) methods have shown promise in reconstructing high-resolution images with fine details from low-resolution counterparts. However, these approaches typically require tens or even hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Xiao He , Huaao Tang , Zhijun Tu , Junchao Zhang , Kun Cheng , Hanting Chen , Yong Guo , Mingrui Zhu , Nannan Wang , Xinbo Gao , Jie Hu

Distribution Matching Distillation (DMD) facilitates efficient inference by distilling multi-step diffusion models into few-step variants. Concurrently, Reinforcement Learning (RL) has emerged as a vital tool for aligning generative models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Dengyang Jiang , Dongyang Liu , Zanyi Wang , Qilong Wu , Liuzhuozheng Li , Hengzhuang Li , Xin Jin , David Liu , Changsheng Lu , Zhen Li , Bo Zhang , Mengmeng Wang , Steven Hoi , Peng Gao , Harry Yang

Distribution Matching Distillation (DMD) distills score-based generative models into efficient one-step generators, without requiring a one-to-one correspondence with the sampling trajectories of their teachers. Yet, the limited capacity of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xiangyu Fan , Zesong Qiu , Zhuguanyu Wu , Fanzhou Wang , Zhiqian Lin , Tianxiang Ren , Dahua Lin , Ruihao Gong , Lei Yang

Achieving streaming, fine-grained control over the outputs of autoregressive video diffusion models remains challenging, making it difficult to ensure that they consistently align with user expectations. To bridge this gap, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Junbao Zhou , Yuan Zhou , Kesen Zhao , Qingshan Xu , Beier Zhu , Richang Hong , Hanwang Zhang

Diffusion distillation is central to accelerating image and video generation, yet existing methods are fundamentally limited by the denoising process, where step reduction has largely saturated. Partial timestep low-resolution generation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Feiyang Chen , Hongpeng Pan , Haonan Xu , Xinyu Duan , Yang Yang , Zhefeng Wang

Diffusion probabilistic models have shown significant progress in video generation; however, their computational efficiency is limited by the large number of sampling steps required. Reducing sampling steps often compromises video quality…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zihan Ding , Chi Jin , Difan Liu , Haitian Zheng , Krishna Kumar Singh , Qiang Zhang , Yan Kang , Zhe Lin , Yuchen Liu

Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yuyang You , Yongzhi Li , Jiahui Li , Yadong Mu , Quan Chen , Peng Jiang

Traditional black-box distillation for Large Vision-Language Models (LVLMs) typically relies on a single teacher response per input, which often yields high-variance responses and format inconsistencies in multimodal or temporal scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Songlin Li , Xin Zhu , Zechao Guan , Peipeng Chen , Jian Yao

Diffusion-based video super-resolution (VSR) methods deliver strong perceptual quality but are often unsuitable for latency-sensitive scenarios due to reliance on future frames and expensive multi-step denoising. We propose Stream-DiffVSR,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Hau-Shiang Shiu , Chin-Yang Lin , Zhixiang Wang , Chi-Wei Hsiao , Po-Fan Yu , Yu-Chih Chen , Yu-Lun Liu

Diffusion models produce high-quality text-to-image results, but their iterative denoising is computationally expensive.Distribution Matching Distillation (DMD) emerges as a promising path to few-step distillation, but suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haoyu Li , Tingyan Wen , Lin Qi , Zhe Wu , Yihuang Chen , Xing Zhou , Lifei Zhu , Xueqian Wang , Kai Zhang

Distilling video generation models to extremely low inference budgets (e.g., 2--4 NFEs) is crucial for real-time deployment, yet remains challenging. Trajectory-style consistency distillation often becomes conservative under complex video…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Xingtong Ge , Yi Zhang , Yushi Huang , Dailan He , Xiahong Wang , Bingqi Ma , Guanglu Song , Yu Liu , Jun Zhang

Current video diffusion models achieve impressive generation quality but struggle in interactive applications due to bidirectional attention dependencies. The generation of a single frame requires the model to process the entire sequence,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Tianwei Yin , Qiang Zhang , Richard Zhang , William T. Freeman , Fredo Durand , Eli Shechtman , Xun Huang

Distribution Matching Distillation (DMD) is a promising score distillation technique that compresses pre-trained teacher diffusion models into efficient one-step or multi-step student generators. Nevertheless, its reliance on the reverse…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Yanzuo Lu , Yuxi Ren , Xin Xia , Shanchuan Lin , Xing Wang , Xuefeng Xiao , Andy J. Ma , Xiaohua Xie , Jian-Huang Lai
‹ Prev 1 2 3 10 Next ›