中文
相关论文

相关论文: One-Forcing: Towards Stable One-Step Autoregressiv…

200 篇论文

Distribution Matching Distillation (DMD) distills score-based generative models into efficient one-step generators, without requiring a one-to-one correspondence with the sampling trajectories of their teachers. Yet, the limited capacity of…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Xiangyu Fan , Zesong Qiu , Zhuguanyu Wu , Fanzhou Wang , Zhiqian Lin , Tianxiang Ren , Dahua Lin , Ruihao Gong , Lei Yang

Diffusion Models have emerged as a leading class of generative models, yet their iterative sampling process remains computationally expensive. Timestep distillation is a promising technique to accelerate generation, but it often requires…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Guanjie Chen , Shirui Huang , Kai Liu , Jianchen Zhu , Xiaoye Qu , Peng Chen , Yu Cheng , Yifu Sun

Recent diffusion- and flow-based VTON methods achieve strong results with pretrained generative models, but their reliance on multi-step sampling incurs high inference cost, while existing acceleration methods largely overlook the intrinsic…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Xianbing Sun , Jiahui Zhan , Liqing Zhang , Jianfu Zhang

Streaming video generation, as one fundamental component in interactive world models and neural game engines, aims to generate high-quality, low-latency, and temporally coherent long video streams. However, most existing work suffers from…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Kunhao Liu , Wenbo Hu , Jiale Xu , Ying Shan , Shijian Lu

Autoregressive (AR) models have achieved state-of-the-art performance in text and image generation but suffer from slow generation due to the token-by-token process. We ask an ambitious question: can a pre-trained AR model be adapted to…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Enshu Liu , Xuefei Ning , Yu Wang , Zinan Lin

Diffusion distillation is a widely used technique to reduce the sampling cost of diffusion models, yet it often requires extensive training, and the student performance tends to be degraded. Recent studies show that incorporating a GAN…

机器学习 · 计算机科学 2025-06-12 Bowen Zheng , Tianming Yang

Recent joint audio-visual diffusion models achieve remarkable generation quality but suffer from high latency due to their bidirectional attention dependencies, hindering real-time applications. We propose OmniForcing, the first framework…

多媒体 · 计算机科学 2026-03-16 Yaofeng Su , Yuming Li , Zeyue Xue , Jie Huang , Siming Fu , Haoran Li , Ying Li , Zezhong Qian , Haoyang Huang , Nan Duan

Efficient streaming video generation is critical for simulating interactive and dynamic worlds. Existing methods distill few-step video diffusion models with sliding window attention, using initial frames as sink tokens to maintain…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Yunhong Lu , Yanhong Zeng , Haobo Li , Hao Ouyang , Qiuyu Wang , Ka Leong Cheng , Jiapeng Zhu , Hengyuan Cao , Zhipeng Zhang , Xing Zhu , Yujun Shen , Min Zhang

Diffusion models have achieved impressive performance in video generation, but their iterative denoising process remains computationally expensive due to the large number of tokens processed at each timestep. Recently, progressive…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Shikang Zheng , Jingkai Huang , Jiacheng Liu , Guantao Chen , Lixuan , Yuqi Lin , Peiliang Cai , Linfeng Zhang

One-step generators distilled from Masked Diffusion Models (MDMs) compress multiple sampling steps into a single forward pass, enabling efficient text and image synthesis. However, they suffer two key limitations: they inherit modeling bias…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Yuanzhi Zhu , Xi Wang , Stéphane Lathuilière , Vicky Kalogeiton

Discrete diffusion models excel at visual synthesis but rely on slow, iterative decoding. Existing single-step distillation methods attempt to bypass this bottleneck, either by training auxiliary score networks that effectively double…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Chaoyang Wang , Yunhai Tong

Diffusion models have significantly advanced the fields of image, audio, and video generation, but they depend on an iterative sampling process that causes slow generation. To overcome this limitation, we propose consistency models, a new…

机器学习 · 计算机科学 2023-06-01 Yang Song , Prafulla Dhariwal , Mark Chen , Ilya Sutskever

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li

To achieve real-time interactive video generation, current methods distill pretrained bidirectional video diffusion models into few-step autoregressive (AR) models, facing an architectural gap when full attention is replaced by causal…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Hongzhou Zhu , Min Zhao , Guande He , Hang Su , Chongxuan Li , Jun Zhu

The "one-shot" technique represents a distinct and sophisticated aesthetic in filmmaking. However, its practical realization is often hindered by prohibitive costs and complex real-world constraints. Although emerging video generation…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Jiawei Liu , Junqiao Li , Jiangfan Deng , Gen Li , Siyu Zhou , Zetao Fang , Shanshan Lao , Zengde Deng , Jianing Zhu , Tingting Ma , Jiayi Li , Yunqiu Wang , Qian He , Xinglong Wu

Sampling from pretrained diffusion and flow-matching models typically requires many forward passes to generate diverse and high-fidelity images. Existing distillation methods often rely on multiple auxiliary networks, carefully designed…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Yuan Zhang , Chenyi Li , Guoqing Ma , Jiajun Zha , Yuanming Yang , Bo Wang , Wei Tang , Wenbo Li , Haoyang Huang , Nan Duan

Diffusion-based stylization methods typically denoise from a specific partial noise state for image-to-image and video-to-video tasks. This multi-step diffusion process is computationally expensive and hinders real-world application. A…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Sijie Xu , Runqi Wang , Wei Zhu , Dejia Song , Nemo Chen , Xu Tang , Yao Hu

Diffusion models have achieved remarkable progress in the field of video generation. However, their iterative denoising nature requires a large number of inference steps to generate a video, which is slow and computationally expensive. In…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Xihui Liu , Yunhong Wang , Yu Qiao

Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Yuyang You , Yongzhi Li , Jiahui Li , Yadong Mu , Quan Chen , Peng Jiang

Current frontier video diffusion models have demonstrated remarkable results at generating high-quality videos. However, they can only generate short video clips, normally around 10 seconds or 240 frames, due to computation limitations…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Desai Xie , Zhan Xu , Yicong Hong , Hao Tan , Difan Liu , Feng Liu , Arie Kaufman , Yang Zhou