English
Related papers

Related papers: One-Forcing: Towards Stable One-Step Autoregressiv…

200 papers

Generating high-dimensional visual modalities is a computationally intensive task. A common solution is progressive generation, where the outputs are synthesized in a coarse-to-fine spectral autoregressive manner. While diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Moayed Haji-Ali , Willi Menapace , Ivan Skorokhodov , Arpit Sahni , Sergey Tulyakov , Vicente Ordonez , Aliaksandr Siarohin

This paper introduces DLM-One, a score-distillation-based framework for one-step sequence generation with continuous diffusion language models (DLMs). DLM-One eliminates the need for iterative refinement by aligning the scores of a student…

Computation and Language · Computer Science 2025-06-03 Tianqi Chen , Shujian Zhang , Mingyuan Zhou

Recent advances in diffusion models have improved controllable streetscape generation and supported downstream perception and planning tasks. However, challenges remain in accurately modeling driving scenes and generating long videos. To…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Jianbiao Mei , Tao Hu , Xuemeng Yang , Licheng Wen , Yu Yang , Tiantian Wei , Yukai Ma , Min Dou , Botian Shi , Yong Liu

Diffusion models, praised for their success in generative tasks, are increasingly being applied to robotics, demonstrating exceptional performance in behavior cloning. However, their slow generation process stemming from iterative denoising…

Recent advancements in generative models have ignited substantial interest in dynamic 3D content creation (\ie, 4D generation). Existing approaches primarily rely on Score Distillation Sampling (SDS) to infer novel-view videos, typically…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Hanxin Zhu , Tianyu He , Xiqian Yu , Junliang Guo , Zhibo Chen , Jiang Bian

Diffusion models produce high-quality text-to-image results, but their iterative denoising is computationally expensive.Distribution Matching Distillation (DMD) emerges as a promising path to few-step distillation, but suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haoyu Li , Tingyan Wen , Lin Qi , Zhe Wu , Yihuang Chen , Xing Zhou , Lifei Zhu , Xueqian Wang , Kai Zhang

With the advance of diffusion models, today's video generation has achieved impressive quality. But generating temporal consistent long videos is still challenging. A majority of video diffusion models (VDMs) generate long videos in an…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Kaifeng Gao , Jiaxin Shi , Hanwang Zhang , Chunping Wang , Jun Xiao

Recent advances in autoregressive video diffusion have enabled real-time frame streaming, yet existing solutions still suffer from temporal repetition, drift, and motion deceleration. We find that naively applying StreamingLLM-style…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Jung Yi , Wooseok Jang , Paul Hyunbin Cho , Jisu Nam , Heeji Yoon , Seungryong Kim

Distillation-based acceleration has become foundational for making autoregressive streaming video diffusion models practical, with distribution matching distillation (DMD) as the de facto choice. Existing methods, however, train the student…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Bin Wu , Mengqi Huang , Shaojin Wu , Weinan Jia , Yuxin Wang , Zhendong Mao , Yongdong Zhang

The rapid development of generative models has significantly advanced image and video applications. Among these, video creation, aimed at generating videos under various conditions, has gained substantial attention. However, existing video…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yutong Wang , Haiyu Zhang , Tianfan Xue , Yu Qiao , Yaohui Wang , Chang Xu , Xinyuan Chen

Diffusion-based video super-resolution (VSR) has recently achieved remarkable fidelity but still suffers from prohibitive sampling costs. While distribution matching distillation (DMD) can accelerate diffusion models toward one-step…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhengyao Lv , Menghan Xia , Xintao Wang , Kwan-Yee K. Wong

The ultimate goal of video generation is to satisfy a fundamental trilemma: achieving high visual quality, maintaining rigorous physical consistency, and enabling precise controllability. While recent models can maintain this balance in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tianshuo Xu , Zhifei Chen , Leyi Wu , Hao Lu , Ying-cong Chen

Diffusion- and flow-based models have emerged as state-of-the-art generative modeling approaches, but they require many sampling steps. Consistency models can distill these models into efficient one-step generators; however, unlike flow-…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis

Long-trajectory video generation is a crucial yet challenging task for world modeling primarily due to the limited scalability of existing video diffusion models (VDMs). Autoregressive models, while offering infinite rollout, suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Junyi Ouyang , Wenbin Teng , Gonglin Chen , Yajie Zhao , Haiwei Chen

While recent diffusion-based generative image codecs have shown impressive performance, their iterative sampling process introduces unpleasing latency. In this work, we revisit the design of a diffusion-based codec and argue that multi-step…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Naifu Xue , Zhaoyang Jia , Jiahao Li , Bin Li , Yuan Zhang , Yan Lu

Flow-based image generative models exhibit stable training and produce high quality samples when using multi-step sampling procedures. One-step generative models can produce high quality image samples but can be difficult to optimize as…

Machine Learning · Computer Science 2026-04-13 Chia-Hong Hsu , Frank Wood

Distilling video generation models to extremely low inference budgets (e.g., 2--4 NFEs) is crucial for real-time deployment, yet remains challenging. Trajectory-style consistency distillation often becomes conservative under complex video…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Xingtong Ge , Yi Zhang , Yushi Huang , Dailan He , Xiahong Wang , Bingqi Ma , Guanglu Song , Yu Liu , Jun Zhang

Despite the advances in the field of generative models in computer vision, video stabilization still lacks a pure regressive deep-learning-based formulation. Deep video stabilization is generally formulated with the help of explicit motion…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Muhammad Kashif Ali , Sangjoon Yu , Tae Hyun Kim

Diffusion models offer superior generation quality at the expense of extensive sampling steps. Distillation methods, with Distribution Matching Distillation (DMD) as a popular example, can mitigate this issue, but performance degradation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Xu Wang , Zexian Li , Litong Gong , Tiezheng Ge , Zhijie Deng

Recent advances in continuous generative models, including multi-step approaches like diffusion and flow-matching (typically requiring 8-1000 sampling steps) and few-step methods such as consistency models (typically 1-8 steps), have…

Machine Learning · Computer Science 2025-05-21 Peng Sun , Yi Jiang , Tao Lin