English
Related papers

Related papers: EFlow: Fast Few-Step Video Generator Training from…

200 papers

Discrete diffusion models excel at visual synthesis but rely on slow, iterative decoding. Existing single-step distillation methods attempt to bypass this bottleneck, either by training auxiliary score networks that effectively double…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Chaoyang Wang , Yunhai Tong

Diffusion models excel in high-quality generation but suffer from slow inference due to iterative sampling. While recent methods have successfully transformed diffusion models into one-step generators, they neglect model size reduction,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Yuanzhi Zhu , Xingchao Liu , Qiang Liu

DiT models have achieved great success in text-to-video generation, leveraging their scalability in model capacity and data scale. High content and motion fidelity aligned with text prompts, however, often require large model parameters and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Shilong Zhang , Wenbo Li , Shoufa Chen , Chongjian GE , Peize Sun , Yifu Zhang , Yi Jiang , Zehuan Yuan , Bingyue Peng , Ping Luo

Recent advances in few-step diffusion models have demonstrated their efficiency and effectiveness by shortcutting the probabilistic paths of diffusion models, especially in training one-step diffusion models from scratch (\emph{a.k.a.}…

Machine Learning · Computer Science 2026-02-03 Haitao Lin , Peiyan Hu , Minsi Ren , Zhifeng Gao , Zhi-Ming Ma , Guolin ke , Tailin Wu , Stan Z. Li

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li

Diffusion transformer-based video generation models (DiTs) have recently attracted widespread attention for their excellent generation quality. However, their computational cost remains a major bottleneck-attention alone accounts for over…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xuan Shen , Chenxia Han , Yufa Zhou , Yanyue Xie , Yifan Gong , Quanyi Wang , Yiwei Wang , Yanzhi Wang , Pu Zhao , Jiuxiang Gu

Few-step video generation has been significantly advanced by consistency distillation. However, the performance of consistency-distilled models often degrades as more sampling steps are allocated at test time, limiting their effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yuchao Gu , Guian Fang , Yuxin Jiang , Weijia Mao , Song Han , Han Cai , Mike Zheng Shou

Generating realistic videos with diffusion transformers demands significant computation, with attention layers the central bottleneck; even producing a short clip requires running a transformer over a very long sequence of embeddings, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Sankeerth Durvasula , Kavya Sreedhar , Zain Moustafa , Suraj Kothawade , Ashish Gondimalla , Suvinay Subramanian , Narges Shahidi , Nandita Vijaykumar

Video diffusion models have made substantial progress in various video generation applications. However, training models for long video generation tasks require significant computational and data resources, posing a challenge to developing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yu Lu , Yuanzhi Liang , Linchao Zhu , Yi Yang

Diffusion models and flow-matching models have enabled generating diverse and realistic images by learning to transfer noise to data. However, sampling from these models involves iterative denoising over many neural network passes, making…

Machine Learning · Computer Science 2025-06-24 Kevin Frans , Danijar Hafner , Sergey Levine , Pieter Abbeel

Flow diffusion models (FDMs) have recently shown potential in generation tasks due to the high generation quality. However, the current ordinary differential equation (ODE) solver for FDMs, e.g., the Euler solver, still suffers from slow…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Kaiyu Song , Hanjiang Lai

Diffusion-based video generation models have demonstrated remarkable success in obtaining high-fidelity videos through the iterative denoising process. However, these models require multiple denoising steps during sampling, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Zhixing Zhang , Yanyu Li , Yushu Wu , Yanwu Xu , Anil Kag , Ivan Skorokhodov , Willi Menapace , Aliaksandr Siarohin , Junli Cao , Dimitris Metaxas , Sergey Tulyakov , Jian Ren

Training diffusion models is always a computation-intensive task. In this paper, we introduce a novel speed-up method for diffusion model training, called, which is based on a closer look at time steps. Our key findings are: i) Time steps…

Machine Learning · Computer Science 2025-03-26 Kai Wang , Mingjia Shi , Yukun Zhou , Zekai Li , Zhihang Yuan , Yuzhang Shang , Xiaojiang Peng , Hanwang Zhang , Yang You

Robust robotic manipulation requires not only predicting how the scene evolves over time, but also recognizing task-relevant objects in complex scenes. However, existing VLA models face two limitations. They typically act only on the…

Robotics · Computer Science 2026-04-21 Kuanning Wang , Ke Fan , Chenhao Qiu , Zeyu Shangguan , Yuqian Fu , Yanwei Fu , Daniel Seita , Xiangyang Xue

The rapid progress in artificial intelligence-generated content (AIGC), especially with diffusion models, has significantly advanced development of high-quality video generation. However, current video diffusion models exhibit demanding…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Zheng Zhan , Yushu Wu , Yifan Gong , Zichong Meng , Zhenglun Kong , Changdi Yang , Geng Yuan , Pu Zhao , Wei Niu , Yanzhi Wang

Video diffusion models (DMs) have enabled high-quality video synthesis. However, their computation costs scale quadratically with sequence length because self-attention has quadratic complexity. While linear attention lowers the cost, fully…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yushi Huang , Xingtong Ge , Ruihao Gong , Chengtao Lv , Jun Zhang

The quadratic time and memory complexity of the attention mechanism in modern Transformer based video generators makes end-to-end training for ultra high resolution videos prohibitively expensive. Motivated by this limitation, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yunfeng Wu , Jiayi Song , Zhenxiong Tan , Zihao He , Songhua Liu

Diffusion models can learn rich representations during data generation, showing potential for Self-Supervised Learning (SSL), but they face a trade-off between generative quality and discriminative performance. Their iterative sampling also…

Machine Learning · Computer Science 2025-12-24 Kosuke Ukita , Tsuyoshi Okita

Diffusion models have demonstrated remarkable capabilities in visual content generation but remain challenging to deploy due to their high computational cost during inference. This computational burden primarily arises from the quadratic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Ye Tian , Xin Xia , Yuxi Ren , Shanchuan Lin , Xing Wang , Xuefeng Xiao , Yunhai Tong , Ling Yang , Bin Cui

We propose a principled and effective framework for one-step generative modeling. We introduce the notion of average velocity to characterize flow fields, in contrast to instantaneous velocity modeled by Flow Matching methods. A…

Machine Learning · Computer Science 2025-05-20 Zhengyang Geng , Mingyang Deng , Xingjian Bai , J. Zico Kolter , Kaiming He