中文
相关论文

相关论文: One-Forcing: Towards Stable One-Step Autoregressiv…

200 篇论文

We introduce a one-step generative policy for offline reinforcement learning that maps noise directly to actions via a residual reformulation of MeanFlow, making it compatible with Q-learning. While one-step Gaussian policies enable fast…

机器学习 · 计算机科学 2025-11-18 Zeyuan Wang , Da Li , Yulin Chen , Ye Shi , Liang Bai , Tianyuan Yu , Yanwei Fu

Distribution Matching Distillation (DMD) is a promising score distillation technique that compresses pre-trained teacher diffusion models into efficient one-step or multi-step student generators. Nevertheless, its reliance on the reverse…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Yanzuo Lu , Yuxi Ren , Xin Xia , Shanchuan Lin , Xing Wang , Xuefeng Xiao , Andy J. Ma , Xiaohua Xie , Jian-Huang Lai

Interactive real-time autoregressive video generation is essential for applications such as content creation and world modeling, where visual content must adapt to dynamically evolving event conditions. A fundamental challenge lies in…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Yuheng Wu , Xiangbo Gao , Tianhao Chen , Xinghao Chen , Qing Yin , Zhengzhong Tu , Dongman Lee

Recently, latent diffusion models has demonstrated promising performance in real-world video super-resolution (VSR) task, which can reconstruct high-quality videos from distorted low-resolution input through multiple diffusion steps.…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Hanting Li , Huaao Tang , Jianhong Han , Tianxiong Zhou , Jiulong Cui , Haizhen Xie , Yan Chen , Jie Hu

While diffusion models can learn complex distributions, sampling requires a computationally expensive iterative process. Existing distillation methods enable efficient sampling, but have notable limitations, such as performance degradation…

One-step generative modeling seeks to generate high-quality data samples in a single function evaluation, significantly improving efficiency over traditional diffusion or flow-based models. In this work, we introduce Modular MeanFlow (MMF),…

机器学习 · 计算机科学 2025-08-26 Haochen You , Baojing Liu , Hongyang He

Modern video generative models based on diffusion models can produce very realistic clips, but they are computationally inefficient, often requiring minutes of GPU time for just a few seconds of video. This inefficiency poses a critical…

计算机视觉与模式识别 · 计算机科学 2026-01-15 Jieying Chen , Jeffrey Hu , Joan Lasenby , Ayush Tewari

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

机器学习 · 计算机科学 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

Recently, open-source video diffusion models (VDMs), such as WanX, Magic141 and HunyuanVideo, have been scaled to over 10 billion parameters. These large-scale VDMs have demonstrated significant improvements over smaller-scale VDMs across…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Shitong Shao , Hongwei Yi , Hanzhong Guo , Tian Ye , Daquan Zhou , Michael Lingelbach , Zhiqiang Xu , Zeke Xie

Few-step video generation has been significantly advanced by consistency distillation. However, the performance of consistency-distilled models often degrades as more sampling steps are allocated at test time, limiting their effectiveness…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Yuchao Gu , Guian Fang , Yuxin Jiang , Weijia Mao , Song Han , Han Cai , Mike Zheng Shou

Diffusion models are relatively easy to train but require many steps to generate samples. Consistency models are far more difficult to train, but generate samples in a single step. In this paper we propose Multistep Consistency Models: A…

机器学习 · 计算机科学 2024-11-20 Jonathan Heek , Emiel Hoogeboom , Tim Salimans

Autoregressive models, often built on Transformer architectures, represent a powerful paradigm for generating ultra-long videos by synthesizing content in sequential chunks. However, this sequential generation process is notoriously slow.…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Yuexiao Ma , Xuzhe Zheng , Jing Xu , Xiwei Xu , Feng Ling , Xiawu Zheng , Huafeng Kuang , Huixia Li , Xing Wang , Xuefeng Xiao , Fei Chao , Rongrong Ji

Diffusion models have achieved significant progress in both image and video generation while still suffering from huge computation costs. As an effective solution, flow matching aims to reflow the diffusion process of diffusion models into…

图形学 · 计算机科学 2025-03-13 Lei Ke , Haohang Xu , Xuefei Ning , Yu Li , Jiajun Li , Haoling Li , Yuxuan Lin , Dongsheng Jiang , Yujiu Yang , Linfeng Zhang

Autoregressive video diffusion models generate streaming video by producing frames sequentially, conditioning each chunk on previously generated content. These models are structurally anchored to the first frame: its key-value…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Yusuf Dalva , Pinar Yanardag

Sampling from diffusion models involves a slow iterative process that hinders their practical deployment, especially for interactive applications. To accelerate generation speed, recent approaches distill a multi-step diffusion model into a…

机器学习 · 计算机科学 2025-03-11 Yilun Xu , Weili Nie , Arash Vahdat

Diffusion and flow models achieve high generative quality but remain computationally expensive due to slow multi-step sampling. Distillation methods accelerate them by training fast student generators, yet most existing objectives lack a…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Yuanzhi Zhu , Eleftherios Tsonis , Lucas Degeorge , Vicky Kalogeiton

Masked Generative Models (MGM)s demonstrate strong capabilities in generating high-fidelity images. However, they need many sampling steps to create high-quality generations, resulting in slow inference speed. In this work, we propose…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Pranav Subbaraman , Shufan Li , Siyan Zhao , Aditya Grover

Recent advances in Video Foundation Models (VFMs) have revolutionized human-centric video synthesis, yet fine-grained and independent editing of subjects and scenes remains a critical challenge. Recent attempts to incorporate richer…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Fengyuan Yang , Luying Huang , Jiazhi Guan , Quanwei Yang , Dongwei Pan , Jianglin Fu , Haocheng Feng , Wei He , Kaisiyuan Wang , Hang Zhou , Angela Yao

We tackle the long video generation problem, i.e.~generating videos beyond the output length of video generation models. Due to the computation resource constraints, video generation models can only generate video clips that are relatively…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Hsin-Ping Huang , Yu-Chuan Su , Ming-Hsuan Yang

Autoregressive video generators are attractive for streaming, long-horizon, and interactive applications, but distilling strong black-box teachers into causal students remains difficult. The student must learn under its own rollout…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Yang Luo , Shengju Qian , Xiaohang Tang , Zirui Zhu , Yong Liu , Xin Wang , Yang You