English
Related papers

Related papers: Head Forcing: Long Autoregressive Video Generation…

200 papers

Autoregressive video synthesis offers a promising pathway for infinite-horizon generation but is fundamentally hindered by three intertwined challenges: semantic forgetting from context limitations, visual drift due to positional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jintao Chen , Chengyu Bai , Junjun Hu , Xinda Xue , Mu Xu

Visual Autoregressive (VAR) models adopt a next-scale prediction paradigm, offering high-quality content generation with substantially fewer decoding steps. However, existing VAR models suffer from significant attention complexity and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Ziran Qin , Youru Lv , Mingbao Lin , Hang Guo , Zeren Zhang , Danping Zou , Weiyao Lin

The task of video generation requires synthesizing visually realistic and temporally coherent video frames. Existing methods primarily use asynchronous auto-regressive models or synchronous diffusion models to address this challenge.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mingzhen Sun , Weining Wang , Gen Li , Jiawei Liu , Jiahui Sun , Wanquan Feng , Shanshan Lao , SiYu Zhou , Qian He , Jing Liu

Current frontier video diffusion models have demonstrated remarkable results at generating high-quality videos. However, they can only generate short video clips, normally around 10 seconds or 240 frames, due to computation limitations…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Desai Xie , Zhan Xu , Yicong Hong , Hao Tan , Difan Liu , Feng Liu , Arie Kaufman , Yang Zhou

Streaming video generation (SVG) distills a pretrained bidirectional video diffusion model into an autoregressive model equipped with sliding window attention (SWA). However, SWA inevitably loses distant history during long video…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ruibin Li , Tao Yang , Fangzhou Ai , Tianhe Wu , Shilei Wen , Bingyue Peng , Lei Zhang

Autoregressive conditional image generation models have emerged as a dominant paradigm in text-to-image synthesis. These methods typically convert images into one-dimensional token sequences and leverage the self-attention mechanism, which…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xunzhi Xiang , Qi Fan

Long-form video generation presents a dual challenge: models must capture long-range dependencies while preventing the error accumulation inherent in autoregressive decoding. To address these challenges, we make two contributions. First,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Xiaofei Wu , Guozhen Zhang , Zhiyong Xu , Yuan Zhou , Qinglin Lu , Xuming He

Autoregressive diffusion enables real-time frame streaming, yet existing sliding-window caches discard past context, causing fidelity degradation, identity drift, and motion stagnation over long horizons. Current approaches preserve a fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Youngrae Kim , Qixin Hu , C. -C. Jay Kuo , Peter A. Beerel

Autoregressive video diffusion models generate streaming video by producing frames sequentially, conditioning each chunk on previously generated content. These models are structurally anchored to the first frame: its key-value…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yusuf Dalva , Pinar Yanardag

Autoregressive (AR) diffusion enables streaming, interactive long-video generation by producing frames causally, yet maintaining coherence over minute-scale horizons remains challenging due to accumulated errors, motion drift, and content…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Yifei Yu , Xiaoshan Wu , Xinting Hu , Tao Hu , Yangtian Sun , Xiaoyang Lyu , Bo Wang , Lin Ma , Yuewen Ma , Zhongrui Wang , Xiaojuan Qi

A unified autoregressive model is a Transformer-based framework that addresses diverse multimodal tasks (e.g., text, image, video) as a single sequence modeling problem under a shared token space. Such models rely on the KV-cache mechanism…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Kunyang Li , Mubarak Shah , Yuzhang Shang

Diffusion models have revolutionized image and video generation, achieving unprecedented visual quality. However, their reliance on transformer architectures incurs prohibitively high computational costs, particularly when extending…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Justin Cui , Jie Wu , Ming Li , Tao Yang , Xiaojie Li , Rui Wang , Andrew Bai , Yuanhao Ban , Cho-Jui Hsieh

Diffusion-based video generation has advanced substantially in visual fidelity and temporal coherence, but practical deployment remains limited by the quadratic complexity of full attention. Training-free sparse attention is attractive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Xuzhe Zheng , Yuexiao Ma , Jing Xu , Xiawu Zheng , Rongrong Ji , Fei Chao

Streaming video generation, as one fundamental component in interactive world models and neural game engines, aims to generate high-quality, low-latency, and temporally coherent long video streams. However, most existing work suffers from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kunhao Liu , Wenbo Hu , Jiale Xu , Ying Shan , Shijian Lu

Autoregressive (AR) diffusion models offer a promising framework for sequential generation tasks such as video synthesis by combining diffusion modeling with causal inference. Although they support streaming generation, existing AR…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Dingcheng Zhen , Xu Zheng , Ruixin Zhang , Zhiqi Jiang , Yichao Yan , Ming Tao , Shunshun Yin

Long-rollout causal video diffusion has converged on a fixed-size sliding-window KV cache, with recent progress innovating within this layout by changing which tokens occupy the window or how their positions are encoded. The per-head KV…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Hidir Yesiltepe , Jiazhen Hu , Tuna Han Salih Meral , Adil Kaan Akan , Kaan Oktay , Hoda Eldardiry , Pinar Yanardag

Despite rapid progress in autoregressive video diffusion, an emerging system algorithm bottleneck limits both deployability and generation capability: KV cache memory. In autoregressive video generation models, the KV cache grows with…

Self-forcing video generation extends a short-horizon video model to longer rollouts by repeatedly feeding generated content back in as context. This scaling path immediately exposes a systems bottleneck: the key-value (KV) cache grows with…

Machine Learning · Computer Science 2026-03-31 Suraj Ranganath , Vaishak Menon , Anish Patnaik

Generating long-form content, such as minute-long videos and extended texts, is increasingly important for modern generative models. Block diffusion improves inference efficiency via KV caching and block-wise causal inference and has been…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Zhuokun Chen , Jianfei Cai , Bohan Zhuang

Diffusion Transformers (DiTs) dominate video generation but their high computational cost severely limits real-world applicability, usually requiring tens of minutes to generate a few seconds of video even on high-performance GPUs. This…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Haocheng Xi , Shuo Yang , Yilong Zhao , Chenfeng Xu , Muyang Li , Xiuyu Li , Yujun Lin , Han Cai , Jintao Zhang , Dacheng Li , Jianfei Chen , Ion Stoica , Kurt Keutzer , Song Han