English
Related papers

Related papers: Pyramid Forcing: Head-Aware Pyramid KV Cache Polic…

200 papers

Autoregressive video diffusion models support real-time synthesis but suffer from error accumulation and context loss over long horizons. We discover that attention heads in AR video diffusion transformers serve functionally distinct roles…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Jiahao Tian , Yiwei Wang , Gang Yu , Chi Zhang

Recent advances in autoregressive video diffusion have enabled sequential and streaming video generation. However, long-horizon generation requires increasingly large KV caches, making efficient compression without sacrificing quality…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Peiliang Cai , Evelyn Zhang , Jiacheng Liu , Hao Lin , Ruiqi Zhang , Weile Mo , Yue Ma , Shikang Zheng , Jiehang Huang , Dongrui Liu , Linfeng Zhang

Autoregressive (AR) video diffusion models adopt a streaming generation framework, enabling long-horizon video generation with real-time responsiveness, as exemplified by the Self Forcing training paradigm. However, existing AR video…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yicheng Ji , Zhizhou Zhong , Jun Zhang , Qin Yang , XiTai Jin , Ying Qin , Wenhan Luo , Shuiyang Mao , Wei Liu , Huan Li

Autoregressive video diffusion models enable open-ended generation through local attention and KV caching. However, existing training-free long-video optimization methods mainly focus on stable extension under a single prompt, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Mingqiang Wu , Weilun Feng , Zhefeng Zhang , Haotong Qin , Yuqi Li , Guoxin Fan , Xiaokun Liu , Zhulin An , Libo Huang , Yongjun Xu , Chuanguang Yang

Autoregressive (AR) video generation has emerged as a promising paradigm for long-horizon video synthesis, where each frame is generated conditioned on previously generated tokens. To accelerate inference, the KV cache is used to avoid…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Jiayi Luo , Qiyan Liu , Tengyang Wang , JunHao Liu , Jiayu Chen , Cong Wang , Hanxin Zhu , Chen Gao , Xiaobin Hu , Qingyun Sun , Zhibo Chen

The autoregressive video diffusion model has recently gained considerable research interest due to its causal modeling and iterative denoising. In this work, we identify that the multi-head self-attention in these models under-utilizes…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Hang Guo , Zhaoyang Jia , Jiahao Li , Bin Li , Yuanhao Cai , Jiangshan Wang , Yawei Li , Yan Lu

Autoregressive (AR) video diffusion has recently emerged as a promising paradigm for long video generation, enabling causal synthesis beyond the limits of bidirectional models. To address training-inference mismatch, a series of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zengqun Zhao , Yanzuo Lu , Ziquan Liu , Jifei Song , Jiankang Deng , Ioannis Patras

Interactive long video generation requires prompt switching to introduce new subjects or events, while maintaining perceptual fidelity and coherent motion over extended horizons. Recent distilled streaming video diffusion models reuse a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yang Yang , Tianyi Zhang , Wei Huang , Jinwei Chen , Boxi Wu , Xiaofei He , Deng Cai , Bo Li , Peng-Tao Jiang

Self-forcing video generation extends a short-horizon video model to longer rollouts by repeatedly feeding generated content back in as context. This scaling path immediately exposes a systems bottleneck: the key-value (KV) cache grows with…

Machine Learning · Computer Science 2026-03-31 Suraj Ranganath , Vaishak Menon , Anish Patnaik

We introduce Sparse Forcing, a training-and-inference paradigm for autoregressive video diffusion models that improves long-horizon generation quality while reducing decoding latency. Sparse Forcing is motivated by an empirical observation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Boxun Xu , Yuming Du , Zichang Liu , Siyu Yang , Ziyang Jiang , Siqi Yan , Rajasi Saha , Albert Pumarola , Wenchen Wang , Peng Li

Autoregressive video diffusion models have demonstrated remarkable progress, yet they remain bottlenecked by intractable linear KV-cache growth, temporal repetition, and compounding errors during long-video generation. To address these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Xiaofeng Mao , Shaohao Rui , Kaining Ying , Bo Zheng , Chuanhao Li , Mingmin Chi , Kaipeng Zhang

We introduce Self Forcing, a novel training paradigm for autoregressive video diffusion models. It addresses the longstanding issue of exposure bias, where models trained on ground-truth context must generate sequences conditioned on their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xun Huang , Zhengqi Li , Guande He , Mingyuan Zhou , Eli Shechtman

Recent advances in autoregressive video diffusion have enabled real-time frame streaming, yet existing solutions still suffer from temporal repetition, drift, and motion deceleration. We find that naively applying StreamingLLM-style…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Jung Yi , Wooseok Jang , Paul Hyunbin Cho , Jisu Nam , Heeji Yoon , Seungryong Kim

Autoregressive video synthesis offers a promising pathway for infinite-horizon generation but is fundamentally hindered by three intertwined challenges: semantic forgetting from context limitations, visual drift due to positional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jintao Chen , Chengyu Bai , Junjun Hu , Xinda Xue , Mu Xu

The linear memory growth of the KV cache poses a significant bottleneck for LLM inference in long-context tasks. Existing static compression methods often fail to preserve globally important information. Although recent dynamic retrieval…

Computation and Language · Computer Science 2026-04-21 Zhiyuan Shi , Qibo Qiu , Feng Xue , Zhonglin Jiang , Li Yu , Jian Jiang , Xiaofei He , Wenxiao Wang

Autoregressive (AR) visual generation has achieved remarkable performance but suffers from high memory usage and low throughput, as it requires caching previously generated visual tokens. Recent research has shown that retaining only a few…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Guotao Liang , Baoquan Zhang , Zhiyuan Wen , Yunming Ye

A unified autoregressive model is a Transformer-based framework that addresses diverse multimodal tasks (e.g., text, image, video) as a single sequence modeling problem under a shared token space. Such models rely on the KV-cache mechanism…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Kunyang Li , Mubarak Shah , Yuzhang Shang

Video generation is pivotal to digital media creation, and recent advances in autoregressive video generation have markedly enhanced the efficiency of real-time video synthesis. However, existing approaches generally rely on heuristic KV…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Hanmo Chen , Chenghao Xu , Xu Yang , Xuan Chen , Cheng Deng

Diffusion models have revolutionized image and video generation, achieving unprecedented visual quality. However, their reliance on transformer architectures incurs prohibitively high computational costs, particularly when extending…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Justin Cui , Jie Wu , Ming Li , Tao Yang , Xiaojie Li , Rui Wang , Andrew Bai , Yuanhao Ban , Cho-Jui Hsieh

Despite rapid progress in autoregressive video diffusion, an emerging system algorithm bottleneck limits both deployability and generation capability: KV cache memory. In autoregressive video generation models, the KV cache grows with…

‹ Prev 1 2 3 10 Next ›