English
Related papers

Related papers: Motion-Aware Caching for Efficient Autoregressive …

200 papers

Large pretrained diffusion models have significantly enhanced the quality of generated videos, and yet their use in real-time streaming remains limited. Autoregressive models offer a natural framework for sequential frame synthesis but…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jinxiu Liu , Xuanming Liu , Kangfu Mei , Yandong Wen , Ming-Hsuan Yang , Weiyang Liu

Generating diverse and natural human motion is one of the long-standing goals for creating intelligent characters in the animated world. In this paper, we propose a self-supervised method for generating long-range, diverse and plausible…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jingwei Xu , Huazhe Xu , Bingbing Ni , Xiaokang Yang , Xiaolong Wang , Trevor Darrell

The autoregressive video diffusion model has recently gained considerable research interest due to its causal modeling and iterative denoising. In this work, we identify that the multi-head self-attention in these models under-utilizes…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Hang Guo , Zhaoyang Jia , Jiahao Li , Bin Li , Yuanhao Cai , Jiangshan Wang , Yawei Li , Yan Lu

Autoregressive video diffusion models support real-time synthesis but suffer from error accumulation and context loss over long horizons. We discover that attention heads in AR video diffusion transformers serve functionally distinct roles…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Jiahao Tian , Yiwei Wang , Gang Yu , Chi Zhang

Autoregressive video diffusion models enable open-ended generation through local attention and KV caching. However, existing training-free long-video optimization methods mainly focus on stable extension under a single prompt, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Mingqiang Wu , Weilun Feng , Zhefeng Zhang , Haotong Qin , Yuqi Li , Guoxin Fan , Xiaokun Liu , Zhulin An , Libo Huang , Yongjun Xu , Chuanguang Yang

Current motion-conditioned video generation methods suffer from prohibitive latency (minutes per video) and non-causal processing that prevents real-time interaction. We present MotionStream, enabling sub-second latency with up to 29 FPS…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Joonghyuk Shin , Zhengqi Li , Richard Zhang , Jun-Yan Zhu , Jaesik Park , Eli Shechtman , Xun Huang

Auto-regressive (AR) models, initially successful in language generation, have recently shown promise in visual generation tasks due to their superior sampling efficiency. Unlike image generation, video generation requires a substantially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xuan Shen , Weize Ma , Yufa Zhou , Enhao Tang , Yanyue Xie , Zhengang Li , Yifan Gong , Quanyi Wang , Henghui Ding , Yiwei Wang , Yanzhi Wang , Pu Zhao , Jun Lin , Jiuxiang Gu

We propose PostCam, a framework for novel-view video generation that enables post-capture editing of camera trajectories in dynamic scenes. We find that existing video recapture methods suffer from suboptimal camera motion injection…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Yipeng Chen , Zhichao Ye , Zhenzhou Fang , Xinyu Chen , Xiaoyu Zhang , Jialing Liu , Nan Wang , Haomin Liu , Guofeng Zhang

Recent advances in diffusion models bring new vitality to visual content creation. However, current text-to-video generation models still face significant challenges such as high training costs, substantial data requirements, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Sicong Feng , Jielong Yang , Li Peng

Animating images with interactive motion control has garnered popularity for image-to-video (I2V) generation. Modern approaches typically rely on large Gaussian kernels to extend motion trajectories as condition without explicitly defining…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zhongwei Zhang , Fuchen Long , Zhaofan Qiu , Yingwei Pan , Wu Liu , Ting Yao , Tao Mei

Autoregressive video diffusion models enable streaming generation, opening the door to long-form synthesis, video world models, and interactive neural game engines. However, their core attention layers become a major bottleneck at inference…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Dvir Samuel , Issar Tzachor , Matan Levy , Micahel Green , Gal Chechik , Rami Ben-Ari

Diffusion models have emerged as a powerful paradigm for generative tasks such as image synthesis and video generation, with Transformer architectures further enhancing performance. However, the high computational cost of diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Huanpeng Chu , Wei Wu , Guanyu Fen , Yutao Zhang

Autoregressive (AR) visual generation has achieved remarkable performance but suffers from high memory usage and low throughput, as it requires caching previously generated visual tokens. Recent research has shown that retaining only a few…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Guotao Liang , Baoquan Zhang , Zhiyuan Wen , Yunming Ye

Autoregressive (AR) video diffusion models enable long-form video generation but remain expensive due to repeated multi-step denoising. Existing training-free acceleration methods rely on binary cache-or-recompute decisions, overlooking…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Hanshuai Cui , Zhiqing Tang , Zhi Yao , Fanshuai Meng , Weijia Jia , Wei Zhao

Controllable generative models have been widely used to improve the realism of synthetic visual content. However, such models must handle control conditions and content generation computational requirements, resulting in generally low…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Lin Liu , Huixia Ben , Shuo Wang , Jinda Lu , Junxiang Qiu , Shengeng Tang , Yanbin Hao

Recent advancements in personalized Text-to-Video (T2V) generation have made significant strides in synthesizing character-specific content. However, these methods face a critical limitation: the inability to perform fine-grained control…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Haopeng Fang , Di Qiu , Binjie Mao , He Tang

Human motion generation is essential for fields such as animation, robotics, and virtual reality, requiring models that effectively capture motion dynamics from text descriptions. Existing approaches often rely on Contrastive Language-Image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Gabriel Maldonado , Armin Danesh Pazho , Ghazal Alinezhad Noghre , Vinit Katariya , Hamed Tabkhi

Diffusion models are a strong backbone for visual generation, but their inherently sequential denoising process leads to slow inference. Previous methods accelerate sampling by caching and reusing intermediate outputs based on feature…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jiwoo Chung , Sangeek Hyun , MinKyu Lee , Byeongju Han , Geonho Cha , Dongyoon Wee , Youngjun Hong , Jae-Pil Heo

This paper addresses the challenge of text-conditioned streaming motion generation, which requires us to predict the next-step human pose based on variable-length historical motions and incoming texts. Existing methods struggle to achieve…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Lixing Xiao , Shunlin Lu , Huaijin Pi , Ke Fan , Liang Pan , Yueer Zhou , Ziyong Feng , Xiaowei Zhou , Sida Peng , Jingbo Wang

Autoregressive video diffusion models generate streaming video by producing frames sequentially, conditioning each chunk on previously generated content. These models are structurally anchored to the first frame: its key-value…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yusuf Dalva , Pinar Yanardag