English

DySink: Dynamic Frame Sinks for Autoregressive Long Video Generation

Computer Vision and Pattern Recognition 2026-05-21 v1 Artificial Intelligence

Abstract

Autoregressive long video generation often adopts bounded-memory streaming for efficiency, typically combining local windows for short-term continuity with static early-frame sinks as long-range anchors. However, this fixed allocation keeps early frames cached even when the current visual state has substantially diverged from them, while discarding potentially more relevant intermediate history. As a result, the retained long-range context may become less adaptive and bias generation toward outdated cues; in severe cases, RoPE-induced phase re-alignment can homogenize inter-head attention and cause sink collapse, where content regresses toward sink frames. We propose DySink, a retrieval-based framework that maintains a compact memory bank and selects visually relevant historical frames as dynamic frame sinks. DySink couples adaptive retrieval with a sink anomaly gate, which detects excessive inter-head consensus over retrieved context and suppresses collapse-prone context. Experiments on minute-long videos show that DySink consistently improves dynamic degree over strong baselines while also achieving higher temporal quality. The code and model weights will be released at https://github.com/yebo0216best/DySink.

Keywords

Cite

@article{arxiv.2605.21028,
  title  = {DySink: Dynamic Frame Sinks for Autoregressive Long Video Generation},
  author = {Bo Ye and Xinyu Cui and Jian Zhao and Tong Wei and Min-Ling Zhang},
  journal= {arXiv preprint arXiv:2605.21028},
  year   = {2026}
}
R2 v1 2026-07-22T07:23:44.904Z