English

SlotMem: Character-Addressable Internal Memory for Narrative Long Video Generation

Computer Vision and Pattern Recognition 2026-07-17 v1

Abstract

Maintaining recurring character identities across scene transitions and long temporal gaps is a central challenge in narrative long video generation. Methods targeting global consistency often retrieve memory using cues that are not aligned with character identity preservation, while recent character-centric variants still rely on coarse frame-level kv memory that entangles identity with incidental visual factors and lacks a continuous update mechanism under limited memory capacity. To address these limitations, we propose \textbf{SlotMem}, a character-addressable internal memory framework for multi-character narrative long video generation. Specifically, SlotMem uses a Character-Semantic Probe to localize character-relevant visual tokens from cross-attention responses, and a Memory Encoder to compress DiT tokens into compact role-wise slot memory. As generation proceeds, a Memory Writer conservatively updates each character's memory with new observations, while Character-Wise Cross-Attention retrieves the role memory and injects it only into localized tokens of the same character. Experiments on multiple narrative long video generation benchmarks show that SlotMem improves long-range character consistency over existing baselines, while maintaining comparable video quality. Our code is available at https://github.com/YilaiLiu-HKU/SlotMem.

Cite

@article{arxiv.2607.15772,
  title  = {SlotMem: Character-Addressable Internal Memory for Narrative Long Video Generation},
  author = {Yilai Liu and Xin Zhang and Shiyuan Zhang and Hongyang Du},
  journal= {arXiv preprint arXiv:2607.15772},
  year   = {2026}
}