English

SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agents

Computer Vision and Pattern Recognition 2026-05-22 v3

Abstract

Long-horizon action-conditioned video generation aims to synthesize temporally coherent videos that follow complex action instructions over extended horizons, requiring procedural ordering, persistent action execution, and scene consistency beyond conventional TI2V's short-term fidelity. Existing single-shot video generation models typically operate in an open-loop manner, leading to incomplete action execution, hallucinated motions, and temporal drift. To address this, we propose SPIRAL, a closed-loop framework that performs sequential planning and iterative reflection for action-conditioned long-horizon video generation. Specifically, SPIRAL instantiates a think-act-reflect process: a PlanAgent decomposes high-level goals into sub-actions, which condition a VideoGenerator to synthesize each segment alongside a memory context, while a CriticAgent evaluates intermediate video segments to provide corrective feedback for iterative refinement. This closed-loop design further supports self-evolution by utilizing PlanAgent-proposed actions and CriticAgent-derived rewards for GRPO-based post-training to enhance the video generator's long-horizon consistency. Moreover, we introduce ActVideoGen-Dataset for task-specific training, and establish ActVideoGen-Bench as a dedicated evaluation suite for measuring action quality and temporal coherence. Experiments across multiple TI2V backbones alongside the self-evolving strategy show consistent gains on ActVideoGen-Bench and VBench, demonstrating the effectiveness of SPIRAL.

Keywords

Cite

@article{arxiv.2603.08403,
  title  = {SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agents},
  author = {Yu Yang and Yue Liao and Jianbiao Mei and Baisen Wang and Xuemeng Yang and Licheng Wen and Jiangning Zhang and Xiangtai Li and Liang Lv and Hanlin Chen and Botian Shi and Yong Liu and Shuicheng Yan and Gim Hee Lee},
  journal= {arXiv preprint arXiv:2603.08403},
  year   = {2026}
}

Comments

42 Pages, 21 Figures, Project page at https://yuyang-cloud.github.io/spiral

R2 v1 2026-07-01T11:10:22.694Z