English

Zero-Shot Dynamic Concept Personalization with Grid-Based LoRA

Graphics 2025-07-25 v1 Computer Vision and Pattern Recognition Machine Learning

Abstract

Recent advances in text-to-video generation have enabled high-quality synthesis from text and image prompts. While the personalization of dynamic concepts, which capture subject-specific appearance and motion from a single video, is now feasible, most existing methods require per-instance fine-tuning, limiting scalability. We introduce a fully zero-shot framework for dynamic concept personalization in text-to-video models. Our method leverages structured 2x2 video grids that spatially organize input and output pairs, enabling the training of lightweight Grid-LoRA adapters for editing and composition within these grids. At inference, a dedicated Grid Fill module completes partially observed layouts, producing temporally coherent and identity preserving outputs. Once trained, the entire system operates in a single forward pass, generalizing to previously unseen dynamic concepts without any test-time optimization. Extensive experiments demonstrate high-quality and consistent results across a wide range of subjects beyond trained concepts and editing scenarios.

Cite

@article{arxiv.2507.17963,
  title  = {Zero-Shot Dynamic Concept Personalization with Grid-Based LoRA},
  author = {Rameen Abdal and Or Patashnik and Ekaterina Deyneka and Hao Chen and Aliaksandr Siarohin and Sergey Tulyakov and Daniel Cohen-Or and Kfir Aberman},
  journal= {arXiv preprint arXiv:2507.17963},
  year   = {2025}
}

Comments

Project Page and Video : https://snap-research.github.io/zero-shot-dynamic-concepts/

R2 v1 2026-07-01T04:16:09.821Z