English

Allegro: Open the Black Box of Commercial-Level Video Generation Model

Computer Vision and Pattern Recognition 2024-10-22 v1

Abstract

Significant advancements have been made in the field of video generation, with the open-source community contributing a wealth of research papers and tools for training high-quality models. However, despite these efforts, the available information and resources remain insufficient for achieving commercial-level performance. In this report, we open the black box and introduce Allegro\textbf{Allegro}, an advanced video generation model that excels in both quality and temporal consistency. We also highlight the current limitations in the field and present a comprehensive methodology for training high-performance, commercial-level video generation models, addressing key aspects such as data, model architecture, training pipeline, and evaluation. Our user study shows that Allegro surpasses existing open-source models and most commercial models, ranking just behind Hailuo and Kling. Code: https://github.com/rhymes-ai/Allegro , Model: https://huggingface.co/rhymes-ai/Allegro , Gallery: https://rhymes.ai/allegro_gallery .

Keywords

Cite

@article{arxiv.2410.15458,
  title  = {Allegro: Open the Black Box of Commercial-Level Video Generation Model},
  author = {Yuan Zhou and Qiuyue Wang and Yuxuan Cai and Huan Yang},
  journal= {arXiv preprint arXiv:2410.15458},
  year   = {2024}
}