English
Related papers

Related papers: SnapGen-V: Generating a Five-Second Video within F…

200 papers

Diffusion Transformers (DiTs) dominate video generation but their high computational cost severely limits real-world applicability, usually requiring tens of minutes to generate a few seconds of video even on high-performance GPUs. This…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Haocheng Xi , Shuo Yang , Yilong Zhao , Chenfeng Xu , Muyang Li , Xiuyu Li , Yujun Lin , Han Cai , Jintao Zhang , Dacheng Li , Jianfei Chen , Ion Stoica , Kurt Keutzer , Song Han

We tackle the long video generation problem, i.e.~generating videos beyond the output length of video generation models. Due to the computation resource constraints, video generation models can only generate video clips that are relatively…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Hsin-Ping Huang , Yu-Chuan Su , Ming-Hsuan Yang

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li

AI-generated content has attracted lots of attention recently, but photo-realistic video synthesis is still challenging. Although many attempts using GANs and autoregressive models have been made in this area, the visual quality and length…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yingqing He , Tianyu Yang , Yong Zhang , Ying Shan , Qifeng Chen

We present On-device Sora, the first model training-free solution for diffusion-based on-device text-to-video generation that operates efficiently on smartphone-grade devices. To address the challenges of diffusion-based text-to-video…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Bosung Kim , Kyuhwan Lee , Isu Jeong , Jungmin Cheon , Yeojin Lee , Seulki Lee

We present On-device Sora, the first model training-free solution for diffusion-based on-device text-to-video generation that operates efficiently on smartphone-grade devices. To address the challenges of diffusion-based text-to-video…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Bosung Kim , Kyuhwan Lee , Isu Jeong , Jungmin Cheon , Yeojin Lee , Seulki Lee

While AI-generated content has garnered significant attention, achieving photo-realistic video synthesis remains a formidable challenge. Despite the promising advances in diffusion models for video generation quality, the complex model…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zhengang Li , Yan Kang , Yuchen Liu , Difan Liu , Tobias Hinz , Feng Liu , Yanzhi Wang

Video diffusion models have rapidly become the dominant paradigm for high-fidelity generative video synthesis, but their practical deployment remains constrained by severe inference costs. Compared with image generation, video synthesis…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Shitong Shao , Lichen Bai , Pengfei Wan , James Kwok , Zeke Xie

Despite diffusion models having shown powerful abilities to generate photorealistic images, generating videos that are realistic and diverse still remains in its infancy. One of the key reasons is that current methods intertwine spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Zhiwu Qing , Shiwei Zhang , Jiayu Wang , Xiang Wang , Yujie Wei , Yingya Zhang , Changxin Gao , Nong Sang

The rapid development and application of foundation models have revolutionized the field of artificial intelligence. Large diffusion models have gained significant attention for their ability to generate photorealistic images and support…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Yu-Hui Chen , Raman Sarokin , Juhyun Lee , Jiuqiang Tang , Chuo-Ling Chang , Andrei Kulik , Matthias Grundmann

Recovering 3D scenes from sparse views is a challenging task due to its inherent ill-posed problem. Conventional methods have developed specialized solutions (e.g., geometry regularization or feed-forward deterministic model) to mitigate…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Hanyang Wang , Fangfu Liu , Jiawei Chi , Yueqi Duan

Recently, video generation has witnessed rapid advancements, drawing increasing attention to image-to-video (I2V) synthesis on mobile devices. However, the substantial computational complexity and slow generation speed of diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Shuai Zhang , Bao Tang , Siyuan Yu , Yueting Zhu , Jingfeng Yao , Ya Zou , Shanglin Yuan , Li Yu , Wenyu Liu , Xinggang Wang

The recent wave of AI-generated content (AIGC) has witnessed substantial success in computer vision, with the diffusion model playing a crucial role in this achievement. Due to their impressive generative capabilities, diffusion models are…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zhen Xing , Qijun Feng , Haoran Chen , Qi Dai , Han Hu , Hang Xu , Zuxuan Wu , Yu-Gang Jiang

Latent diffusion models have emerged as a leading paradigm for efficient video generation. However, as user expectations shift toward higher-resolution outputs, relying solely on latent computation becomes inadequate. A promising approach…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Liangbin Xie , Yu Li , Shian Du , Menghan Xia , Xintao Wang , Fanghua Yu , Ziyan Chen , Pengfei Wan , Jiantao Zhou , Chao Dong

Recent advances in diffusion models have revolutionized video generation, offering superior temporal consistency and visual quality compared to traditional generative adversarial networks-based approaches. While this emerging field shows…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yimu Wang , Xuye Liu , Wei Pang , Li Ma , Shuai Yuan , Paul Debevec , Ning Yu

Video generation is a critical pathway toward world models, with efficient long video inference as a key capability. Toward this end, we introduce LongCat-Video, a foundational video generation model with 13.6B parameters, delivering strong…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Meituan LongCat Team , Xunliang Cai , Qilong Huang , Zhuoliang Kang , Hongyu Li , Shijun Liang , Liya Ma , Siyu Ren , Xiaoming Wei , Rixu Xie , Tong Zhang

Diffusion models are rising as a powerful solution for high-fidelity image generation, which exceeds GANs in quality in many circumstances. However, their slow training and inference speed is a huge bottleneck, blocking them from being used…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Hao Phung , Quan Dao , Anh Tran

Current video diffusion models achieve impressive generation quality but struggle in interactive applications due to bidirectional attention dependencies. The generation of a single frame requires the model to process the entire sequence,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Tianwei Yin , Qiang Zhang , Richard Zhang , William T. Freeman , Fredo Durand , Eli Shechtman , Xun Huang

Generating long and consistent videos has emerged as a significant yet challenging problem. While most existing diffusion-based video generation models, derived from image generation models, demonstrate promising performance in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yichen Ouyang , jianhao Yuan , Hao Zhao , Gaoang Wang , Bo zhao

Recent advances in video generation demand increasingly efficient training recipes to mitigate escalating computational costs. In this report, we present ContentV, an 8B-parameter text-to-video model that achieves state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Wenfeng Lin , Renjie Chen , Boyuan Liu , Shiyue Yan , Ruoyu Feng , Jiangchuan Wei , Yichen Zhang , Yimeng Zhou , Chao Feng , Jiao Ran , Qi Wu , Zuotao Liu , Mingyu Guo