English
Related papers

Related papers: A Survey on Video Diffusion Models

200 papers

The rapid progress in generative models has given rise to the critical task of AI-Generated Content Stealth (AIGC-S), which aims to create AI-generated images that can evade both forensic detectors and human inspection. This task is crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Ziyin Zhou , Ke Sun , Zhongxi Chen , Huafeng Kuang , Xiaoshuai Sun , Rongrong Ji

Recently, diffusion models like StableDiffusion have achieved impressive image generation results. However, the generation process of such diffusion models is uncontrollable, which makes it hard to generate videos with continuous and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Zhihao Hu , Dong Xu

Diffusion models (DMs) have emerged as a powerful class of generative AI models, showing remarkable potential in anomaly detection (AD) tasks across various domains, such as cybersecurity, fraud detection, healthcare, and manufacturing. The…

Machine Learning · Computer Science 2025-02-28 Jing Liu , Zhenchao Ma , Zepu Wang , Chenxuanyin Zou , Jiayang Ren , Zehua Wang , Liang Song , Bo Hu , Yang Liu , Victor C. M. Leung

In this study, we explore Transformer-based diffusion models for image and video generation. Despite the dominance of Transformer architectures in various fields due to their flexibility and scalability, the visual generative domain…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Shoufa Chen , Mengmeng Xu , Jiawei Ren , Yuren Cong , Sen He , Yanping Xie , Animesh Sinha , Ping Luo , Tao Xiang , Juan-Manuel Perez-Rua

With advancements in video generative AI models (e.g., SORA), creators are increasingly using these techniques to enhance video previsualization. However, they face challenges with incomplete and mismatched AI workflows. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Yiran Chen , Anyi Rao , Xuekun Jiang , Shishi Xiao , Ruiqing Ma , Zeyu Wang , Hui Xiong , Bo Dai

This paper investigates the performance of diffusion models for video anomaly detection (VAD) within the most challenging but also the most operational scenario in which the data annotations are not used. As being sparse, diverse,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Anil Osman Tur , Nicola Dall'Asen , Cigdem Beyan , Elisa Ricci

The growing capabilities of AI in generating video content have brought forward significant challenges in effectively evaluating these videos. Unlike static images or text, video content involves complex spatial and temporal dynamics which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Xiao Liu , Xinhao Xiang , Zizhong Li , Yongheng Wang , Zhuoheng Li , Zhuosheng Liu , Weidi Zhang , Weiqi Ye , Jiawei Zhang

As a prominent subfield of Artificial Intelligence Generated Content (AIGC), video generation has achieved notable advancements in recent years. The introduction of Sora-alike models represents a pivotal breakthrough in video generation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Linyuan Li , Jianing Qiu , Anujit Saha , Lin Li , Poyuan Li , Mengxian He , Ziyu Guo , Wu Yuan

The rapid advancement in image generation models has predominantly been driven by diffusion models, which have demonstrated unparalleled success in generating high-fidelity, diverse images from textual prompts. Despite their success,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yusuf Dalva , Hidir Yesiltepe , Pinar Yanardag

Diffusion models have recently become the de-facto approach for generative modeling in the 2D domain. However, extending diffusion models to 3D is challenging due to the difficulties in acquiring 3D ground truth data for training. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jiatao Gu , Qingzhe Gao , Shuangfei Zhai , Baoquan Chen , Lingjie Liu , Josh Susskind

Modern text-to-video (T2V) diffusion models can synthesize visually compelling clips, yet they remain brittle at fine-scale structure: even state-of-the-art generators often produce distorted faces and hands, warped backgrounds, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Tejas Panambur , Ishan Rajendrakumar Dave , Chongjian Ge , Ersin Yumer , Xue Bai

Diffusion models have been central to the development of recent image, video, and even text generation systems. They posses striking geometric properties that can be faithfully portrayed in low-dimensional settings. However, existing…

Machine Learning · Computer Science 2025-07-08 Alec Helbling , Duen Horng Chau

Anomaly detection (AD) plays a pivotal role across diverse domains, including cybersecurity, finance, healthcare, and industrial manufacturing, by identifying unexpected patterns that deviate from established norms in real-world data.…

Machine Learning · Computer Science 2025-06-12 Yang Liu , Jing Liu , Chengfang Li , Rui Xi , Wenchao Li , Liang Cao , Jin Wang , Laurence T. Yang , Junsong Yuan , Wei Zhou

Customized generation using diffusion models has made impressive progress in image generation, but remains unsatisfactory in the challenging video generation task, as it requires the controllability of both subjects and motions. To that…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yujie Wei , Shiwei Zhang , Zhiwu Qing , Hangjie Yuan , Zhiheng Liu , Yu Liu , Yingya Zhang , Jingren Zhou , Hongming Shan

Diffusion models have achieved remarkable progress in the field of video generation. However, their iterative denoising nature requires a large number of inference steps to generate a video, which is slow and computationally expensive. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Xihui Liu , Yunhong Wang , Yu Qiao

In recent years, there has been a significant surge of interest in unifying image comprehension and generation within Large Language Models (LLMs). This growing interest has prompted us to explore extending this unification to videos. The…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yuying Ge , Yizhuo Li , Yixiao Ge , Ying Shan

The remarkable generative capabilities of diffusion models have motivated extensive research in both image and video editing. Compared to video editing which faces additional challenges in the time dimension, image editing has witnessed the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Wenqi Ouyang , Yi Dong , Lei Yang , Jianlou Si , Xingang Pan

Diffusion Generative Models (DGM) have rapidly surfaced as emerging topics in the field of computer vision, garnering significant interest across a wide array of deep learning applications. Despite their high computational demand, these…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Denisha Thakkar , Vincent Quoc-Huy Trinh , Sonal Varma , Samira Ebrahimi Kahou , Hassan Rivaz , Mahdi S. Hosseini

Diffusion models offer unprecedented image generation power given just a text prompt. While emerging approaches for controlling diffusion models have enabled users to specify the desired spatial layouts of the generated content, they cannot…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yunxiang Zhang , Nan Wu , Connor Z. Lin , Gordon Wetzstein , Qi Sun

Recent advances in generative modeling can create remarkably realistic synthetic videos, making it increasingly difficult for humans to distinguish them from real ones and necessitating reliable detection methods. However, two key…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Long Ma , Zihao Xue , Yan Wang , Zhiyuan Yan , Jin Xu , Xiaorui Jiang , Haiyang Yu , Yong Liao , Zhen Bi