English
Related papers

Related papers: A Survey on Video Diffusion Models

200 papers

Building on the momentum of image generation diffusion models, there is an increasing interest in video-based diffusion models. However, video generation poses greater challenges due to its higher-dimensional nature, the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Aimon Rahman , Malsha V. Perera , Vishal M. Patel

Recent success of large text-to-image models has empirically underscored the exceptional performance of diffusion models in generative tasks. To facilitate their efficient deployment on resource-constrained edge devices, model quantization…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Qian Zeng , Chenggong Hu , Mingli Song , Jie Song

Generative tasks about molecules, including but not limited to molecule generation, are crucial for drug discovery and material design, and have consistently attracted significant attention. In recent years, diffusion models have emerged as…

Machine Learning · Computer Science 2025-02-14 Liang Wang , Chao Song , Zhiyuan Liu , Yu Rong , Qiang Liu , Shu Wu , Liang Wang

Video generation models have made significant progress in generating realistic content, enabling applications in simulation, gaming, and film making. However, current generated videos still contain visual artifacts arising from 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Duolikun Danier , Ge Gao , Steven McDonagh , Changjian Li , Hakan Bilen , Oisin Mac Aodha

Diffusion models have achieved remarkable progress in generative modelling, particularly in enhancing image quality to conform to human preferences. Recently, these models have also been applied to low-level computer vision for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

In recent years, video generation has seen significant advancements. However, challenges still persist in generating complex motions and interactions. To address these challenges, we introduce ReVision, a plug-and-play framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Qihao Liu , Ju He , Qihang Yu , Liang-Chieh Chen , Alan Yuille

Diffusion Models (DMs) have disrupted the image Super-Resolution (SR) field and further closed the gap between image quality and human perceptual preferences. They are easy to train and can produce very high-quality samples that exceed the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Brian B. Moser , Arundhati S. Shanbhag , Federico Raue , Stanislav Frolov , Sebastian Palacio , Andreas Dengel

The field of deep generative modeling has grown rapidly in the last few years. With the availability of massive amounts of training data coupled with advances in scalable unsupervised learning paradigms, recent large-scale generative models…

AI-generated content (AIGC) methods aim to produce text, images, videos, 3D assets, and other media using AI algorithms. Due to its wide range of applications and the potential of recent works, AIGC developments -- especially in Machine…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Lin Geng Foo , Hossein Rahmani , Jun Liu

As a newly emerging advance in deep generative models, diffusion models have achieved state-of-the-art results in many fields, including computer vision, natural language processing, and molecule design. The remote sensing (RS) community…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Yidan Liu , Jun Yue , Shaobo Xia , Pedram Ghamisi , Weiying Xie , Leyuan Fang

In this work, we rethink the approach to video super-resolution by introducing a method based on the Diffusion Posterior Sampling framework, combined with an unconditional video diffusion transformer operating in latent space. The video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Zhihao Zhan , Wang Pang , Xiang Zhu , Yechao Bai

The video generation field has witnessed rapid improvements with the introduction of recent diffusion models. While these models have successfully enhanced appearance quality, they still face challenges in generating coherent and natural…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Yaosi Hu , Zhenzhong Chen , Chong Luo

Artificial Intelligence Generated Content (AIGC) has advanced significantly, particularly with the development of video generation models such as text-to-video (T2V) models and image-to-video (I2V) models. However, like other AIGC types,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Runyi Hu , Jie Zhang , Yiming Li , Jiwei Li , Qing Guo , Han Qiu , Tianwei Zhang

Despite the remarkable progress in deep generative models, synthesizing high-resolution and temporally coherent videos still remains a challenge due to their high-dimensionality and complex temporal dynamics along with large spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Sihyun Yu , Kihyuk Sohn , Subin Kim , Jinwoo Shin

Image editing aims to edit the given synthetic or real image to meet the specific requirements from users. It is widely studied in recent years as a promising and challenging field of Artificial Intelligence Generative Content (AIGC).…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xincheng Shuai , Henghui Ding , Xingjun Ma , Rongcheng Tu , Yu-Gang Jiang , Dacheng Tao

In the realm of image generation, the quest for realism and customization has never been more pressing. While existing methods like concept sliders have made strides, they often falter when it comes to no-AIGC images, particularly images…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Yufei Tang , Daiheng Gao , Pingyu Wu , Wenbo Zhou , Bang Zhang , Weiming Zhang

Diffusion models are getting popular in generative image and video synthesis. However, due to the diffusion process, they require a large number of steps to converge. To tackle this issue, in this paper, we propose to perform the diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yuanhao Gong

The latest developments in Artificial Intelligence include diffusion generative models, quite popular tools which can produce original images both unconditionally and, in some cases, conditioned by some inputs provided by the user. Apart…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Stefano Scotta , Alberto Messina

Generative artificial intelligence (AI) refers to algorithms that create synthetic but realistic output. Diffusion models currently offer state of the art performance in generative AI for images. They also form a key component in more…

Machine Learning · Computer Science 2023-12-27 Catherine F. Higham , Desmond J. Higham , Peter Grindrod

Video generation is an interesting problem in computer vision. It is quite popular for data augmentation, special effect in move, AR/VR and so on. With the advances of deep learning, many deep generative models have been proposed to solve…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Tingfung Lau , Sailun Xu , Xinze Wang