English
Related papers

Related papers: Diffusion Probabilistic Modeling for Video Generat…

200 papers

Diffusion models have achieved remarkable progress in the field of video generation. However, their iterative denoising nature requires a large number of inference steps to generate a video, which is slow and computationally expensive. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Xihui Liu , Yunhong Wang , Yu Qiao

Current 4D generation methods have achieved noteworthy efficacy with the aid of advanced diffusion generative models. However, these methods lack multi-view spatial-temporal modeling and encounter challenges in integrating diverse prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Xihui Liu , Yunhong Wang , Yu Qiao

Score-based generative modeling, informally referred to as diffusion models, continue to grow in popularity across several important domains and tasks. While they provide high-quality and diverse samples from empirical distributions,…

Machine Learning · Statistics 2023-12-29 Jacopo Teneggi , Matthew Tivnan , J. Webster Stayman , Jeremias Sulam

We propose a deterministic denoising algorithm for discrete-state diffusion models. The key idea is to derandomize the generative reverse Markov chain by introducing a variant of the herding algorithm, which induces deterministic state…

Machine Learning · Computer Science 2026-01-30 Hideyuki Suzuki , Wataru Kurebayashi , Hiroshi Yamashita

Video generation models have been used as a robot policy to predict the future states of executing a task conditioned on task description and observation. Previous works ignore their high computational cost and long inference time. To…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Qikang Zhang , Yingjie Lei , Wei Liu , Daochang Liu

Denoising diffusion probabilistic models (DDPMs) have achieved impressive performance on various image generation tasks, including image super-resolution. By learning to reverse the process of gradually diffusing the data distribution into…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Kai Zhao , Alex Ling Yu Hung , Kaifeng Pang , Haoxin Zheng , Kyunghyun Sung

With the rapid development of diffusion models and flow-based generative models, there has been a surge of interests in solving noisy linear inverse problems, e.g., super-resolution, deblurring, denoising, colorization, etc, with generative…

Machine Learning · Computer Science 2024-10-22 Xiangming Meng , Yoshiyuki Kabashima

Diffusion models have achieved impressive performance in video generation, but their iterative denoising process remains computationally expensive due to the large number of tokens processed at each timestep. Recently, progressive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Shikang Zheng , Jingkai Huang , Jiacheng Liu , Guantao Chen , Lixuan , Yuqi Lin , Peiliang Cai , Linfeng Zhang

Diffusion models have recently been shown to be relevant for high-quality speech generation. Most work has been focused on generating spectrograms, and as such, they further require a subsequent model to convert the spectrogram to a…

Sound · Computer Science 2024-03-12 Roi Benita , Michael Elad , Joseph Keshet

Training deep learning methods on small time series datasets that also include corrupted samples is challenging. Diffusion models have shown to be effective to generate realistic and synthetic data, and correct corrupted samples through…

Machine Learning · Computer Science 2025-09-17 Julian Ripper , Ousama Esbel , Rafael Fietzek , Max Mühlhäuser , Thomas Kreutz

Denoising diffusion probabilistic models and score-matching models have proven to be very powerful for generative tasks. While these approaches have also been applied to the generation of discrete graphs, they have, so far, relied on…

Machine Learning · Computer Science 2023-08-17 Kilian Konstantin Haefeli , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

Building on the momentum of image generation diffusion models, there is an increasing interest in video-based diffusion models. However, video generation poses greater challenges due to its higher-dimensional nature, the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Aimon Rahman , Malsha V. Perera , Vishal M. Patel

We introduce a method to generate temporally coherent human animation from a single image, a video, or a random noise. This problem has been formulated as modeling of an auto-regressive generation, i.e., to regress past frames to decode…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Tserendorj Adiya , Jae Shin Yoon , Jungeun Lee , Sanghun Kim , Hwasup Lim

Denoising diffusion models are a class of generative models which have recently achieved state-of-the-art results across many domains. Gradual noise is added to the data using a diffusion process, which transforms the data distribution into…

Machine Learning · Statistics 2024-06-28 Francisco Vargas , Teodora Reu , Anna Kerekes , Michael M Bronstein

Diffusion models represent a class of generative models that produce data by denoising a sample corrupted by white noise. Despite the success of diffusion models in computer vision, audio synthesis, and point cloud generation, so far they…

Statistical Mechanics · Physics 2025-01-17 Kanta Masuki , Yuto Ashida

We propose in this paper an analytically new construct of a diffusion model whose drift and diffusion parameters yield an exponentially time-decaying Signal to Noise Ratio in the forward process. In reverse, the construct cleverly carries…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Tanmay Asthana , Yufang Bao , Hamid Krim

Generating realistic animated videos from static images is an important area of research in computer vision. Methods based on physical simulation and motion prediction have achieved notable advances, but they are often limited to specific…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Qiang Wang , Minghua Liu , Junjun Hu , Fan Jiang , Mu Xu

Recently, diffusion models have shown remarkable results in image synthesis by gradually removing noise and amplifying signals. Although the simple generative process surprisingly works well, is this the best way to generate image data? For…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Sangyun Lee , Hyungjin Chung , Jaehyeon Kim , Jong Chul Ye

Diffusion generative models have recently become a powerful technique for creating and modifying high-quality, coherent video content. This survey provides a comprehensive overview of the critical components of diffusion models for video…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Andrew Melnik , Michal Ljubljanac , Cong Lu , Qi Yan , Weiming Ren , Helge Ritter

Diffusion models are the current state of the art for generating photorealistic images. Controlling the sampling process for constrained image generation tasks such as inpainting, however, remains challenging since exact conditioning on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Anji Liu , Mathias Niepert , Guy Van den Broeck
‹ Prev 1 3 4 5 6 7 10 Next ›