English
Related papers

Related papers: Cache Me if You Can: Accelerating Diffusion Models…

200 papers

Most recent diffusion-based methods still show a large gap compared to non-diffusion methods for video frame interpolation, in both accuracy and efficiency. Most of them formulate the problem as a denoising procedure in latent space…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yang Hai , Guo Wang , Tan Su , Wenjie Jiang , Yinlin Hu

Denoising diffusion models represent a recent emerging topic in computer vision, demonstrating remarkable results in the area of generative modeling. A diffusion model is a deep generative model that is based on two stages, a forward…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Florinel-Alin Croitoru , Vlad Hondru , Radu Tudor Ionescu , Mubarak Shah

In recent years, diffusion models have emerged as the most powerful approach in image synthesis. However, applying these models directly to video synthesis presents challenges, as it often leads to noticeable flickering contents. Although…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Zhongjie Duan , Lizhou You , Chengyu Wang , Cen Chen , Ziheng Wu , Weining Qian , Jun Huang

Stable diffusion models have ushered in a new era of advancements in image generation, currently reigning as the state-of-the-art approach, exhibiting unparalleled performance. The process of diffusion, accompanied by denoising through…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Andras Horvath

Diffusion models have achieved unprecedented performance in image generation, yet they suffer from slow inference due to their iterative sampling process. To address this, early-exiting has recently been proposed, where the depth of the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Daniel Gallo Fernández , Răzvan-Andrei Matişan , Alejandro Monroy Muñoz , Ana-Maria Vasilcoiu , Janusz Partyka , Tin Hadži Veljković , Metod Jazbec

Due to the high complexity and technical requirements of industrial production processes, surface defects will inevitably appear, which seriously affects the quality of products. Although existing lightweight detection networks are highly…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xuyi Yu

Diffusion and flow matching models have achieved remarkable success in text-to-image generation. However, these models typically rely on the predetermined denoising schedules for all prompts. The multi-step reverse diffusion process can be…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Zilyu Ye , Zhiyang Chen , Tiancheng Li , Zemin Huang , Weijian Luo , Guo-Jun Qi

We empirically study the effect of noise scheduling strategies for denoising diffusion generative models. There are three findings: (1) the noise scheduling is crucial for the performance, and the optimal one depends on the task (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Ting Chen

Diffusion language models offer parallel token generation and inherent bidirectionality, promising more efficient and powerful sequence modeling compared to autoregressive approaches. However, state-of-the-art diffusion models (e.g., Dream…

Computation and Language · Computer Science 2025-10-10 Zhanqiu Hu , Jian Meng , Yash Akhauri , Mohamed S. Abdelfattah , Jae-sun Seo , Zhiru Zhang , Udit Gupta

Recent empirical studies have demonstrated that diffusion models can effectively learn the image distribution and generate new samples. Remarkably, these models can achieve this even with a small number of training samples despite a large…

Machine Learning · Computer Science 2025-07-08 Peng Wang , Huijie Zhang , Zekai Zhang , Siyi Chen , Yi Ma , Qing Qu

Diffusion models have recently achieved great success in the synthesis of high-quality images and videos. However, the existing denoising techniques in diffusion models are commonly based on step-by-step noise predictions, which suffers…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Hancheng Ye , Jiakang Yuan , Renqiu Xia , Xiangchao Yan , Tao Chen , Junchi Yan , Botian Shi , Bo Zhang

Diffusion models have become the go-to method for many generative tasks, particularly for image-to-image generation tasks such as super-resolution and inpainting. Current diffusion-based methods do not provide statistical guarantees…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Eliahu Horwitz , Yedid Hoshen

Efficient video generation models are increasingly vital for multimedia synthetic content generation. Leveraging the Transformer architecture and the diffusion process, video DiT models have emerged as a dominant approach for high-quality…

Graphics · Computer Science 2026-02-27 Yuanxin Wei , Lansong Diao , Bujiao Chen , Shenggan Cheng , Zhengping Qian , Wenyuan Yu , Nong Xiao , Wei Lin , Jiangsu Du

Diffusion models and flow-matching models have enabled generating diverse and realistic images by learning to transfer noise to data. However, sampling from these models involves iterative denoising over many neural network passes, making…

Machine Learning · Computer Science 2025-06-24 Kevin Frans , Danijar Hafner , Sergey Levine , Pieter Abbeel

This work aims to improve the efficiency of text-to-image diffusion models. While diffusion models use computationally expensive UNet-based denoising operations in every generation step, we identify that not all operations are equally…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Amirhossein Habibian , Amir Ghodrati , Noor Fathima , Guillaume Sautiere , Risheek Garrepalli , Fatih Porikli , Jens Petersen

Video diffusion models have rapidly become the dominant paradigm for high-fidelity generative video synthesis, but their practical deployment remains constrained by severe inference costs. Compared with image generation, video synthesis…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Shitong Shao , Lichen Bai , Pengfei Wan , James Kwok , Zeke Xie

Diffusion models have emerged as a promising approach for generating high-quality, high-dimensional images. Nevertheless, these models are hindered by their high computational cost and slow inference, partly due to the quadratic…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Omid Saghatchian , Atiyeh Gh. Moghadam , Ahmad Nickabadi

Diffusion models are the de facto approach for generating high-quality images and videos, but learning high-dimensional models remains a formidable task due to computational and optimization challenges. Existing methods often resort to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jiatao Gu , Shuangfei Zhai , Yizhe Zhang , Josh Susskind , Navdeep Jaitly

Diffusion- and flow-based models usually allocate compute uniformly across space, updating all patches with the same timestep and number of function evaluations. While convenient, this ignores the heterogeneity of natural images: some…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Johannes Schusterbauer , Ming Gui , Yusong Li , Pingchuan Ma , Felix Krause , Björn Ommer

Diffusion models are widely recognized for generating high-quality and diverse images, but their poor real-time performance has led to numerous acceleration works, primarily focusing on UNet-based structures. With the more successful…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Pengtao Chen , Mingzhu Shen , Peng Ye , Jianjian Cao , Chongjun Tu , Christos-Savvas Bouganis , Yiren Zhao , Tao Chen