English
Related papers

Related papers: Sublinear iterations can suffice even for DDPMs

200 papers

Diffusion models have shown remarkable empirical success in sampling from rich multi-modal distributions. Their inference relies on numerically solving a certain differential equation. This differential equation cannot be solved in closed…

Machine Learning · Computer Science 2026-01-16 Khashayar Gatmiry , Sitan Chen , Adil Salim

Discrete diffusion models (DDMs) have shown powerful generation ability for discrete data modalities like text and molecules. However, their practical application is hindered by inefficient sampling, requiring a large number of sampling…

Machine Learning · Computer Science 2025-09-25 Feiyang Fu , Tongxian Guo , Zhaoqiang Liu

This survey addresses sampling discretization and its connections with other areas of mathematics. The survey concentrates on sampling discretization of norms of elements of finite-dimensional subspaces. We present here known results on…

Functional Analysis · Mathematics 2022-02-11 B. Kashin , E. Kosov , I. Limonova , V. Temlyakov

Diffusion models, which convert noise into new data instances by learning to reverse a diffusion process, have become a cornerstone in contemporary generative modeling. In this work, we develop non-asymptotic convergence theory for a…

Machine Learning · Computer Science 2024-08-06 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

Denoising Diffusion Probabilistic Models (DDPMs) represent a contemporary class of generative models with exceptional qualities in both synthesis and maximizing the data likelihood. These models work by traversing a forward Markov Chain…

Machine Learning · Computer Science 2024-09-16 Hang Li , Wei Jin , Geri Skenderi , Harry Shomer , Wenzhuo Tang , Wenqi Fan , Jiliang Tang

We present DeepFDM, a differentiable finite-difference framework for learning spatially varying coefficients in time-dependent partial differential equations (PDEs). By embedding a classical forward-Euler discretization into a convolutional…

Numerical Analysis · Mathematics 2025-07-30 Patrick Chatain , Michael Rizvi-Martel , Guillaume Rabusseau , Adam Oberman

Diffusion modeling (DM) has high-quality generative performance, and the sampling problem is an important part of the DM performance. Thanks to efficient differential equation solvers, the sampling speed can be reduced while higher sampling…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Zitong Cheng

In this paper, conditional denoising diffusion probabilistic models (DDPMs) are proposed to enhance the data transmission and reconstruction over wireless channels. The underlying mechanism of DDPM is to decompose the data generation…

Information Theory · Computer Science 2024-11-21 Mehdi Letafati , Samad Ali , Matti Latva-aho

Because diffusion models have shown impressive performances in a number of tasks, such as image synthesis, there is a trend in recent works to prove (with certain assumptions) that these models have strong approximation capabilities. In…

Machine Learning · Computer Science 2024-01-19 Yangming Li , Boris van Breugel , Mihaela van der Schaar

Constructing a highly accurate handwritten OCR system requires large amounts of representative training data, which is both time-consuming and expensive to collect. To mitigate the issue, we propose a denoising diffusion probabilistic model…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Haisong Ding , Bozhi Luan , Dongnan Gui , Kai Chen , Qiang Huo

In recent years, Rectified flow (RF) has gained considerable popularity largely due to its generation efficiency and state-of-the-art performance. In this paper, we investigate the degree to which RF automatically adapts to the intrinsic…

Machine Learning · Statistics 2026-02-24 Saptarshi Roy , Alessandro Rinaldo , Purnamrita Sarkar

Correcting for detector effects in experimental data, particularly through unfolding, is critical for enabling precision measurements in high-energy physics. However, traditional unfolding methods face challenges in scalability,…

Data Analysis, Statistics and Probability · Physics 2024-11-28 Camila Pazos , Shuchin Aeron , Pierre-Hugues Beauchemin , Vincent Croft , Zhengyan Huan , Martin Klassen , Taritree Wongjirad

Denoising Diffusion Probabilistic Models (DDPMs) exhibit remarkable capabilities in image generation, with studies suggesting that they can generalize by composing latent factors learned from the training data. In this work, we go further…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Justin Deschenaux , Igor Krawczuk , Grigorios Chrysos , Volkan Cevher

Denoising diffusion models (DDMs) have recently attracted increasing attention by showing impressive synthesis quality. DDMs are built on a diffusion process that pushes data to the noise distribution and the models learn to denoise. In…

Machine Learning · Computer Science 2023-05-16 Jaemoo Choi , Yesom Park , Myungjoo Kang

Diffusion Probabilistic Models (DPMs) have emerged as the de facto approach for high-fidelity image synthesis, operating diffusion processes on continuous VAE latent, which significantly differ from the text generation methods employed by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xiaoping Wu , Jie Hu , Xiaoming Wei

We study parametric inference for ergodic diffusion processes with a degenerate diffusion matrix. Existing research focuses on a particular class of hypo-elliptic SDEs, with components split into `rough'/`smooth' and noise from rough…

Statistics Theory · Mathematics 2024-05-29 Yuga Iguchi , Alexandros Beskos , Matthew Graham

In applications of diffusion models, controllable generation is of practical significance, but is also challenging. Current methods for controllable generation primarily focus on modifying the score function of diffusion models, while Mean…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ao Li , Wei Fang , Hongbo Zhao , Le Lu , Ge Yang , Minfeng Xu

Diffusion and flow matching models generate high-fidelity data by simulating paths defined by Ordinary or Stochastic Differential Equations (ODEs/SDEs), starting from a tractable prior distribution. The probability flow ODE formulation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Liangyu Yuan , Ruoyu Wang , Tong Zhao , Dingwen Fu , Mingkun Lei , Beier Zhu , Chi Zhang

We present a class of diffusion-based algorithms to draw samples from high-dimensional probability distributions given their unnormalized densities. Ideally, our methods can transport samples from a Gaussian distribution to a specified…

Machine Learning · Computer Science 2025-02-04 Anand Jerry George , Nicolas Macris

Free-form inpainting is the task of adding new content to an image in the regions specified by an arbitrary binary mask. Most existing approaches train for a certain distribution of masks, which limits their generalization capabilities to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Andreas Lugmayr , Martin Danelljan , Andres Romero , Fisher Yu , Radu Timofte , Luc Van Gool