English
Related papers

Related papers: Non-Asymptotic Convergence of Discrete Diffusion M…

200 papers

Denoising diffusion probabilistic models (DDPMs) (Ho et al. 2020) have shown impressive results on image and waveform generation in continuous state spaces. Here, we introduce Discrete Denoising Diffusion Probabilistic Models (D3PMs),…

Machine Learning · Computer Science 2023-02-23 Jacob Austin , Daniel D. Johnson , Jonathan Ho , Daniel Tarlow , Rianne van den Berg

We present a concise, self-contained derivation of diffusion-based generative models. Starting from basic properties of Gaussian distributions (densities, quadratic expectations, re-parameterisation, products, and KL divergences), we…

Machine Learning · Computer Science 2025-11-18 Sepehr Maleki , Negar Pourmoazemi

For certain materials science scenarios arising in rubber technology, one-dimensional moving boundary problems (MBPs) with kinetic boundary conditions are capable of unveiling the large-time behavior of the diffusants penetration front,…

Numerical Analysis · Mathematics 2023-12-04 Surendra Nepal , Magnus Ogren , Yosief Wondmagegne , Adrian Muntean

The diffusive transport of particles in anisotropic media is a fundamental phenomenon in computational, medical and biological disciplines. While deterministic models (partial differential equations) of such processes are well established,…

Computational Physics · Physics 2025-10-20 Luke P. Filippini , Adrianne L. Jenner , Elliot J. Carr

Discrete diffusion models have recently gained significant prominence in applications involving natural language and graph data. A key factor influencing their effectiveness is the efficiency of discretized samplers. Among these,…

Machine Learning · Computer Science 2025-11-03 Yuchen Liang , Yingbin Liang , Lifeng Lai , Ness Shroff

Diffusion models have demonstrated remarkable empirical success in the recent years and are considered one of the state-of-the-art generative models in modern AI. These models consist of a forward process, which gradually diffuses the data…

Machine Learning · Computer Science 2026-01-07 Xingyu Xu , Ziyi Zhang , Yorie Nakahira , Guannan Qu , Yuejie Chi

We propose a new approach to quantize the marginals of the discrete Euler diffusion process. The method is built recursively and involves the conditional distribution of the marginals of the discrete Euler process. Analytically, the method…

Probability · Mathematics 2015-05-25 Gilles Pagès , Abass Sagna

Despite the remarkable empirical success of score-based diffusion models, their statistical guarantees remain underdeveloped. Existing analyses often provide pessimistic convergence rates that do not reflect the intrinsic low-dimensional…

Machine Learning · Statistics 2026-04-24 Saptarshi Chakraborty , Quentin Berthet , Peter L. Bartlett

Although generative diffusion models (GDMs) are widely used in practice, their theoretical foundations remain limited, especially concerning the impact of different discretization schemes applied to the underlying stochastic differential…

Numerical Analysis · Mathematics 2026-01-27 Emanuel Pfarr , Radu Timofte , Frank Werner

In this paper, we focus on non-asymptotic bounds related to the Euler scheme of an ergodic diffusion with a possibly multiplicative diffusion term (non-constant diffusion coefficient). More precisely, the objective of this paper is to…

Probability · Mathematics 2022-09-23 Gilles Pages , Fabien Panloup

Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution.…

Machine Learning · Computer Science 2023-08-21 Francisco Vargas , Will Grathwohl , Arnaud Doucet

Generative modeling aims to produce new random examples from an unknown target distribution, given access to a finite collection of examples. Among the leading approaches, denoising diffusion probabilistic models (DDPMs) construct such…

Machine Learning · Statistics 2025-06-12 Vahan Arsenyan , Elen Vardanyan , Arnak Dalalyan

Denoising diffusion probabilistic models and score-matching models have proven to be very powerful for generative tasks. While these approaches have also been applied to the generation of discrete graphs, they have, so far, relied on…

Machine Learning · Computer Science 2023-08-17 Kilian Konstantin Haefeli , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

Score-based diffusion models, which generate new data by learning to reverse a diffusion process that perturbs data from the target distribution into noise, have achieved remarkable success across various generative tasks. Despite their…

Machine Learning · Computer Science 2025-01-23 Gen Li , Yuling Yan

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard…

Statistical Mechanics · Physics 2024-08-15 Luke Causer , Grant M. Rotskoff , Juan P. Garrahan

Diffusion-based generative models (DBGMs) perturb data to a target noise distribution and reverse this process to generate samples. The choice of noising process, or inference diffusion process, affects both likelihoods and sample quality.…

Machine Learning · Computer Science 2023-03-06 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

We introduce the concept of Randomly Modulated Gaussian Processes as a unifying framework for modeling, analyzing and classifying anomalous diffusion models in heterogeneous media. This formulation incorporates correlations in the…

Biological Physics · Physics 2026-03-16 Yann Lanoiselée , Denis S. Grebenkov , Gianni Pagnini

This paper investigates score-based diffusion models when the underlying target distribution is concentrated on or near low-dimensional manifolds within the higher-dimensional space in which they formally reside, a common characteristic of…

Machine Learning · Computer Science 2025-01-03 Gen Li , Yuling Yan

Score-based diffusion models have emerged as powerful techniques for generating samples from high-dimensional data distributions. These models involve a two-phase process: first, injecting noise to transform the data distribution into a…

Machine Learning · Computer Science 2024-10-21 Runjia Li , Qiwei Di , Quanquan Gu

Mathematical models of motility are often based on random-walk descriptions of discrete individuals that can move according to certain rules. It is usually the case that large masses concentrated in small regions of space have a great…

Physics and Society · Physics 2022-11-23 Carles Falcó