English
Related papers

Related papers: Analyzing the Error of Generative Diffusion Models…

200 papers

We investigate the approximation efficiency of score functions by deep neural networks in diffusion-based generative modeling. While existing approximation theories utilize the smoothness of score functions, they suffer from the curse of…

Machine Learning · Computer Science 2023-09-21 Song Mei , Yuchen Wu

In this paper, we derive error estimates of the backward Euler-Maruyama method applied to multi-valued stochastic differential equations. An important example of such an equation is a stochastic gradient flow whose associated potential is…

Numerical Analysis · Mathematics 2022-05-10 Monika Eisenmann , Mihály Kovács , Raphael Kruse , Stig Larsson

Score-based diffusion models (SBDM) have recently emerged as state-of-the-art approaches for image generation. Existing SBDMs are typically formulated in a finite-dimensional setting, where images are considered as tensors of finite size.…

Machine Learning · Computer Science 2024-10-22 Paul Hagemann , Sophie Mildenberger , Lars Ruthotto , Gabriele Steidl , Nicole Tianjiao Yang

We study convergence of a generative modeling method that first estimates the score function of the distribution using Denoising Auto-Encoders (DAE) or Denoising Score Matching (DSM) and then employs Langevin diffusion for sampling. We show…

Machine Learning · Statistics 2022-10-12 Adam Block , Youssef Mroueh , Alexander Rakhlin

Diffusion models have become the de facto framework for generating new datasets. The core of these models lies in the ability to reverse a diffusion process in time. The goal of this manuscript is to explain, from a PDE perspective, how…

Probability · Mathematics 2025-01-29 Fei Cao , Kimball Johnston , Thomas Laurent , Justin Le , Sébastien Motsch

In the present article we study strong approximation of solutions of scalar stochastic differential equations (SDEs) with bounded and $\alpha$-H\"older continuous drift coefficient and constant diffusion coefficient at time point $1$.…

Probability · Mathematics 2025-04-30 Simon Ellinger , Thomas Müller-Gronbach , Larisa Yaroslavtseva

Diffusion models are one of the most important families of deep generative models. In this note, we derive a quantitative upper bound on the Wasserstein distance between the data-generating distribution and the distribution learned by a…

Machine Learning · Computer Science 2024-09-17 Sokhna Diarra Mbacke , Omar Rivasplata

We are interested in the Euler-Maruyama dicretization of the SDE dXt =b(t,Xt)dt+ dZt, X0 =x$\in$Rd, where Zt is a symmetric isotropic d-dimensional $\alpha$-stable process, $\alpha$ $\in$ (1, 2] and the drift b $\in$ L$\infty$…

Numerical Analysis · Mathematics 2026-04-15 Mathis Fitoussi , Stephane Menozzi

A potent class of generative models known as Diffusion Probabilistic Models (DPMs) has become prominent. A forward diffusion process adds gradually noise to data, while a model learns to gradually denoise. Sampling from pre-trained DPMs is…

Machine Learning · Computer Science 2023-10-27 Martin Gonzalez , Nelson Fernandez , Thuy Tran , Elies Gherbi , Hatem Hajri , Nader Masmoudi

We consider Galerkin finite element methods for semilinear stochastic partial differential equations (SPDEs) with multiplicative noise and Lipschitz continuous nonlinearities. We analyze the strong error of convergence for spatially…

Numerical Analysis · Mathematics 2014-11-26 Raphael Kruse

We present an explicit method for simulating stochastic differential equations (SDEs) that have variable diffusion coefficients and satisfy the detailed balance condition with respect to a known equilibrium density. In Tupper and Yang…

Numerical Analysis · Mathematics 2014-06-27 Paul Tupper , Xin Yang

This paper establishes the asymptotic error distribution of the tamed Euler method for stochastic differential equations (SDEs) with a coupled monotonicity condition, that is, the limit distribution of the corresponding normalized error…

Numerical Analysis · Mathematics 2026-02-11 Xinjie Dai , Diancong Jin , Jiaoyang Xu

Generating graph-structured data requires learning the underlying distribution of graphs. Yet, this is a challenging problem, and the previous graph generative methods either fail to capture the permutation-invariance property of graphs or…

Machine Learning · Computer Science 2022-06-16 Jaehyeong Jo , Seul Lee , Sung Ju Hwang

In this paper, we consider the adaptive Eulerian--Lagrangian method (ELM) for linear convection-diffusion problems. Unlike the classical a posteriori error estimations, we estimate the temporal error along the characteristics and derive a…

Numerical Analysis · Mathematics 2012-09-07 Xiaozhe Hu , Young-Ju Lee , Jinchao Xu , Chensong Zhang

Modelling random dynamical systems in continuous time, diffusion processes are a powerful tool in many areas of science. Model parameters can be estimated from time-discretely observed processes using Markov chain Monte Carlo (MCMC) methods…

Computation · Statistics 2020-10-12 Susanne Pieschner , Christiane Fuchs

Discrete flow models offer a powerful framework for learning distributions over discrete state spaces and have demonstrated superior performance compared to the discrete diffusion models. However, their convergence properties and error…

Statistics Theory · Mathematics 2026-05-27 Zhengyan Wan , Yidong Ouyang , Qiang Yao , Liyan Xie , Fang Fang , Hongyuan Zha , Guang Cheng

Masked discrete diffusion models (MDMs) are a promising new approach to generative modelling, offering the ability for parallel token generation and therefore greater efficiency than autoregressive counterparts. However, achieving an…

Machine Learning · Computer Science 2026-03-02 David Fox , Sam Bowyer , Song Liu , Laurence Aitchison , Raul Santos-Rodriguez , Mengyue Yang

Stochastic differential equation mixed-effects models (SDEMEMs) are flexible hierarchical models that are able to account for random variability inherent in the underlying time-dynamics, as well as the variability between experimental units…

Computation · Statistics 2021-01-22 Samuel Wiqvist , Andrew Golightly , Ashleigh T. McLean , Umberto Picchini

Recent developments in generative modeling have utilized score-based methods coupled with stochastic differential equations to sample from complex probability distributions. However, these and other performant sampling methods generally…

Machine Learning · Computer Science 2025-06-03 Bryan Riel , Tobias Bischoff

Can standard continuous-time generative models represent distributions whose support is an extremely sparse, globally constrained discrete set? We study this question using completed Sudoku grids as a controlled testbed, treating them as a…

Machine Learning · Computer Science 2026-01-29 Mariia Drozdova