English
Related papers

Related papers: Analyzing the Error of Generative Diffusion Models…

200 papers

An implicit Euler finite-volume scheme for general cross-diffusion systems with volume-filling constraints is proposed and analyzed. The diffusion matrix may be nonsymmetric and not positive semidefinite, but the diffusion system is assumed…

Numerical Analysis · Mathematics 2021-05-13 Ansgar Jüngel , Antoine Zurek

We study strong approximation of $d$-dimensional stochastic differential equations (SDEs) with a discontinuous drift coefficient. More precisely, we essentially assume that the drift coefficient is piecewise Lipschitz continuous with an…

Numerical Analysis · Mathematics 2025-04-03 Thomas Müller-Gronbach , Christopher Rauhögger , Larisa Yaroslavtseva

A prominent family of methods for learning data distributions relies on density ratio estimation (DRE), where a model is trained to $\textit{classify}$ between data samples and samples from some reference distribution. DRE-based models can…

Machine Learning · Computer Science 2024-11-01 Shahar Yadin , Noam Elata , Tomer Michaeli

We propose two Euler-Maruyama (EM) type numerical schemes in order to approximate the invariant measure of a stochastic differential equation (SDE) driven by an $\alpha$-stable L\'evy process ($1<\alpha<2$): an approximation scheme with the…

Probability · Mathematics 2023-06-21 Peng Chen , Changsong Deng , Rene Schilling , Lihu Xu

In this study, we investigate the performance of two novel first-order optimization algorithms, namely the rescaled-gradient flow (RGF) and the signed-gradient flow (SGF). These algorithms are derived from the forward Euler discretization…

Machine Learning · Computer Science 2025-03-19 Siqi Zhang , Mouhacine Benosman , Orlando Romero

The paper establishes the strong convergence rates of a spatio-temporal full discretization of the stochastic wave equation with nonlinear damping in dimension one and two. We discretize the SPDE by applying a spectral Galerkin method in…

Numerical Analysis · Mathematics 2024-12-30 Meng Cai , David Cohen , Xiaojie Wang

Despite the widespread adoption of deterministic samplers in diffusion models (DMs), their potential limitations remain largely unexplored. In this paper, we identify collapse errors, a previously unrecognized phenomenon in ODE-based…

Machine Learning · Computer Science 2025-08-25 Yi Zhang , Zhenyu Liao , Jingfeng Wu , Difan Zou

In this paper, we consider Maxwell's equations in linear dispersive media described by a single-pole Lorentz model for electronic polarization. We study two classes of commonly used spatial discretizations: finite difference methods (FD)…

Numerical Analysis · Mathematics 2019-06-26 Yan Jiang , Puttha Sakkaplangkul , Vrushali A. Bokil , Yingda Cheng , Fengyan Li

The Ensemble Kalman methodology in an inverse problems setting can be viewed as an iterative scheme, which is a weakly tamed discretization scheme for a certain stochastic differential equation (SDE). Assuming a suitable approximation…

Probability · Mathematics 2018-06-19 Dirk Blömker , Claudia Schillings , Philipp Wacker

We are interested in the strong convergence and almost sure stability of Euler-Maruyama (EM) type approximations to the solutions of stochastic differential equations (SDEs) with non-linear and non-Lipschitzian coefficients. Motivation…

Numerical Analysis · Mathematics 2012-04-10 Xuerong Mao , Lukasz Szpruch

We address the problem of Bayesian inference for parameters in ordinary differential equation (ODE) models based on observational data. Conventional approaches in this setting typically rely on numerical solvers such as the Euler or…

Methodology · Statistics 2025-12-01 Shoji Toyota , Yuto Miyatake

Parameter inference for stochastic differential equations is challenging due to the presence of a latent diffusion process. Working with an Euler-Maruyama discretisation for the diffusion, we use variational inference to jointly learn the…

Computation · Statistics 2018-05-15 Thomas Ryder , Andrew Golightly , A. Stephen McGough , Dennis Prangle

In this paper we analyze the behaviour of the stochastic gradient descent (SGD), a widely used method in supervised learning for optimizing neural network weights via a minimization of non-convex loss functions. Since the pioneering work of…

Machine Learning · Computer Science 2025-05-13 Davide Barbieri , Matteo Bonforte , Peio Ibarrondo

Generating samples from complex and high-dimensional distributions is ubiquitous in various scientific fields of statistical physics, Bayesian inference, scientific computing and machine learning. Very recently, Huang et al. (IEEE Trans.…

Numerical Analysis · Mathematics 2026-01-01 Xiaojie Wang , Xiaoyan Zhang

We introduce a general framework for approximating parabolic Stochastic Partial Differential Equations (SPDEs) based on fluctuation-dissipation balance. Using this approach we formulate Stochastic Discontinuous Galerkin Methods (SDGM). We…

Numerical Analysis · Mathematics 2023-02-28 Will Pazner , Nathaniel Trask , Paul J. Atzberger

This paper develops a generative model by minimizing the second-order Wasserstein loss (the $W_2$ loss) through a distribution-dependent ordinary differential equation (ODE), whose dynamics involves the Kantorovich potential associated with…

Machine Learning · Statistics 2026-05-14 Yu-Jui Huang , Zachariah Malik

This paper studies sampling error bounds for denoising diffusion probabilistic models (DDPMs) in the 2-Wasserstein distance. Our contributions are threefold. (i) Under general Lipschitz-type conditions on the score function and for a broad…

Machine Learning · Statistics 2026-05-19 Yuta Koike

*The gradient discretisation method (GDM) is a generic framework, covering many classical methods (Finite Elements, Finite Volumes, Discontinuous Galerkin, etc.), for designing and analysing numerical schemes for diffusion models. In this…

Numerical Analysis · Mathematics 2021-01-01 Jerome Droniou , Beniamin Goldys , Kim-Ngan Le

This study evaluates numerical discretization methods for the Single Particle Model (SPM) used in electrochemical modeling. The methods include the Finite Difference Method (FDM), spectral methods, Pad\'e approximation, and parabolic…

Systems and Control · Electrical Eng. & Systems 2025-06-03 Feng Guo , Luis D. Couto

Diffusion (score-based) generative models have been widely used for modeling various types of complex data, including images, audios, and point clouds. Recently, the deep connection between forward-backward stochastic differential equations…

Machine Learning · Computer Science 2022-06-22 Weitao Du , Tao Yang , He Zhang , Yuanqi Du