English
Related papers

Related papers: Unadjusted Langevin algorithm with multiplicative …

200 papers

We derive a multidimensional Stein's method for asymptotic independence in the case of a general target $\mu$ with a density, being invariant measure of a diffusion process. It allows us to give a general bound in Wasserstein distance…

Probability · Mathematics 2026-05-28 Ciprian A. Tudor , Jérémy Zurcher

Stochastic iterative algorithms, including stochastic gradient descent (SGD) and stochastic gradient Langevin dynamics (SGLD), are widely utilized for optimization and sampling in large-scale and high-dimensional problems in machine…

Machine Learning · Statistics 2025-01-22 Xiaoyu Wang , Mikolaj J. Kasprzak , Jeffrey Negrea , Solesne Bourguin , Jonathan H. Huggins

Brownian yet non-Gaussian phenomenon has recently been observed in many biological and active matter systems. The main idea of explaining this phenomenon is to introduce a random diffusivity for particles moving in inhomogeneous…

Statistical Mechanics · Physics 2022-01-19 Xudong Wang , Yao Chen

This article details a novel numerical scheme to approximate gradient flows for optimal transport (i.e. Wasserstein) metrics. These flows have proved useful to tackle theoretically and numerically non-linear diffusion equations that model…

Optimization and Control · Mathematics 2015-03-10 Gabriel Peyré

A general method is proposed which allows one to estimate drift and diffusion coefficients of a stochastic process governed by a Langevin equation. It extends a previously devised approach [R. Friedrich et al., Physics Letters A 271, 217…

Data Analysis, Statistics and Probability · Physics 2009-11-11 D. Kleinhans , R. Friedrich , A. Nawroth , J. Peinke

Sampling from score-based diffusion models incurs bias due to both time discretisation and the approximation of the score function. A common strategy for reducing this bias is to apply corrector steps based on the unadjusted Langevin…

Machine Learning · Statistics 2026-05-12 Kevin H. Lam , Tyler Farghly , Christopher Williams , Jun Yang , Yee Whye Teh , Arnaud Doucet

This work is concerned with the derivation of a robust a posteriori error estimator for a discontinuous Galerkin method discretisation of linear non-stationary convection-diffusion initial/boundary value problems and with the implementation…

Numerical Analysis · Mathematics 2012-11-16 Andrea Cangiani , Emmanuil H. Georgoulis , Stephen Metcalfe

We present an improved analysis of the Euler-Maruyama discretization of the Langevin diffusion. Our analysis does not require global contractivity, and yields polynomial dependence on the time horizon. Compared to existing approaches, we…

Probability · Mathematics 2019-11-05 Wenlong Mou , Nicolas Flammarion , Martin J. Wainwright , Peter L. Bartlett

Score-based diffusion models have emerged as powerful tools in generative modeling, yet their theoretical foundations remain underexplored. In this work, we focus on the Wasserstein convergence analysis of score-based diffusion models.…

Machine Learning · Statistics 2025-02-10 Yifeng Yu , Lu Yu

Diffusion models are one of the most important families of deep generative models. In this note, we derive a quantitative upper bound on the Wasserstein distance between the data-generating distribution and the distribution learned by a…

Machine Learning · Computer Science 2024-09-17 Sokhna Diarra Mbacke , Omar Rivasplata

We study the long time behavior of an advection-diffusion equation with a random shear flow which depends on a stationary Ornstein-Uhlenbeck (OU) process in parallel-plate channels enforcing the no-flux boundary conditions. We derive a…

Analysis of PDEs · Mathematics 2020-12-15 Lingyun Ding , Richard M. McLaughlin

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

Machine Learning · Computer Science 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

Stein's method has been widely used for probability approximations. However, in the multi-dimensional setting, most of the results are for multivariate normal approximation or for test functions with bounded second- or higher-order…

Probability · Mathematics 2018-08-16 Xiao Fang , Qi-Man Shao , Lihu Xu

Langevin dynamics are widely used in sampling high-dimensional, non-Gaussian distributions whose densities are known up to a normalizing constant. In particular, there is strong interest in unadjusted Langevin algorithms (ULA), which…

Methodology · Statistics 2024-10-24 Benjamin J. Zhang , Youssef M. Marzouk , Konstantinos Spiliopoulos

This work is motivated by the need to study the impact of data uncertainties and material imperfections on the solution to optimal control problems constrained by partial differential equations. We consider a pathwise optimal control…

Optimization and Control · Mathematics 2016-03-01 Ahmad Ahmad Ali , Elisabeth Ullmann , Michael Hinze

Diffusion approximation provides weak approximation for stochastic gradient descent algorithms in a finite time horizon. In this paper, we introduce new tools motivated by the backward error analysis of numerical stochastic differential…

Machine Learning · Computer Science 2019-09-05 Yuanyuan Feng , Tingran Gao , Lei Li , Jian-Guo Liu , Yulong Lu

We study the Unadjusted Langevin Algorithm (ULA) for sampling from a probability distribution $\nu = e^{-f}$ on $\mathbb{R}^n$. We prove a convergence guarantee in Kullback-Leibler (KL) divergence assuming $\nu$ satisfies a log-Sobolev…

Data Structures and Algorithms · Computer Science 2022-03-04 Santosh S. Vempala , Andre Wibisono

Diffusion models have demonstrated remarkable empirical success in the recent years and are considered one of the state-of-the-art generative models in modern AI. These models consist of a forward process, which gradually diffuses the data…

Machine Learning · Computer Science 2026-01-07 Xingyu Xu , Ziyi Zhang , Yorie Nakahira , Guannan Qu , Yuejie Chi

In this paper we present a novel approach towards variance reduction for discretised diffusion processes. The proposed approach involves specially constructed control variates and allows for a significant reduction in the variance for the…

Probability · Mathematics 2017-12-05 Denis Belomestny , Stefan Häfner , Mikhail Urusov

In generative modelling and stochastic optimal control, a central computational task is to modify a reference diffusion process to maximise a given terminal-time reward. Most existing methods require this reward to be differentiable, using…