English
Related papers

Related papers: The Tamed Unadjusted Langevin Algorithm

200 papers

In this paper, we consider stochastic differential equations whose drift coefficient is superlinearly growing and piece-wise continuous, and whose diffusion coefficient is superlinearly growing and locally H\"older continuous. We first…

Probability · Mathematics 2023-05-15 Minh-Thang Do , Hoang-Long Ngo , Nhat-An Pho

The $\beta$ ensembles are a class of eigenvalue probability densities which generalise the invariant ensembles of classical random matrix theory. In the case of the Gaussian and Laguerre weights, the corresponding eigenvalue densities are…

Mathematical Physics · Physics 2018-12-20 Peter J. Forrester , Allan K. Trinh

Understanding the complexity of sampling from a strongly log-concave and log-smooth distribution $\pi$ on $\mathbb{R}^d$ to high accuracy is a fundamental problem, both from a practical and theoretical standpoint. In practice, high-accuracy…

Statistics Theory · Mathematics 2023-02-22 Jason M. Altschuler , Sinho Chewi

Diffusion models, typically formulated as discretizations of stochastic differential equations (SDEs), have achieved state-of-the-art performance in generative tasks. However, their theoretical analysis often involves complex proofs. In…

Machine Learning · Computer Science 2026-02-02 Juhyeok Choi , Chenglin Fan

A family of explicit modified Euler methods (MEMs) is constructed for long-time approximations of super-linear SODEs driven by multiplicative noise. The proposed schemes can preserve the same Lyapunov structure as the continuous problems.…

Numerical Analysis · Mathematics 2025-09-11 Zhihui Liu , Xiaojie Wang , Xiaoming Wu , Xiaoyan Zhang

Consider the following stochastic differential equation for $(X_t)_{t\ge 0}$ on $\mathbb R^d$ and its Euler-Maruyama (EM) approximation $(Y_{t_n})_{n\in \mathbb Z^+}$: \begin{align*} &d X_t=b( X_t) d t+\sigma(X_t) d B_t, \\ &…

Probability · Mathematics 2023-10-03 Xiang Li , Feng-Yu Wang , Lihu Xu

We consider a generic and explicit tamed Euler--Maruyama scheme for multidimensional time-inhomogeneous stochastic differential equations with multiplicative Brownian noise. The diffusive coefficient is uniformly elliptic, H\"older…

Probability · Mathematics 2025-02-03 Khoa Lê , Chengcheng Ling

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

Statistics Theory · Mathematics 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

We propose a deterministic sampling framework using Score-Based Transport Modeling for sampling an unnormalized target density $\pi$ given only its score $\nabla \log \pi$. Our method approximates the Wasserstein gradient flow on…

Machine Learning · Computer Science 2025-10-21 Vasily Ilin , Peter Sushko , Jingwei Hu

The unadjusted Langevin algorithm is commonly used to sample probability distributions in extremely high-dimensional settings. However, existing analyses of the algorithm for strongly log-concave distributions suggest that, as the dimension…

Machine Learning · Statistics 2025-09-05 Yifan Chen , Xiaoou Cheng , Jonathan Niles-Weed , Jonathan Weare

We study the problem of sampling from a distribution $\mu$ with density $\propto e^{-V}$ for some potential function $V:\mathbb R^d\to \mathbb R$ with query access to $V$ and $\nabla V$. We start with the following standard assumptions: (1)…

Data Structures and Algorithms · Computer Science 2026-02-10 Yuchen He , Zhehan Lei , Jianan Shao , Chihao Zhang

We discrete the ergodic semilinear stochastic partial differential equations in space dimension $d \leq 3$ with additive noise, spatially by a spectral Galerkin method and temporally by an exponential Euler scheme. It is shown that both the…

Numerical Analysis · Mathematics 2020-06-16 Ziheng Chen , Siqing Gan , Xiaojie Wang

In this paper, we propose a new numerical method for the underdamped Langevin diffusion (ULD) and present a non-asymptotic analysis of its sampling error in the 2-Wasserstein distance when the $d$-dimensional target distribution…

Machine Learning · Statistics 2025-08-25 Maximilian Scott , Dáire O'Kane , Andraž Jelinčič , James Foster

We introduce a novel and efficient algorithm called the stochastic approximate gradient descent (SAGD), as an alternative to the stochastic gradient descent for cases where unbiased stochastic gradients cannot be trivially obtained.…

Machine Learning · Computer Science 2020-02-14 Yixuan Qiu , Xiao Wang

In this paper, we analyse a proximal method based on the idea of forward-backward splitting for sampling from distributions with densities that are not necessarily smooth. In particular, we study the non-asymptotic properties of the…

Numerical Analysis · Mathematics 2022-01-25 Armin Eftekhari , Luis Vargas , Konstantinos Zygalakis

We consider the problem of sampling from constrained distributions, which has posed significant challenges to both non-asymptotic analysis and algorithmic design. We propose a unified framework, which is inspired by the classical mirror…

Machine Learning · Computer Science 2021-01-01 Ya-Ping Hsieh , Ali Kavis , Paul Rolland , Volkan Cevher

We study the mixing time of Metropolis-Adjusted Langevin algorithm (MALA) for sampling a target density on $\mathbb{R}^d$. We assume that the target density satisfies $\psi_\mu$-isoperimetry and that the operator norm and trace of its…

Machine Learning · Statistics 2023-06-09 Yuansi Chen , Khashayar Gatmiry

We study multiscale integrator numerical schemes for a class of stiff stochastic differential equations (SDEs). We consider multiscale SDEs with potentially multiple attractors that behave as diffusions on graphs as the stiffness parameter…

Numerical Analysis · Mathematics 2018-10-10 Jianfeng Lu , Konstantinos Spiliopoulos

In this work we develop a scalable computational framework for the solution of PDE-constrained optimal control under high-dimensional uncertainty. Specifically, we consider a mean-variance formulation of the control objective and employ a…

Optimization and Control · Mathematics 2019-03-27 Peng Chen , Umberto Villa , Omar Ghattas

This paper presents a novel stochastic optimisation methodology to perform empirical Bayesian inference in semi-blind image deconvolution problems. Given a blurred image and a parametric class of possible operators, the proposed…

Applications · Statistics 2024-03-12 Charlesquin Kemajou Mbakam , Marcelo Pereyra , Jean-François Giovannelli