English
Related papers

Related papers: The Tamed Unadjusted Langevin Algorithm

200 papers

The approximation of invariant measures for nonlinear ergodic stochastic differential equations (SDEs) is a central problem in scientific computing, with important applications in stochastic sampling, physics, and ecology. We first propose…

Numerical Analysis · Mathematics 2025-11-18 Shan Huang , Xiaoyue Li

This article relaxes the integrability condition imposed in the literature for the robust $\alpha$-stable central limit theorem under sublinear expectation. Specifically, for $\alpha \in(0,1]$, we prove that the normalized sums of i.i.d.…

Probability · Mathematics 2023-01-20 Lianzi Jiang , Gechun Liang

Stochastic approximation (SA) is a method for finding the root of an operator perturbed by noise. There is a rich literature establishing the asymptotic normality of rescaled SA iterates under fairly mild conditions. However, these…

Machine Learning · Statistics 2026-02-17 Shaan Ul Haque , Zedong Wang , Zixuan Zhang , Siva Theja Maguluri

The Metropolis-adjusted Langevin (MALA) algorithm is a sampling algorithm which makes local moves by incorporating information about the gradient of the logarithm of the target density. In this paper we study the efficiency of MALA on a…

Probability · Mathematics 2012-11-29 Natesh S. Pillai , Andrew M. Stuart , Alexandre H. Thiéry

The Metropolis-Adjusted Langevin Algorithm (MALA), originally introduced to sample exactly the invariant measure of certain stochastic differential equations (SDE) on infinitely long time intervals, can also be used to approximate pathwise…

Probability · Mathematics 2010-08-23 Nawaf Bou-Rabee , Martin Hairer , Eric Vanden-Eijnden

We extend the taming techniques for explicit Euler approximations of stochastic differential equations (SDEs) driven by L\'evy noise with super-linearly growing drift coefficients. Strong convergence results are presented for the case of…

Probability · Mathematics 2015-01-23 Konstantinos Dareiotis , Chaman Kumar , Sotirios Sabanis

The Langevin Markov chain algorithms are widely deployed methods to sample from distributions in challenging high-dimensional and non-convex statistics and machine learning applications. Despite this, current bounds for the Langevin…

Data Structures and Algorithms · Computer Science 2019-04-10 Oren Mangoubi , Nisheeth K. Vishnoi

We study a sampling problem whose target distribution is $\pi \propto \exp(-f-r)$ where the data fidelity term $f$ is Lipschitz smooth while the regularizer term $r=r_1-r_2$ is a non-smooth difference-of-convex (DC) function, i.e.,…

Machine Learning · Computer Science 2026-05-21 Hoang Phuc Hau Luu , Zhongjian Wang

We propose a novel method for sampling from unnormalized Boltzmann densities based on a probability flow ordinary differential equation (ODE) derived from linear stochastic interpolants. The key innovation of our approach is the use of a…

Numerical Analysis · Mathematics 2026-03-12 Chenguang Duan , Yuling Jiao , Gabriele Steidl , Christian Wald , Jerry Zhijian Yang , Ruizhe Zhang

The method to derive uniform bounds with Gaussian and Rademacher complexities is extended to the case where the sample average is replaced by a nonlinear statistic. Tight bounds are obtained for U-statistics, smoothened L-statistics and…

Statistics Theory · Mathematics 2019-05-13 Andreas Maurer , Massimiliano Pontil

This paper extends the link between stochastic approximation (SA) theory and randomized urn models developed in Laruelle, Pag{\`e}s (2013), and their applications to clinical trials introduced in Bai, HU (1999,2005) and Bai, Hu, Shen…

Probability · Mathematics 2018-05-16 Sophie Laruelle , Gilles Pagès

Obtaining stable diffusion-based samplers in high- and infinite-dimensional settings is challenging because errors can accumulate across high-frequency coordinates and make the dynamics unstable under refinement of the finite-dimensional…

Machine Learning · Statistics 2026-05-19 Lorenzo Baldassari , Josselin Garnier , Knut Solna , Maarten V. de Hoop

We study the problem of sampling from a distribution $\target$ using the Langevin Monte Carlo algorithm and provide rate of convergences for this algorithm in terms of Wasserstein distance of order $2$. Our result holds as long as the…

Computation · Statistics 2016-07-04 Thomas Bonis

We propose two Euler-Maruyama (EM) type numerical schemes in order to approximate the invariant measure of a stochastic differential equation (SDE) driven by an $\alpha$-stable L\'evy process ($1<\alpha<2$): an approximation scheme with the…

Probability · Mathematics 2023-06-21 Peng Chen , Changsong Deng , Rene Schilling , Lihu Xu

We present an improved analysis of the Euler-Maruyama discretization of the Langevin diffusion. Our analysis does not require global contractivity, and yields polynomial dependence on the time horizon. Compared to existing approaches, we…

Probability · Mathematics 2019-11-05 Wenlong Mou , Nicolas Flammarion , Martin J. Wainwright , Peter L. Bartlett

Acceleration is a celebrated cornerstone of convex optimization, enabling gradient-based algorithms to converge sublinearly in the condition number. A major open question is whether an analogous acceleration phenomenon is possible for…

Probability · Mathematics 2026-04-01 Jason M. Altschuler , Sinho Chewi , Matthew S. Zhang

Underdamped Langevin dynamics (ULD) is a widely-used sampler for Gibbs distributions $\pi\propto e^{-V}$, and is often empirically effective in high dimensions. However, existing non-asymptotic convergence guarantees for discretized ULD…

Machine Learning · Computer Science 2026-03-04 Shiyuan Zhang , Qiwei Di , Xuheng Li , Quanquan Gu

We present a novel method for drawing samples from Gibbs distributions with densities of the form $\pi(x) \propto \exp(-U(x))$. The method accelerates the unadjusted Langevin algorithm by introducing an inertia term similar to Polyak's…

Numerical Analysis · Mathematics 2025-10-09 Alexander Falk , Andreas Habring , Christoph Griesbacher , Thomas Pock

In this paper, we first provide a criterion on uniform large deviation principles (ULDP) of stochastic differential equations under Lyapunov conditions on the coefficients, which can be applied to stochastic systems with coefficients of…

Probability · Mathematics 2024-02-27 Jifa Jiang , Jian Wang , Jianliang Zhai , Tusheng Zhang

Laplace-type results characterize the limit of sequence of measures $(\pi_\varepsilon)_{\varepsilon >0}$ with density w.r.t the Lebesgue measure $(\mathrm{d} \pi_\varepsilon / \mathrm{d} \mathrm{Leb})(x) \propto \exp[-U(x)/\varepsilon]$…

Probability · Mathematics 2026-04-29 Valentin De Bortoli , Agnès Desolneux