English
Related papers

Related papers: Convergence of Reflected Langevin Diffusion for Co…

200 papers

Consider a reflected diffusion on the positive half-line. We approximate it by solutions of stochastic differential equations using the penalty method: We emulate the "hard barrier" of reflection by a "soft barrier" of a large drift…

Probability · Mathematics 2016-10-17 Cameron Bruggeman , Andrey Sarantsev

We consider contractivity for diffusion semigroups w.r.t. Kantorovich ($L^1$ Wasserstein) distances based on appropriately chosen concave functions. These distances are inbetween total variation and usual Wasserstein distances. It is shown…

Probability · Mathematics 2015-10-20 Andreas Eberle

We address an original approach for the convergence analysis of a finite-volume scheme for the approximation of a stochastic diffusion-convection equation with multiplicative noise in a bounded domain of $\mathbb{R}^d$ (with $d=2$ or $3$)…

Numerical Analysis · Mathematics 2024-02-20 Caroline Bauzet , Kerstin Schmitz , Aleksandra Zimmermann

In this work, we are concerned with existence and uniqueness of invariant measures for path-dependent random diffusions and their time discretizations. The random diffusion here means a diffusion process living in a random environment…

Probability · Mathematics 2017-06-20 Jianhai Bao , Jinghai Shao , Chenggui Yuan

We consider a Markov chain on $\mathbb{R}^d$ with invariant measure $\mu$. We are interested in the rate of convergence of the empirical measures towards the invariant measure with respect to various dual distances, including in particular…

Probability · Mathematics 2022-10-13 Adrian Riekert

We study in this paper a weak approximation to stochastic variance reduced gradient Langevin dynamics by stochastic delay differential equations in Wasserstein-1 distance, and obtain a uniform error bound. Our approach is via a refined…

Probability · Mathematics 2021-12-21 Peng Chen , Jianya Lu , Lihu Xu

This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a stochastic relaxed…

We study the problem of sampling from a distribution $p^*(x) \propto \exp\left(-U(x)\right)$, where the function $U$ is $L$-smooth everywhere and $m$-strongly convex outside a ball of radius $R$, but potentially nonconvex inside this ball.…

Replica exchange stochastic gradient Langevin dynamics (reSGLD) is an effective sampler for non-convex learning in large-scale datasets. However, the simulation may encounter stagnation issues when the high-temperature chain delves too…

Machine Learning · Computer Science 2024-06-04 Haoyang Zheng , Hengrong Du , Qi Feng , Wei Deng , Guang Lin

We study the Riemannian Langevin Algorithm for the problem of sampling from a distribution with density $\nu$ with respect to the natural measure on a manifold with metric $g$. We assume that the target density satisfies a log-Sobolev…

Machine Learning · Computer Science 2022-04-25 Khashayar Gatmiry , Santosh S. Vempala

Langevin diffusion is a commonly used tool for sampling from a given distribution. In this work, we establish that when the target density $p^*$ is such that $\log p^*$ is $L$ smooth and $m$ strongly convex, discrete Langevin diffusion…

Machine Learning · Statistics 2017-11-02 Xiang Cheng , Peter Bartlett

Score-based diffusion models learn to reverse a stochastic differential equation that maps data to noise. However, for complex tasks, numerical error can compound and result in highly unnatural samples. Previous work mitigates this drift…

Machine Learning · Statistics 2023-06-12 Aaron Lou , Stefano Ermon

In this paper, we study a method to sample from a target distribution $\pi$ over $\mathbb{R}^d$ having a positive density with respect to the Lebesgue measure, known up to a normalisation factor. This method is based on the Euler…

Statistics Theory · Mathematics 2016-12-20 Alain Durmus , Eric Moulines

We introduce a new probabilistic approach to quantify convergence to equilibrium for (kinetic) Langevin processes. In contrast to previous analytic approaches that focus on the associated kinetic Fokker-Planck equation, our approach is…

Probability · Mathematics 2018-07-02 Andreas Eberle , Arnaud Guillin , Raphael Zimmer

In this paper, we examine the problem of sampling from log-concave distributions with (possibly) superlinear gradient growth under kinetic (underdamped) Langevin algorithms. Using a carefully tailored taming scheme, we propose two novel…

Probability · Mathematics 2025-12-10 Iosif Lytras , Panayotis Mertikopoulos

Denoising diffusion models have recently emerged as the predominant paradigm for generative modelling on image domains. In addition, their extension to Riemannian manifolds has facilitated a range of applications across the natural…

Machine Learning · Computer Science 2023-11-10 Nic Fishman , Leo Klarner , Emile Mathieu , Michael Hutchinson , Valentin de Bortoli

Sampling from a target distribution is a fundamental problem. Traditional Markov chain Monte Carlo (MCMC) algorithms, such as the unadjusted Langevin algorithm (ULA), derived from the overdamped Langevin dynamics, have been extensively…

Optimization and Control · Mathematics 2024-10-29 Xinzhe Zuo , Stanley Osher , Wuchen Li

In this paper, we investigate a continuous time version of the Stochastic Langevin Monte Carlo method, introduced in [WT11], that incorporates a stochastic sampling step inside the traditional over-damped Langevin diffusion. This method is…

Machine Learning · Statistics 2023-01-10 Marelys Crespo Navas , Sébastien Gadat , Xavier Gendre

In this note, we consider the underdamped Langevin dynamics with invariant measure $\mu(\mathrm{d}x\,\mathrm{d}v) \propto e^{-U(x)-|v|^2/2}\,\mathrm{d}x\,\mathrm{d}v$. Assume that the position marginal $\mu_x(\mathrm{d}x)\propto…

Analysis of PDEs · Mathematics 2026-04-14 Zexi Fan , Bowen Li , Jianfeng Lu

It was shown recently that a Langevin process can be reflected at an energy absorbing boundary. Here, we establish that the law of this reflecting process can be characterized as the unique weak solution to a certain second order stochastic…

Probability · Mathematics 2007-05-23 Jean Bertoin