English
Related papers

Related papers: Exponential ergodicity of mirror-Langevin diffusio…

200 papers

We propose a new discretization of the mirror-Langevin diffusion and give a crisp proof of its convergence. Our analysis uses relative convexity/smoothness and self-concordance, ideas which originated in convex optimization, together with a…

Statistics Theory · Mathematics 2021-10-26 Kwangjun Ahn , Sinho Chewi

Discretized Langevin diffusions are efficient Monte Carlo methods for sampling from high dimensional target densities that are log-Lipschitz-smooth and (strongly) log-concave. In particular, the Euclidean Langevin Monte Carlo sampling…

Statistics Theory · Mathematics 2020-02-12 Kelvin Shuangjian Zhang , Gabriel Peyré , Jalal Fadili , Marcelo Pereyra

In this paper, we study the problem of sampling from log-concave distributions supported on convex, compact sets, with a particular focus on the randomized midpoint discretization of both vanilla and kinetic Langevin diffusions in this…

Machine Learning · Statistics 2025-05-27 Yifeng Yu , Lu Yu

We study the problem of sampling from a distribution $\target$ using the Langevin Monte Carlo algorithm and provide rate of convergences for this algorithm in terms of Wasserstein distance of order $2$. Our result holds as long as the…

Computation · Statistics 2016-07-04 Thomas Bonis

We examine the Langevin diffusion confined to a closed, convex domain $D\subset\mathbb{R}^d$, represented as a reflected stochastic differential equation. We introduce a sequence of penalized stochastic differential equations and prove that…

Probability · Mathematics 2026-01-22 Tarika Mane , Amine Boukardagha

The technique of modifying the geometry of a problem from Euclidean to Hessian metric has proved to be quite effective in optimization, and has been the subject of study for sampling. The Mirror Langevin Diffusion (MLD) is a sampling…

Data Structures and Algorithms · Computer Science 2021-10-12 Ruilin Li , Molei Tao , Santosh S. Vempala , Andre Wibisono

Langevin diffusion processes and their discretizations are often used for sampling from a target density. The most convenient framework for assessing the quality of such a sampling scheme corresponds to smooth and strongly log-concave…

Probability · Mathematics 2018-12-27 Arnak S. Dalalyan , Lionel Riou-Durand

We study the asymptotic behavior of a weighted ultrafast diffusion PDE on the real line, with a log-concave and log-lipschitz weight, and prove exponential convergence to equilibrium. This result goes beyond the compact setting studied in…

Analysis of PDEs · Mathematics 2025-07-18 Max Fathi , Mikaela Iacobelli

We provide convergence guarantees in Wasserstein distance for a variety of variance-reduction methods: SAGA Langevin diffusion, SVRG Langevin diffusion and control-variate underdamped Langevin diffusion. We analyze these methods under a…

Machine Learning · Statistics 2018-02-16 Niladri S. Chatterji , Nicolas Flammarion , Yi-An Ma , Peter L. Bartlett , Michael I. Jordan

This article is concerned with sampling from Gibbs distributions $\pi(x)\propto e^{-U(x)}$ using Markov chain Monte Carlo methods. In particular, we investigate Langevin dynamics in the continuous- and the discrete-time setting for such…

Numerical Analysis · Mathematics 2026-05-25 Lorenz Fruehwirth , Andreas Habring

Consider a reflected jump-diffusion on the positive half-line. Assume it is stochastically ordered. We apply the theory of Lyapunov functions and find explicit estimates for the rate of exponential convergence to the stationary…

Probability · Mathematics 2016-11-16 Andrey Sarantsev

We propose a method for sampling from Gibbs distributions of the form $\pi(x)\propto\exp(-U(x))$ by considering a family $(\pi^{t})_t$ of approximations of the target density which is such that $\pi^{t}$ exhibits favorable properties for…

Optimization and Control · Mathematics 2025-10-10 Andreas Habring , Alexander Falk , Martin Zach , Thomas Pock

An Euler discretization of the Langevin diffusion is known to converge to the global minimizers of certain convex and non-convex optimization problems. We show that this property holds for any suitably smooth diffusion and that different…

Machine Learning · Statistics 2019-12-30 Murat A. Erdogdu , Lester Mackey , Ohad Shamir

Langevin diffusion is a commonly used tool for sampling from a given distribution. In this work, we establish that when the target density $p^*$ is such that $\log p^*$ is $L$ smooth and $m$ strongly convex, discrete Langevin diffusion…

Machine Learning · Statistics 2017-11-02 Xiang Cheng , Peter Bartlett

We consider the problem of sampling from constrained distributions, which has posed significant challenges to both non-asymptotic analysis and algorithmic design. We propose a unified framework, which is inspired by the classical mirror…

Machine Learning · Computer Science 2021-01-01 Ya-Ping Hsieh , Ali Kavis , Paul Rolland , Volkan Cevher

We present a new random walk for uniformly sampling high-dimensional convex bodies. It achieves state-of-the-art runtime complexity with stronger guarantees on the output than previously known, namely in R\'enyi divergence (which implies…

Data Structures and Algorithms · Computer Science 2026-03-23 Yunbum Kook , Santosh S. Vempala , Matthew S. Zhang

We revisit the problem of sampling from a target distribution that has a smooth strongly log-concave density everywhere in $\mathbb R^p$. In this context, if no additional density information is available, the randomized midpoint…

Statistics Theory · Mathematics 2023-06-19 Lu Yu , Avetik Karagulyan , Arnak Dalalyan

Langevin Dynamics has been extensively employed in global non-convex optimization due to the concentration of its stationary distribution around the global minimum of the potential function at low temperatures. In this paper, we propose to…

Optimization and Control · Mathematics 2023-05-22 Ryo Fujino

Discretization of continuous-time diffusion processes is a widely recognized method for sampling. However, the canonical Euler Maruyama discretization of the Langevin diffusion process, referred as Unadjusted Langevin Algorithm (ULA),…

Computation · Statistics 2021-07-28 Dao Nguyen , Xin Dang , Yixin Chen

Classically, the continuous-time Langevin diffusion converges exponentially fast to its stationary distribution $\pi$ under the sole assumption that $\pi$ satisfies a Poincar\'e inequality. Using this fact to provide guarantees for the…

Statistics Theory · Mathematics 2024-07-11 Sinho Chewi , Murat A. Erdogdu , Mufan Bill Li , Ruoqi Shen , Matthew Zhang
‹ Prev 1 2 3 10 Next ›