English
Related papers

Related papers: On sampling from a log-concave density using kinet…

200 papers

This paper proposes a new sampling scheme based on Langevin dynamics that is applicable within pseudo-marginal and particle Markov chain Monte Carlo algorithms. We investigate this algorithm's theoretical properties under standard…

Methodology · Statistics 2016-05-30 Christopher Nemeth , Chris Sherlock , Paul Fearnhead

We study Langevin-type algorithms for sampling from Gibbs distributions such that the potentials are dissipative and their weak gradients have finite moduli of continuity not necessarily convergent to zero. Our main result is a…

Statistics Theory · Mathematics 2024-03-01 Shogo Nakakita

We describe a new MCMC method optimized for the sampling of probability measures on Hilbert space which have a density with respect to a Gaussian; such measures arise in the Bayesian approach to inverse problems, and in conditioned…

Probability · Mathematics 2014-04-04 Michela Ottobre , Natesh S. Pillai , Frank J. Pinski , Andrew M. Stuart

Markov chains and diffusion processes are indispensable tools in machine learning and statistics that are used for inference, sampling, and modeling. With the growth of large-scale datasets, the computational cost associated with simulating…

Statistics Theory · Mathematics 2017-08-31 Jonathan H. Huggins , James Zou

This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a stochastic relaxed…

This paper presents a new Metropolis-adjusted Langevin algorithm (MALA) that uses convex analysis to simulate efficiently from high-dimensional densities that are log-concave, a class of probability distributions that is widely used in…

Methodology · Statistics 2015-04-06 Marcelo Pereyra

Given a Lipschitz or smooth convex function $\, f:K \to \mathbb{R}$ for a bounded polytope $K \subseteq \mathbb{R}^d$ defined by $m$ inequalities, we consider the problem of sampling from the log-concave distribution $\pi(\theta) \propto…

Data Structures and Algorithms · Computer Science 2022-11-16 Oren Mangoubi , Nisheeth K. Vishnoi

Overdamped Langevin dynamics are reversible stochastic differential equations which are commonly used to sample probability measures in high-dimensional spaces, such as the ones appearing in computational statistical physics and Bayesian…

Numerical Analysis · Mathematics 2025-02-10 Tony Lelièvre , Grigorios A. Pavliotis , Geneviève Robin , Régis Santet , Gabriel Stoltz

Bayesian methods of sampling from a posterior distribution are becoming increasingly popular due to their ability to precisely display the uncertainty of a model fit. Classical methods based on iterative random sampling and posterior…

Machine Learning · Statistics 2022-11-04 Jacopo Guidolin , Vyacheslav Kungurtsev , Ondřej Kuželka

The random splitting Langevin Monte Carlo could mitigate the first order bias in Langevin Monte Carlo with little extra work compared other high order schemes. We develop in this work an analysis framework for the sampling error under…

Numerical Analysis · Mathematics 2025-10-10 Lei Li , Chen Wang , Mengchao Wang

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

Machine Learning · Computer Science 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

We consider the constrained sampling problem where the goal is to sample from a target distribution on a constrained domain. We propose skew-reflected non-reversible Langevin dynamics (SRNLD), a continuous-time stochastic differential…

Machine Learning · Computer Science 2025-04-16 Hengrong Du , Qi Feng , Changwei Tu , Xiaoyu Wang , Lingjiong Zhu

Langevin algorithms are gradient descent methods augmented with additive noise, and are widely used in Markov Chain Monte Carlo (MCMC) sampling, optimization, and machine learning. In recent years, the non-asymptotic analysis of Langevin…

Machine Learning · Computer Science 2023-01-10 Yuping Zheng , Andrew Lamperski

Discretization of continuous-time diffusion processes is a widely recognized method for sampling. However, the canonical Euler Maruyama discretization of the Langevin diffusion process, referred as Unadjusted Langevin Algorithm (ULA),…

Computation · Statistics 2021-07-28 Dao Nguyen , Xin Dang , Yixin Chen

The unadjusted Langevin algorithm is widely used for sampling from complex high-dimensional distributions. It is well known to be biased, with the bias typically scaling linearly with the dimension when measured in squared Wasserstein…

Machine Learning · Statistics 2025-09-11 Daniel Lacker , Fuzhong Zhou

We study the Riemannian Langevin Algorithm for the problem of sampling from a distribution with density $\nu$ with respect to the natural measure on a manifold with metric $g$. We assume that the target density satisfies a log-Sobolev…

Machine Learning · Computer Science 2022-04-25 Khashayar Gatmiry , Santosh S. Vempala

Langevin Monte Carlo (LMC) and its stochastic gradient versions are powerful algorithms for sampling from complex high-dimensional distributions. To sample from a distribution with density $\pi(\theta)\propto \exp(-U(\theta)) $, LMC…

Computation · Statistics 2023-09-25 Sifan Liu

For the task of sampling from a density $\pi \propto \exp(-V)$ on $\mathbb{R}^d$, where $V$ is possibly non-convex but $L$-gradient Lipschitz, we prove that averaged Langevin Monte Carlo outputs a sample with $\varepsilon$-relative Fisher…

Statistics Theory · Mathematics 2022-02-11 Krishnakumar Balasubramanian , Sinho Chewi , Murat A. Erdogdu , Adil Salim , Matthew Zhang

In order to solve tasks like uncertainty quantification or hypothesis tests in Bayesian imaging inverse problems, we often have to draw samples from the arising posterior distribution. For the usually log-concave but high-dimensional…

Computation · Statistics 2025-01-23 Matthias J. Ehrhardt , Lorenz Kuger , Carola-Bibiane Schönlieb

Langevin Monte Carlo (LMC) is a popular Bayesian sampling method. For the log-concave distribution function, the method converges exponentially fast, up to a controllable discretization error. However, the method requires the evaluation of…

Machine Learning · Statistics 2025-03-07 Zhiyan Ding , Qin Li