中文
相关论文

相关论文: Towards a Complete Analysis of Langevin Monte Carl…

200 篇论文

Langevin Monte Carlo (LMC) is a popular Bayesian sampling method. For the log-concave distribution function, the method converges exponentially fast, up to a controllable discretization error. However, the method requires the evaluation of…

机器学习 · 统计学 2025-03-07 Zhiyan Ding , Qin Li

Discretization of continuous-time diffusion processes is a widely recognized method for sampling. However, the canonical Euler Maruyama discretization of the Langevin diffusion process, referred as Unadjusted Langevin Algorithm (ULA),…

统计计算 · 统计学 2021-07-28 Dao Nguyen , Xin Dang , Yixin Chen

The randomized midpoint Langevin Monte Carlo (RLMC), introduced by Shen and Lee (2019), is a variant of classical Unadjusted Langevin Algorithm. It was shown in the literature that the RLMC is an efficient algorithm for approximating…

统计理论 · 数学 2025-11-18 Ruinan Li , Tian Shen , Zhonggen Su

We investigate the use of a certain class of functional inequalities known as weak Poincar\'e inequalities to bound convergence of Markov chains to equilibrium. We show that this enables the straightforward and transparent derivation of…

统计计算 · 统计学 2024-09-25 Christophe Andrieu , Anthony Lee , Sam Power , Andi Q. Wang

We propose a Markov chain Monte Carlo (MCMC) algorithm based on third-order Langevin dynamics for sampling from distributions with log-concave and smooth densities. The higher-order dynamics allow for more flexible discretization schemes,…

机器学习 · 统计学 2020-05-27 Wenlong Mou , Yi-An Ma , Martin J. Wainwright , Peter L. Bartlett , Michael I. Jordan

In this paper, we study the problem of sampling from log-concave distributions supported on convex, compact sets, with a particular focus on the randomized midpoint discretization of both vanilla and kinetic Langevin diffusions in this…

机器学习 · 统计学 2025-05-27 Yifeng Yu , Lu Yu

It is of significant interest in many applications to sample from a high-dimensional target distribution $\pi$ with the density $\pi(\text{d} x) \propto e^{-U(x)} (\text{d} x) $, based on the temporal discretization of the Langevin…

数值分析 · 数学 2025-01-30 Chenxu Pang , Xiaojie Wang , Yue Wu

The task of sampling from a high-dimensional distribution $\pi$ on $\R^d$ is a fundamental algorithmic problem with applications throughout statistics, engineering, and the sciences. Consider the Langevin diffusion on $\R^d$ \begin{align*}…

统计理论 · 数学 2025-11-18 Tian Shen , Zhonggen Su

The problem of sampling according to the probability distribution minimizing a given free energy, using interacting particles unadjusted kinetic Langevin Monte Carlo, is addressed. In this setting, three sources of error arise, related to…

概率论 · 数学 2024-12-05 Pierre Monmarché , Katharina Schuh

We study sampling from a target distribution ${\nu_* = e^{-f}}$ using the unadjusted Langevin Monte Carlo (LMC) algorithm. For any potential function $f$ whose tails behave like ${\|x\|^\alpha}$ for ${\alpha \in [1,2]}$, and has…

机器学习 · 统计学 2020-05-28 Murat A. Erdogdu , Rasa Hosseinzadeh

In the first part of this paper we study approximations of trajectories of Piecewise Deter-ministic Processes (PDP) when the flow is not explicit by the thinning method. We also establish a strong error estimate for PDPs as well as a weak…

概率论 · 数学 2022-02-10 Vincent Lemaire , Michèle Thieullen , Nicolas Thomas

In order to solve tasks like uncertainty quantification or hypothesis tests in Bayesian imaging inverse problems, we often have to draw samples from the arising posterior distribution. For the usually log-concave but high-dimensional…

统计计算 · 统计学 2025-01-23 Matthias J. Ehrhardt , Lorenz Kuger , Carola-Bibiane Schönlieb

The possibility of different interpretations of the stochastic term (or calculi) in the overdamped Langevin equation for the motion of a particle in an inhomogeneous medium is often referred to as the "Ito--Stratonovich dilemma," although…

统计力学 · 物理学 2012-08-28 Hendrick W. de Haan , Mykyta V. Chubynsky , Gary W. Slater

Discretization of continuous-time diffusion processes is a widely recognized method for sampling. However, it seems to be a considerable restriction when the potentials are often required to be smooth (gradient Lipschitz). This paper…

统计计算 · 统计学 2022-02-23 Dao Nguyen

Sampling from a high-dimensional distribution is a fundamental task in statistics, engineering, and the sciences. A canonical approach is the Langevin Algorithm, i.e., the Markov chain for the discretized Langevin Diffusion. This is the…

统计理论 · 数学 2022-11-01 Jason M. Altschuler , Kunal Talwar

It is well known in many settings that reversible Langevin diffusions in confining potentials converge to equilibrium exponentially fast. Adding irreversible perturbations to the drift of a Langevin diffusion that maintain the same…

统计方法学 · 统计学 2019-07-02 Michela Ottobre , Natesh S. Pillai , Konstantinos Spiliopoulos

The technique of modifying the geometry of a problem from Euclidean to Hessian metric has proved to be quite effective in optimization, and has been the subject of study for sampling. The Mirror Langevin Diffusion (MLD) is a sampling…

数据结构与算法 · 计算机科学 2021-10-12 Ruilin Li , Molei Tao , Santosh S. Vempala , Andre Wibisono

This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a stochastic relaxed…

In this paper, we revisit the recently established theoretical guarantees for the convergence of the Langevin Monte Carlo algorithm of sampling from a smooth and (strongly) log-concave density. We improve the existing results when the…

统计理论 · 数学 2017-07-31 Arnak S. Dalalyan

A key task in Bayesian machine learning is sampling from distributions that are only specified up to a partition function (i.e., constant of proportionality). One prevalent example of this is sampling posteriors in parametric distributions,…

机器学习 · 计算机科学 2020-09-10 Rong Ge , Holden Lee , Andrej Risteski