中文
相关论文

相关论文: Underdamped Langevin MCMC: A non-asymptotic analys…

200 篇论文

A new methodology is presented for the construction of control variates to reduce the variance of additive functionals of Markov Chain Monte Carlo (MCMC) samplers. Our control variates are definedthrough the minimization of the asymptotic…

统计方法学 · 统计学 2019-07-09 Nicolas Brosse , Alain Durmus , Sean Meyn , Eric Moulines , Anand Radhakrishnan

The randomized midpoint Langevin Monte Carlo (RLMC), introduced by Shen and Lee (2019), is a variant of classical Unadjusted Langevin Algorithm. It was shown in the literature that the RLMC is an efficient algorithm for approximating…

统计理论 · 数学 2025-11-18 Ruinan Li , Tian Shen , Zhonggen Su

We introduce Markov chain Monte Carlo (MCMC) algorithms based on numerical approximations of piecewise-deterministic Markov processes obtained with the framework of splitting schemes. We present unadjusted as well as adjusted algorithms,…

概率论 · 数学 2025-11-04 Andrea Bertazzi , Paul Dobson , Pierre Monmarché

Sampling logconcave functions arising in statistics and machine learning has been a subject of intensive study. Recent developments include analyses for Langevin dynamics and Hamiltonian Monte Carlo (HMC). While both approaches have…

数据结构与算法 · 计算机科学 2018-12-18 Yin Tat Lee , Zhao Song , Santosh S. Vempala

We consider the constrained sampling problem where the goal is to sample from a target distribution on a constrained domain. We propose skew-reflected non-reversible Langevin dynamics (SRNLD), a continuous-time stochastic differential…

机器学习 · 计算机科学 2025-04-16 Hengrong Du , Qi Feng , Changwei Tu , Xiaoyu Wang , Lingjiong Zhu

We provide a new convergence analysis of stochastic gradient Langevin dynamics (SGLD) for sampling from a class of distributions that can be non-log-concave. At the core of our approach is a novel conductance analysis of SGLD using an…

机器学习 · 计算机科学 2021-02-24 Difan Zou , Pan Xu , Quanquan Gu

The Stochastic Gradient Langevin Dynamics (SGLD) are popularly used to approximate Bayesian posterior distributions in statistical learning procedures with large-scale data. As opposed to many usual Markov chain Monte Carlo (MCMC)…

机器学习 · 统计学 2024-04-30 Kexin Jin , Chenguang Liu , Jonas Latz

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that allows to sample high dimensional probability measures. It relies on the integration of the Hamiltonian dynamics to propose a move which is then accepted or rejected…

数值分析 · 数学 2023-08-08 Tony Lelièvre , Régis Santet , Gabriel Stoltz

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) algorithm for estimating expectations with respect to continuous un-normalized probability distributions. MCMC estimators typically have higher variance than…

统计计算 · 统计学 2020-03-04 Dan Piponi , Matthew D. Hoffman , Pavel Sountsov

Standard Markov chain Monte Carlo methods struggle to explore distributions that are concentrated in the neighbourhood of low-dimensional structures. These pathologies naturally occur in a number of situations. For example, they are common…

统计计算 · 统计学 2021-12-02 Khai Xiang Au , Matthew M. Graham , Alexandre H. Thiery

The unadjusted Langevin algorithm is widely used for sampling from complex high-dimensional distributions. It is well known to be biased, with the bias typically scaling linearly with the dimension when measured in squared Wasserstein…

机器学习 · 统计学 2025-09-11 Daniel Lacker , Fuzhong Zhou

We investigate the theoretical properties of general diffusion (interpolation) paths and their Langevin Monte Carlo implementation, referred to as diffusion annealed Langevin Monte Carlo (DALMC), under weak conditions on the data…

机器学习 · 统计学 2025-02-14 Paula Cordero-Encinar , O. Deniz Akyildiz , Andrew B. Duncan

In this article, we study the problem of sampling from distributions whose densities are not necessarily smooth nor logconcave. We propose a simple Langevin-based algorithm that does not rely on popular but computationally challenging…

机器学习 · 统计学 2025-12-02 Tim Johnston , Iosif Lytras , Nikolaos Makras , Sotirios Sabanis

We sample from a given target distribution by constructing a neural network which maps samples from a simple reference, e.g. the standard normal distribution, to samples from the target. To that end, we propose using a neural network…

机器学习 · 计算机科学 2024-12-11 Charles Miranda , Janina Schütte , David Sommer , Martin Eigel

Hamiltonian Monte Carlo (HMC) has emerged as a powerful Markov Chain Monte Carlo (MCMC) method to sample from complex continuous distributions. However, a fundamental limitation of HMC is that it can not be applied to distributions with…

统计计算 · 统计学 2021-12-10 Guangyao Zhou

Markov chain Monte Carlo (MCMC) provides asymptotically consistent estimates of intractable posterior expectations as the number of iterations tends to infinity. However, in large data applications, MCMC can be computationally expensive per…

统计计算 · 统计学 2023-11-03 Niloy Biswas , Lester Mackey

This work considers the problem of sampling from a probability distribution known up to a normalization constant while satisfying a set of statistical constraints specified by the expected values of general nonlinear functions. This problem…

机器学习 · 统计学 2025-01-08 Luiz F. O. Chamon , Mohammad Reza Karimi , Anna Korba

Recent works have derived non-asymptotic upper bounds for convergence of underdamped Langevin MCMC. We revisit these bound and consider introducing scaling terms in the underlying underdamped Langevin equation. In particular, we provide…

机器学习 · 统计学 2019-12-09 Tim Zajic

Langevin Monte Carlo (LMC) is a popular Markov chain Monte Carlo sampling method. One drawback is that it requires the computation of the full gradient at each iteration, an expensive operation if the dimension of the problem is high. We…

机器学习 · 统计学 2020-10-06 Zhiyan Ding , Qin Li , Jianfeng Lu , Stephen J. Wright

Bayesian inference in the presence of an intractable likelihood function is computationally challenging. When following a Markov chain Monte Carlo (MCMC) approach to approximate the posterior distribution in this context, one typically…

统计方法学 · 统计学 2019-10-03 Johan Alenlöv , Arnaud Doucet , Fredrik Lindsten