中文
相关论文

相关论文: Underdamped Langevin MCMC: A non-asymptotic analys…

200 篇论文

This article is concerned with sampling from Gibbs distributions $\pi(x)\propto e^{-U(x)}$ using Markov chain Monte Carlo methods. In particular, we investigate Langevin dynamics in the continuous- and the discrete-time setting for such…

数值分析 · 数学 2026-05-25 Lorenz Fruehwirth , Andreas Habring

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) method for performing approximate inference in complex probabilistic models of continuous variables. In common with many MCMC methods, however, the standard HMC…

统计计算 · 统计学 2017-04-12 Matthew M. Graham , Amos J. Storkey

Markov Chain Monte Carlo (MCMC) requires to evaluate the full data likelihood at different parameter values iteratively and is often computationally infeasible for large data sets. In this paper, we propose to approximate the log-likelihood…

统计方法学 · 统计学 2020-05-26 Guanyu Hu , HaiYing Wang

We study Bayesian inversion for a model elliptic PDE with unknown diffusion coefficient. We provide complexity analyses of several Markov Chain-Monte Carlo (MCMC) methods for the efficient numerical evaluation of expectations under the…

数值分析 · 数学 2013-05-01 Viet Ha Hoang , Christoph Schwab , Andrew M. Stuart

Sampling from a log-concave distribution function is one core problem that has wide applications in Bayesian statistics and machine learning. While most gradient free methods have slow convergence rate, the Langevin Monte Carlo (LMC) that…

机器学习 · 统计学 2020-10-23 Zhiyan Ding , Qin Li

In this paper, we focus on non-asymptotic bounds related to the Euler scheme of an ergodic diffusion with a possibly multiplicative diffusion term (non-constant diffusion coefficient). More precisely, the objective of this paper is to…

概率论 · 数学 2022-09-23 Gilles Pages , Fabien Panloup

Markov Chain Monte Carlo (MCMC) methods are employed to sample from a given distribution of interest, whenever either the distribution does not exist in closed form, or, if it does, no efficient method to simulate an independent sample from…

统计计算 · 统计学 2008-07-22 Ioana A. Cosma , Masoud Asgharian

Classically, the continuous-time Langevin diffusion converges exponentially fast to its stationary distribution $\pi$ under the sole assumption that $\pi$ satisfies a Poincar\'e inequality. Using this fact to provide guarantees for the…

统计理论 · 数学 2024-07-11 Sinho Chewi , Murat A. Erdogdu , Mufan Bill Li , Ruoqi Shen , Matthew Zhang

In the first part of this paper we study approximations of trajectories of Piecewise Deter-ministic Processes (PDP) when the flow is not explicit by the thinning method. We also establish a strong error estimate for PDPs as well as a weak…

概率论 · 数学 2022-02-10 Vincent Lemaire , Michèle Thieullen , Nicolas Thomas

This article is concerned with the multilevel Monte Carlo (MLMC) methods for approximating expectations of some functions of the solution to the Heston 3/2-model from mathematical finance, which takes values in $(0, \infty)$ and possesses…

数值分析 · 数学 2024-03-12 Xiaojuan Wu , Siqing Gan

We study and develop multilevel methods for the numerical approximation of a log-concave probability $\pi$ on $\mathbb{R}^d$, based on (over-damped) Langevin diffusion. In the continuity of \cite{art:egeapanloup2021multilevel} concentrated…

数值分析 · 数学 2023-01-24 Maxime Egéa

Approximate Bayesian inference estimates descriptors of an intractable target distribution - in essence, an optimization problem within a family of distributions. For example, Langevin dynamics (LD) extracts asymptotically exact samples…

机器学习 · 统计学 2021-10-11 Zheyang Shen , Markus Heinonen , Samuel Kaski

A randomized time integrator is suggested for unadjusted Hamiltonian Monte Carlo (uHMC) which involves a very minor modification to the usual Verlet time integrator, and hence, is easy to implement. For target distributions of the form…

概率论 · 数学 2025-03-03 Nawaf Bou-Rabee , Milo Marsden

The problem of sampling according to the probability distribution minimizing a given free energy, using interacting particles unadjusted kinetic Langevin Monte Carlo, is addressed. In this setting, three sources of error arise, related to…

概率论 · 数学 2024-12-05 Pierre Monmarché , Katharina Schuh

We study a sequential Monte Carlo algorithm to sample from the Gibbs measure with a non-convex energy function at a low temperature. We use the practical and popular geometric annealing schedule, and use a Langevin diffusion at each…

统计理论 · 数学 2026-01-13 Ruiyu Han , Gautam Iyer , Dejan Slepčev

As an important Markov Chain Monte Carlo (MCMC) method, stochastic gradient Langevin dynamics (SGLD) algorithm has achieved great success in Bayesian learning and posterior sampling. However, SGLD typically suffers from slow convergence…

机器学习 · 计算机科学 2019-11-05 Bao Wang , Difan Zou , Quanquan Gu , Stanley Osher

Hamiltonian Monte Carlo is a prominent Markov Chain Monte Carlo algorithm, which employs symplectic integrators to sample from high dimensional target distributions in many applications, such as statistical mechanics, Bayesian statistics…

数值分析 · 数学 2025-02-13 Geoffrey McGregor , Andy T. S. Wan

Tuning the durations of the Hamiltonian flow in Hamiltonian Monte Carlo (also called Hybrid Monte Carlo) (HMC) involves a tradeoff between computational cost and sampling quality, which is typically challenging to resolve in a satisfactory…

概率论 · 数学 2017-09-08 Nawaf Bou-Rabee , Jesus Maria Sanz-Serna

Standard first-order Langevin algorithms such as the unadjusted Langevin algorithm (ULA) are obtained by discretizing the Langevin diffusion and are widely used for sampling in machine learning because they scale to high dimensions and…

机器学习 · 统计学 2025-09-25 Mert Gurbuzbalaban , Hoang M. Nguyen , Xicheng Zhang , Lingjiong Zhu

We investigate a weighted Multilevel Richardson-Romberg extrapolation for the ergodic approximation of invariant distributions of diffusions adapted from the one introduced in~[Lemaire-Pag\`es, 2013] for regular Monte Carlo simulation. In a…

概率论 · 数学 2016-07-05 Gilles Pagès , Fabien Panloup