English
Related papers

Related papers: Convergence of unadjusted Hamiltonian Monte Carlo …

200 papers

Based on a new coupling approach, we prove that the transition step of the Hamiltonian Monte Carlo algorithm is contractive w.r.t. a carefully designed Kantorovich (L1 Wasserstein) distance. The lower bound for the contraction rate is…

Probability · Mathematics 2020-07-30 Nawaf Bou-Rabee , Andreas Eberle , Raphael Zimmer

We derive non-asymptotic quantitative bounds for convergence to equilibrium of the exact preconditioned Hamiltonian Monte Carlo algorithm (pHMC) on a Hilbert space. As a consequence, explicit and dimension-free bounds for pHMC applied to…

Probability · Mathematics 2021-02-26 Nawaf Bou-Rabee , Andreas Eberle

Hamiltonian Monte Carlo and underdamped Langevin Monte Carlo are state-of-the-art methods for taking samples from high-dimensional distributions with a differentiable density function. To generate samples, they numerically integrate…

Computation · Statistics 2025-05-20 Jakob Robnik , Reuben Cohn-Gordon , Uroš Seljak

This paper provides a convergence analysis for generalized Hamiltonian Monte Carlo samplers, a family of Markov Chain Monte Carlo methods based on leapfrog integration of Hamiltonian dynamics and kinetic Langevin diffusion, that encompasses…

Probability · Mathematics 2024-05-14 Evan Camrud , Alain Durmus , Pierre Monmarché , Gabriel Stoltz

Underdamped Langevin dynamics (ULD) is a widely-used sampler for Gibbs distributions $\pi\propto e^{-V}$, and is often empirically effective in high dimensions. However, existing non-asymptotic convergence guarantees for discretized ULD…

Machine Learning · Computer Science 2026-03-04 Shiyuan Zhang , Qiwei Di , Xuheng Li , Quanquan Gu

Existing rigorous convergence guarantees for the Hamiltonian Monte Carlo (HMC) algorithm use Gaussian auxiliary momentum variables, which are crucially symmetrically distributed. We present a novel convergence analysis for HMC utilizing new…

Machine Learning · Statistics 2026-05-12 Soumyadip Ghosh , Yingdong Lu , Tomasz Nowicki

We establish the geometric ergodicity of the preconditioned Hamiltonian Monte Carlo (HMC) algorithm defined on an infinite-dimensional Hilbert space, as developed in [Beskos et al., Stochastic Process. Appl., 2011]. This algorithm can be…

Statistics Theory · Mathematics 2020-03-19 Nathan E. Glatt-Holtz , Cecilia F. Mondaini

We present a nonlinear (in the sense of McKean) generalization of Hamiltonian Monte Carlo (HMC) termed nonlinear HMC (nHMC) capable of sampling from nonlinear probability measures of mean-field type. When the underlying confinement…

Probability · Mathematics 2023-09-22 Nawaf Bou-Rabee , Katharina Schuh

In this article, we consider the preconditioned Hamiltonian Monte Carlo (pHMC) algorithm defined directly on an infinite-dimensional Hilbert space. In this context, and under a condition reminiscent of strong log-concavity of the target…

Probability · Mathematics 2020-11-18 Jakiw Pidstrigach

We provide quantitative upper bounds on the total variation mixing time of the Markov chain corresponding to the unadjusted Hamiltonian Monte Carlo (uHMC) algorithm. For two general classes of models and fixed time discretization step size…

Probability · Mathematics 2022-10-13 Nawaf Bou-Rabee , Andreas Eberle

This article considers the popular MCMC method of unadjusted Langevin Monte Carlo (LMC) and provides a non-asymptotic analysis of its sampling error in 2-Wasserstein distance. The proof is based on a refinement of mean-square analysis in Li…

Machine Learning · Computer Science 2022-02-22 Ruilin Li , Hongyuan Zha , Molei Tao

We propose a methodology to parallelize Hamiltonian Monte Carlo estimators. Our approach constructs a pair of Hamiltonian Monte Carlo chains that are coupled in such a way that they meet exactly after some random number of iterations. These…

Computation · Statistics 2018-08-28 Jeremy Heng , Pierre E. Jacob

This work considers the problem of sampling from a probability distribution known up to a normalization constant while satisfying a set of statistical constraints specified by the expected values of general nonlinear functions. This problem…

Machine Learning · Statistics 2025-01-08 Luiz F. O. Chamon , Mohammad Reza Karimi , Anna Korba

Hamiltonian Monte Carlo (HMC) is an efficient method of simulating smooth distributions and has motivated the widely used No-U-turn Sampler (NUTS) and software Stan. We build on NUTS and the technique of "unbiased sampling" to design HMC…

Computation · Statistics 2022-12-26 George M. Leigh , Amanda R. Northrop

In this article, we analyze Hamiltonian Monte Carlo (HMC) by placing it in the setting of Riemannian geometry using the Jacobi metric, so that each step corresponds to a geodesic on a suitable Riemannian manifold. We then combine the notion…

Probability · Mathematics 2015-05-21 Susan Holmes , Simon Rubinstein-Salzedo , Christof Seiler

We provide a general methodology for unbiased estimation for intractable stochastic models. We consider situations where the target distribution can be written as an appropriate limit of distributions, and where conventional approaches…

Methodology · Statistics 2014-12-01 Sergios Agapiou , Gareth O. Roberts , Sebastian J. Vollmer

Hamiltonian Monte Carlo (HMC) algorithms are among the most widely used sampling methods in high dimensional settings, yet their convergence properties are poorly understood in divergences that quantify relative density mismatch, such as…

Machine Learning · Statistics 2026-01-15 Nawaf Bou-Rabee , Siddharth Mitra , Andre Wibisono

Inexact Markov Chain Monte Carlo methods rely on Markov chains that do not exactly preserve the target distribution. Examples include the unadjusted Langevin algorithm (ULA) and unadjusted Hamiltonian Monte Carlo (uHMC). This paper…

Probability · Mathematics 2023-04-13 Alain Oliviero Durmus , Andreas Eberle

Tuning the durations of the Hamiltonian flow in Hamiltonian Monte Carlo (also called Hybrid Monte Carlo) (HMC) involves a tradeoff between computational cost and sampling quality, which is typically challenging to resolve in a satisfactory…

Probability · Mathematics 2017-09-08 Nawaf Bou-Rabee , Jesus Maria Sanz-Serna

We study an optimal control problem under uncertainty, where the target function is the solution of an elliptic partial differential equation with random coefficients, steered by a control function. The robust formulation of the…

Numerical Analysis · Mathematics 2019-10-23 Philipp A. Guth , Vesa Kaarnioja , Frances Y. Kuo , Claudia Schillings , Ian H. Sloan
‹ Prev 1 2 3 10 Next ›