English

Unadjusted Hamiltonian MCMC with Stratified Monte Carlo Time Integration

Probability 2025-03-03 v3 Numerical Analysis Numerical Analysis Statistics Theory Computation Machine Learning Statistics Theory

Abstract

A randomized time integrator is suggested for unadjusted Hamiltonian Monte Carlo (uHMC) which involves a very minor modification to the usual Verlet time integrator, and hence, is easy to implement. For target distributions of the form μ(dx)eU(x)dx\mu(dx) \propto e^{-U(x)} dx where U:RdR0U: \mathbb{R}^d \to \mathbb{R}_{\ge 0} is KK-strongly convex but only LL-gradient Lipschitz, and initial distributions ν\nu with finite second moment, coupling proofs reveal that an ε\varepsilon-accurate approximation of the target distribution in L2L^2-Wasserstein distance W2\boldsymbol{\mathcal{W}}^2 can be achieved by the uHMC algorithm with randomized time integration using O((d/K)1/3(L/K)5/3ε2/3log(W2(μ,ν)/ε)+)O\left((d/K)^{1/3} (L/K)^{5/3} \varepsilon^{-2/3} \log( \boldsymbol{\mathcal{W}}^2(\mu, \nu) / \varepsilon)^+\right) gradient evaluations; whereas for such rough target densities the corresponding complexity of the uHMC algorithm with Verlet time integration is in general O((d/K)1/2(L/K)2ε1log(W2(μ,ν)/ε)+)O\left((d/K)^{1/2} (L/K)^2 \varepsilon^{-1} \log( \boldsymbol{\mathcal{W}}^2(\mu, \nu) / \varepsilon)^+ \right). Metropolis-adjustable randomized time integrators are also provided.

Keywords

Cite

@article{arxiv.2211.11003,
  title  = {Unadjusted Hamiltonian MCMC with Stratified Monte Carlo Time Integration},
  author = {Nawaf Bou-Rabee and Milo Marsden},
  journal= {arXiv preprint arXiv:2211.11003},
  year   = {2025}
}

Comments

32 pages, 2 figures