English

Mixing Time Guarantees for Unadjusted Hamiltonian Monte Carlo

Probability 2022-10-13 v1 Numerical Analysis Numerical Analysis Computation Machine Learning

Abstract

We provide quantitative upper bounds on the total variation mixing time of the Markov chain corresponding to the unadjusted Hamiltonian Monte Carlo (uHMC) algorithm. For two general classes of models and fixed time discretization step size hh, the mixing time is shown to depend only logarithmically on the dimension. Moreover, we provide quantitative upper bounds on the total variation distance between the invariant measure of the uHMC chain and the true target measure. As a consequence, we show that an ε\varepsilon-accurate approximation of the target distribution μ\mu in total variation distance can be achieved by uHMC for a broad class of models with O(d3/4ε1/2log(d/ε))O\left(d^{3/4}\varepsilon^{-1/2}\log (d/\varepsilon )\right) gradient evaluations, and for mean field models with weak interactions with O(d1/2ε1/2log(d/ε))O\left(d^{1/2}\varepsilon^{-1/2}\log (d/\varepsilon )\right) gradient evaluations. The proofs are based on the construction of successful couplings for uHMC that realize the upper bounds.

Keywords

Cite

@article{arxiv.2105.00887,
  title  = {Mixing Time Guarantees for Unadjusted Hamiltonian Monte Carlo},
  author = {Nawaf Bou-Rabee and Andreas Eberle},
  journal= {arXiv preprint arXiv:2105.00887},
  year   = {2022}
}

Comments

43 pages