English

Error bounds for Metropolis-Hastings algorithms applied to perturbations of Gaussian measures in high dimensions

Probability 2014-01-17 v2 Computation

Abstract

The Metropolis-adjusted Langevin algorithm (MALA) is a Metropolis-Hastings method for approximate sampling from continuous distributions. We derive upper bounds for the contraction rate in Kantorovich-Rubinstein-Wasserstein distance of the MALA chain with semi-implicit Euler proposals applied to log-concave probability measures that have a density w.r.t. a Gaussian reference measure. For sufficiently "regular" densities, the estimates are dimension-independent, and they hold for sufficiently small step sizes hh that do not depend on the dimension either. In the limit h0h\downarrow0, the bounds approach the known optimal contraction rates for overdamped Langevin diffusions in a convex potential. A similar approach also applies to Metropolis-Hastings chains with Ornstein-Uhlenbeck proposals. In this case, the resulting estimates are still independent of the dimension but less optimal, reflecting the fact that MALA is a higher order approximation of the diffusion limit than Metropolis-Hastings with Ornstein-Uhlenbeck proposals.

Keywords

Cite

@article{arxiv.1210.1180,
  title  = {Error bounds for Metropolis-Hastings algorithms applied to perturbations of Gaussian measures in high dimensions},
  author = {Andreas Eberle},
  journal= {arXiv preprint arXiv:1210.1180},
  year   = {2014}
}

Comments

Published in at http://dx.doi.org/10.1214/13-AAP926 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)