Autocovariance and Optimal Design for Random Walk Metropolis-Hastings Algorithm
Computation
2026-03-03 v2 Optimization and Control
Statistics Theory
Statistics Theory
Abstract
The Metropolis-Hastings algorithm has been extensively studied in the estimation and simulation literature, with most prior work focusing on convergence behavior and asymptotic theory. However, its covariance structure-an important statistical property for both theory and implementation-remains less understood. In this work, we provide new theoretical insights into the scalar case, focusing primarily on symmetric unimodal target distributions with symmetric random walk proposals, where we also establish an optimal proposal design. In addition, we derive some more general results beyond this setting. For the high-dimensional case, we relate the covariance matrix to the classical 0.23 average acceptance rate tuning criterion.
Cite
@article{arxiv.2511.10967,
title = {Autocovariance and Optimal Design for Random Walk Metropolis-Hastings Algorithm},
author = {Jingyi Zhang and James C. Spall},
journal= {arXiv preprint arXiv:2511.10967},
year = {2026}
}