Mini-batch Tempered MCMC
Computation
2018-05-23 v8
Abstract
In this paper we propose a general framework of performing MCMC with only a mini-batch of data. We show by estimating the Metropolis-Hasting ratio with only a mini-batch of data, one is essentially sampling from the true posterior raised to a known temperature. We show by experiments that our method, Mini-batch Tempered MCMC (MINT-MCMC), can efficiently explore multiple modes of a posterior distribution. Based on the Equi-Energy sampler (Kou et al. 2006), we developed a new parallel MCMC algorithm based on the Equi-Energy sampler, which enables efficient sampling from high-dimensional multi-modal posteriors with well separated modes.
Keywords
Cite
@article{arxiv.1707.09705,
title = {Mini-batch Tempered MCMC},
author = {Dangna Li and Wing H Wong},
journal= {arXiv preprint arXiv:1707.09705},
year = {2018}
}