English
Related papers

Related papers: Scalable couplings for the random walk Metropolis …

200 papers

Couplings play a central role in the analysis of Markov chain convergence and in the construction of novel Markov chain Monte Carlo estimators, diagnostics, and variance reduction techniques. The set of possible couplings is often…

Statistics Theory · Mathematics 2023-01-09 John O'Leary , Guanyang Wang

The random walk Metropolis (RWM) is one of the most common Markov chain Monte Carlo algorithms in practical use today. Its theoretical properties have been extensively explored for certain classes of target, and a number of results with…

Methodology · Statistics 2010-11-30 Chris Sherlock , Paul Fearnhead , Gareth O. Roberts

We examine the optimal scaling and the efficiency of the pseudo-marginal random walk Metropolis algorithm using a recently-derived result on the limiting efficiency as the dimension, $d\rightarrow \infty$. We prove that the optimal scaling…

Computation · Statistics 2015-04-24 Chris Sherlock

Lifted samplers form a class of Markov chain Monte Carlo methods which has drawn a lot attention in recent years due to superior performance in challenging Bayesian applications. A canonical example of lifted samplers is the one that is…

Computation · Statistics 2026-05-01 Philippe Gagnon , Florian Maire

The Metropolis-Hastings algorithm is a fundamental Markov chain Monte Carlo (MCMC) method for sampling and inference. With the advent of Big Data, distributed and parallel variants of MCMC methods are attracting increased attention. In this…

Data Structures and Algorithms · Computer Science 2019-07-16 Weiming Feng , Thomas P. Hayes , Yitong Yin

Adaptive and interacting Markov chain Monte Carlo algorithms (MCMC) have been recently introduced in the literature. These novel simulation algorithms are designed to increase the simulation efficiency to sample complex distributions.…

Statistics Theory · Mathematics 2012-03-15 G. Fort , E. Moulines , P. Priouret

Blockchain technology, with implications in the financial domain, offers data in the form of large-scale transaction networks. Analyzing transaction networks facilitates fraud detection, market analysis, and supports government regulation.…

Computational Engineering, Finance, and Science · Computer Science 2025-01-23 Junliang Luo , Xue Liu

We investigate local MCMC algorithms, namely the random-walk Metropolis and the Langevin algorithms, and identify the optimal choice of the local step-size as a function of the dimension $n$ of the state space, asymptotically as…

Probability · Mathematics 2009-08-07 Alexandros Beskos , Gareth Roberts , Andrew Stuart

Practitioners of Markov chain Monte Carlo (MCMC) may hesitate to use random walk Metropolis-Hastings algorithms, especially variable-at-a-time algorithms with many parameters, because these algorithms require users to select values of…

Computation · Statistics 2011-03-31 Todd L. Graves

We construct a new framework for accelerating Markov chain Monte Carlo in posterior sampling problems where standard methods are limited by the computational cost of the likelihood, or of numerical models embedded therein. Our approach…

Methodology · Statistics 2017-01-06 Patrick R. Conrad , Youssef M. Marzouk , Natesh S. Pillai , Aaron Smith

The Metropolis-Hastings algorithm has been extensively studied in the estimation and simulation literature, with most prior work focusing on convergence behavior and asymptotic theory. However, its covariance structure-an important…

Computation · Statistics 2026-03-03 Jingyi Zhang , James C. Spall

We consider versions of the Metropolis algorithm which avoid the inefficiency of rejections. We first illustrate that a natural Uniform Selection Algorithm might not converge to the correct distribution. We then analyse the use of Markov…

Statistics Theory · Mathematics 2024-04-04 J. S. Rosenthal , A. Dote , K. Dabiri , H. Tamura , S. Chen , A. Sheikholeslami

We consider the recently introduced Transformation-based Markov Chain Monte Carlo (TMCMC) (Dutta and Bhattacharya (2014)), a methodology that is designed to update all the parameters simultaneously using some simple deterministic…

Methodology · Statistics 2017-01-24 Kushal Kumar Dey , Sourabh Bhattacharya

Monte Carlo approaches have recently been proposed to quantify connectivity in neuronal networks. The key problem is to sample from the conditional distribution of a single neuronal spike train, given the activity of the other neurons in…

Applications · Statistics 2011-12-01 Yuriy Mishchenko , Liam Paninski

The stability and ergodicity properties of two adaptive random walk Metropolis algorithms are considered. The both algorithms adjust the scaling of the proposal distribution continuously based on the observed acceptance probability. Unlike…

Probability · Mathematics 2011-11-21 Matti Vihola

We propose a new sampling algorithm combining two quite powerful ideas in the Markov chain Monte Carlo literature -- adaptive Metropolis sampler and two-stage Metropolis-Hastings sampler. The proposed sampling method will be particularly…

Computation · Statistics 2021-01-05 Anirban Mondal , Kai Yin , Abhijit Mandal

We propose a methodology to parallelize Hamiltonian Monte Carlo estimators. Our approach constructs a pair of Hamiltonian Monte Carlo chains that are coupled in such a way that they meet exactly after some random number of iterations. These…

Computation · Statistics 2018-08-28 Jeremy Heng , Pierre E. Jacob

Markov chain Monte Carlo methods such as Gibbs sampling and simple forms of the Metropolis algorithm typically move about the distribution being sampled via a random walk. For the complex, high-dimensional distributions commonly encountered…

bayes-an · Physics 2008-02-03 R. M. Neal

We consider the random walk Metropolis algorithm on $\mathbb{R}^n$ with Gaussian proposals, and when the target probability measure is the $n$-fold product of a one-dimensional law. In the limit $n\to\infty$, it is well known (see [Ann.…

Probability · Mathematics 2016-08-14 Benjamin Jourdain , Tony Lelièvre , Błażej Miasojedow

The availability of data sets with large numbers of variables is rapidly increasing. The effective application of Bayesian variable selection methods for regression with these data sets has proved difficult since available Markov chain…

Computation · Statistics 2019-05-08 Jim Griffin , Krys Latuszynski , Mark Steel