English
Related papers

Related papers: On the convergence of the Metropolis algorithm wit…

200 papers

This paper introduces a class of Monte Carlo algorithms which are based upon the simulation of a Markov process whose quasi-stationary distribution coincides with a distribution of interest. This differs fundamentally from, say, current…

Methodology · Statistics 2020-04-14 Murray Pollock , Paul Fearnhead , Adam M. Johansen , Gareth O. Roberts

Markov Chain Monte Carlo (MCMC) algorithms are widely used for stochastic optimization, sampling, and integration of mathematical objective functions, in particular, in the context of Bayesian inverse problems and parameter estimation. For…

Data Analysis, Statistics and Probability · Physics 2020-10-12 Shashank Kumbhare , Amir Shahmoradi

Markov chain Monte Carlo methods are often deemed too computationally intensive to be of any practical use for big data applications, and in particular for inference on datasets containing a large number $n$ of individual data points, also…

Methodology · Statistics 2015-05-13 Rémi Bardenet , Arnaud Doucet , Chris Holmes

Markov chain Monte Carlo methods such as Gibbs sampling and simple forms of the Metropolis algorithm typically move about the distribution being sampled via a random walk. For the complex, high-dimensional distributions commonly encountered…

bayes-an · Physics 2008-02-03 R. M. Neal

We analyse computational efficiency of Metropolis-Hastings algorithms with stochastic AR(1) process proposals. These proposals include, as a subclass, discretized Langevin diffusion (e.g. MALA) and discretized Hamiltonian dynamics (e.g.…

Computation · Statistics 2016-05-23 Richard A. Norton , Colin Fox

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) algorithm for estimating expectations with respect to continuous un-normalized probability distributions. MCMC estimators typically have higher variance than…

Computation · Statistics 2020-03-04 Dan Piponi , Matthew D. Hoffman , Pavel Sountsov

We study the integration of functions with respect to an unknown density. We compare the simple Monte Carlo method (which is almost optimal for a certain large class of inputs) and compare it with the Metropolis algorithm (based on a…

Numerical Analysis · Mathematics 2007-06-13 Peter Mathe , Erich Novak

We develop an Evolutionary Markov Chain Monte Carlo (EMCMC) algorithm for sampling spatial partitions that lie within a large and complex spatial state space. Our algorithm combines the advantages of evolutionary algorithms (EAs) as…

Computation · Statistics 2021-01-19 Wendy K. Tam Cho , Yan Y. Liu

In recent years, various interacting particle samplers have been developed to sample from complex target distributions, such as those found in Bayesian inverse problems. These samplers are motivated by the mean-field limit perspective and…

Computation · Statistics 2023-12-22 Björn Sprungk , Simon Weissmann , Jakob Zech

Markov Chain Monte Carlo (MCMC) methods, such as the Metropolis-Hastings (MH) algorithm, are widely used for Bayesian inference. One of the most important issues for any MCMC method is the convergence of the Markov chain, which depends…

Computation · Statistics 2015-11-20 Luca Martino , Jesse Read , David Luengo

Particle MCMC is a class of algorithms that can be used to analyse state-space models. They use MCMC moves to update the parameters of the models, and particle filters to propose values for the path of the state-space model. Currently the…

Computation · Statistics 2014-12-25 Chris Nemeth , Paul Fearnhead

Markov chain Monte Carlo (MCMC) is a powerful methodology for the approximation of posterior distributions. However, the iterative nature of MCMC does not naturally facilitate its use with modern highly parallel computation on HPC and cloud…

We develop a new Markov chain on graph partitions that makes relatively global moves yet is computationally feasible to be used as the proposal in the Metropolis-Hastings method. Our resulting algorithm can be made reversible and able to…

Data Structures and Algorithms · Computer Science 2021-05-11 Eric Autrey , Daniel Carter , Gregory Herschlag , Zach Hunter , Jonathan C. Mattingly

Convergence diagnosis for Markov chain Monte Carlo is a matter of fundamental importance in computational statistics: it determines the resources allocated to a particular sampling problem and influences the practitioner's view of the…

Computation · Statistics 2026-05-14 Buu Phan , Gergely Flamich , Ashish Khisti , Shahab Asoodeh

We discuss a non-reversible, lifted Markov-chain Monte Carlo (MCMC) algorithm for particle systems in which the direction of proposed displacements is changed deterministically. This algorithm sweeps through directions analogously to the…

Statistical Mechanics · Physics 2022-08-31 Liang Qin , Philipp Hoellmer , Werner Krauth

Markov chain Monte Carlo (MCMC) methods have existed for a long time and the field is well-explored. The purpose of MCMC methods is to approximate a distribution through repeated sampling; most MCMC algorithms exhibit asymptotically optimal…

Computation · Statistics 2023-07-13 Fareed Sheriff

Motivated by the physics of strings and branes, we introduce a general suite of Markov chain Monte Carlo (MCMC) "suburban samplers" (i.e., spread out Metropolis). The suburban algorithm involves an ensemble of statistical agents connected…

Computation · Statistics 2016-05-23 Jonathan J. Heckman , Jeffrey G. Bernstein , Ben Vigoda

Markov chain Monte Carlo methods have become popular in statistics as versatile techniques to sample from complicated probability distributions. In this work, we propose a method to parameterize and train transition kernels of Markov chains…

Machine Learning · Computer Science 2024-06-05 Evgenii Egorov , Ricardo Valperga , Efstratios Gavves

In this paper we propose to evaluate and compare Markov chain Monte Carlo (MCMC) methods to estimate the parameters in a generalized extreme value model. We employed the Bayesian approach using traditional Metropolis-Hastings methods,…

Computation · Statistics 2016-11-03 Marcelo Hartmann , Ricardo Ehlers

In MCMC methods, such as the Metropolis-Hastings (MH) algorithm, the Gibbs sampler, or recent adaptive methods, many different strategies can be proposed, often associated in practice to unknown rates of convergence. In this paper we…

Statistics Theory · Mathematics 2007-06-13 Didier Chauveau , Pierre Vandekerkhove