English
Related papers

Related papers: An introduction to computational complexity in Mar…

200 papers

This document presents methods to remove the initialization or burn-in bias from Markov chain Monte Carlo (MCMC) estimates, with consequences on parallel computing, convergence diagnostics and performance assessment. The document is written…

Methodology · Statistics 2024-06-12 Yves F. Atchadé , Pierre E. Jacob

We elaborate the idea behind Markov chain Monte Carlo (MCMC) methods in a mathematically coherent, yet simple and understandable way. To this end, we proof a pivotal convergence theorem for finite Markov chains and a minimal version of the…

Statistics Theory · Mathematics 2019-07-30 Tobias Siems

From its inception in the 1950s to the modern frontiers of applied statistics, Markov chain Monte Carlo has been one of the most ubiquitous and successful methods in statistical computing. In that time its development has been fueled by…

Methodology · Statistics 2018-01-11 Michael Betancourt

Markov chain Monte Carlo (MCMC) lies at the core of modern Bayesian methodology, much of which would be impossible without it. Thus, the convergence properties of MCMCs have received significant attention, and in particular, proving…

Statistics Theory · Mathematics 2015-08-28 Bala Rajaratnam , Doug Sparks

Markov chain Monte Carlo is an inherently serial algorithm. Although likelihood calculations for individual steps can sometimes be parallelized, the serial evolution of the process is widely viewed as incompatible with parallelization,…

Computation · Statistics 2013-12-31 Douglas N. VanDerwerken , Scott C. Schmidler

The Markov Chain Monte Carlo method is the dominant paradigm for posterior computation in Bayesian analysis. It is common to control computation time by making approximations to the Markov transition kernel. Comparatively little attention…

Computation · Statistics 2017-08-30 James E. Johndrow , Jonathan C. Mattingly , Sayan Mukherjee , David Dunson

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such…

Machine Learning · Statistics 2021-10-05 Theodore Papamarkou , Jacob Hinkle , M. Todd Young , David Womble

Markov chain Monte Carlo (MCMC) is the engine of modern Bayesian statistics, being used to approximate the posterior and derived quantities of interest. Despite this, the issue of how the output from a Markov chain is post-processed and…

Methodology · Statistics 2021-09-07 Leah F. South , Marina Riabiz , Onur Teymur , Chris. J. Oates

A brief introduction to the technique of Monte Carlo simulations in statistical physics is presented. The topics covered include statistical ensembles random and pseudo random numbers, random sampling techniques, importance sampling, Markov…

Statistical Mechanics · Physics 2016-08-31 K. P. N. Murthy

Rich data generating mechanisms are ubiquitous in this age of information and require complex statistical models to draw meaningful inference. While Bayesian analysis has seen enormous development in the last 30 years, benefitting from the…

Computation · Statistics 2022-10-20 Radu V. Craiu , Evgeny Levi

Current reporting of results based on Markov chain Monte Carlo computations could be improved. In particular, a measure of the accuracy of the resulting estimates is rarely reported. Thus we have little ability to objectively assess the…

Statistics Theory · Mathematics 2009-09-29 James M. Flegal , Murali Haran , Galin L. Jones

Monte Carlo methods play an important role in scientific computation, especially when problems have a vast phase space. In this lecture an introduction to the Monte Carlo method is given. Concepts such as Markov chains, detailed balance,…

Statistical Mechanics · Physics 2011-05-05 Helmut G. Katzgraber

In this paper we investigate the continuum limits of a class of Markov chains. The investigation of such limits is motivated by the desire to model very large networks. We show that under some conditions, a sequence of Markov chains…

Networking and Internet Architecture · Computer Science 2011-06-22 Yang Zhang , Edwin K. P. Chong , Jan Hannig , Donald Estep

Markov Chain Monte Carlo (MCMC) methods for sampling probability density functions (combined with abundant computational resources) have transformed the sciences, especially in performing probabilistic inferences, or fitting models to data.…

Instrumentation and Methods for Astrophysics · Physics 2018-05-23 David W. Hogg , Daniel Foreman-Mackey

Markov chain Monte Carlo (MCMC) is an established approach for uncertainty quantification and propagation in scientific applications. A key challenge in applying MCMC to scientific domains is computation: the target density of interest is…

Machine Learning · Statistics 2022-10-05 Diana Cai , Ryan P. Adams

This short note reviews the basic theory for quantifying both the asymptotic and preasymptotic convergence of Markov chain Monte Carlo estimators.

Probability · Mathematics 2021-10-15 Michael Betancourt

Markov chain Monte Carlo (MCMC) algorithms are generally regarded as the gold standard technique for Bayesian inference. They are theoretically well-understood and conceptually simple to apply in practice. The drawback of MCMC is that in…

Computation · Statistics 2019-07-17 Christopher Nemeth , Paul Fearnhead

Adaptive and interacting Markov chain Monte Carlo algorithms (MCMC) have been recently introduced in the literature. These novel simulation algorithms are designed to increase the simulation efficiency to sample complex distributions.…

Statistics Theory · Mathematics 2012-03-15 G. Fort , E. Moulines , P. Priouret

This paper presents a novel theoretical Monte Carlo Markov chain procedure in the framework of graphs. It specifically deals with the construction of a Markov chain whose empirical distribution converges to a given reference one. The Markov…

Probability · Mathematics 2019-07-02 Roy Cerqueti , Emilio De Santis

Monte Carlo simulations are widely used in many areas including particle accelerators. In this lecture, after a short introduction and reviewing of some statistical backgrounds, we will discuss methods such as direct inversion, rejection…

Computational Physics · Physics 2020-06-19 Ji Qiang