English
Related papers

Related papers: Relative fixed-width stopping rules for Markov cha…

200 papers

We prove finite sample complexities for sequential Monte Carlo (SMC) algorithms which require only local mixing times of the associated Markov kernels. Our bounds are particularly useful when the target distribution is multimodal and global…

Computation · Statistics 2022-08-16 Joseph Mathews , Scott C. Schmidler

Markov chain Monte Carlo (MCMC) algorithms are used to estimate features of interest of a distribution. The Monte Carlo error in estimation has an asymptotic normal distribution whose multivariate nature has so far been ignored in the MCMC…

Statistics Theory · Mathematics 2016-07-05 Dootika Vats , James M. Flegal , Galin L. Jones

This paper considers a new approach to using Markov chain Monte Carlo (MCMC) in contexts where one may adopt multilevel (ML) Monte Carlo. The underlying problem is to approximate expectations w.r.t. an underlying probability measure that is…

Numerical Analysis · Mathematics 2018-06-27 Ajay Jasra , Kody Law , Yaxian Xu

In this paper we investigate the continuum limits of a class of Markov chains. The investigation of such limits is motivated by the desire to model very large networks. We show that under some conditions, a sequence of Markov chains…

Networking and Internet Architecture · Computer Science 2011-06-22 Yang Zhang , Edwin K. P. Chong , Jan Hannig , Donald Estep

In Bayesian inference, predictive distributions are typically in the form of samples generated via Markov chain Monte Carlo (MCMC) or related algorithms. In this paper, we conduct a systematic analysis of how to make and evaluate…

Methodology · Statistics 2020-06-25 Fabian Krüger , Sebastian Lerch , Thordis L. Thorarinsdottir , Tilmann Gneiting

We prove a bound on the finite sample error of sequential Monte Carlo (SMC) on static spaces using the $L_2$ distance between interpolating distributions and the mixing times of Markov kernels. This result is unique in that it is the first…

Computation · Statistics 2025-08-26 Joe Marion , Joseph Mathews , Scott C. Schmidler

This paper presents how to use common random number (CRN) simulation to evaluate Markov chain Monte Carlo (MCMC) convergence to stationarity. We provide an upper bound on the Wasserstein distance of a Markov chain to its stationary…

Computation · Statistics 2025-11-03 Sabrina Sixta , Jeffrey S. Rosenthal , Austin Brown

Markov chain Monte Carlo (MCMC) simulations are modeled as driven by true random numbers. We consider variance bounding Markov chains driven by a deterministic sequence of numbers. The star-discrepancy provides a measure of efficiency of…

Computation · Statistics 2014-12-03 Josef Dick , Daniel Rudolf

We consider the efficient use of an approximation within Markov chain Monte Carlo (MCMC), with subsequent importance sampling (IS) correction of the Markov chain inexact output, leading to asymptotically exact inference. We detail…

Computation · Statistics 2019-04-15 Jordan Franks

Using concentration inequalities, we give non-asymptotic confidence intervals for estimates obtained by Markov chain Monte Carlo (MCMC) simulations, when using the approximation $\mathbb{E}_{\pi} f\approx (1/(N-t_0))\cdot \sum_{i=t_0+1}^N…

Probability · Mathematics 2015-09-29 Benjamin M. Gyori , Daniel Paulin

Markov chain Monte Carlo (MCMC) is a sampling-based method for estimating features of probability distributions. MCMC methods produce a serially correlated, yet representative, sample from the desired distribution. As such it can be…

Computation · Statistics 2019-12-10 Dootika Vats , Nathan Robertson , James M Flegal , Galin L Jones

Two popular classes of methods for approximate inference are Markov chain Monte Carlo (MCMC) and variational inference. MCMC tends to be accurate if run for a long enough time, while variational inference tends to give better approximations…

Machine Learning · Computer Science 2017-06-21 Justin Domke

Markov Chain Monte Carlo (MCMC) is a popular class of statistical methods for simulating autocorrelated draws from target distributions, including posterior distributions in Bayesian analysis. An important consideration in using simulated…

Methodology · Statistics 2017-06-16 Benjamin E. Deonovic , Brian J. Smith

Monte Carlo algorithms simulate some prescribed number of samples, taking some random real time to complete the computations necessary. This work considers the converse: to impose a real-time budget on the computation, which results in the…

Computation · Statistics 2023-06-22 Lawrence M. Murray , Sumeetpal Singh , Anthony Lee

Markov Chain Monte Carlo (MCMC) techniques are now widely used for cosmological parameter estimation. Chains are generated to sample the posterior probability distribution obtained following the Bayesian approach. An important issue is how…

Markov chain Monte Carlo (MCMC) methods are foundational algorithms for Bayesian inference and probabilistic modeling. However, most MCMC algorithms are inherently sequential and their time complexity scales linearly with the sequence…

Computation · Statistics 2025-12-03 David M. Zoltowski , Skyler Wu , Xavier Gonzalez , Leo Kozachkov , Scott W. Linderman

MCMC methods (Monte Carlo Markov Chain) are a class of methods used to perform simulations per a probability distribution $P$. These methods are often used when we have difficulties to directly sample per a given probability distribution…

Methodology · Statistics 2014-01-21 Papa Ngom , Badiassiatta Don Bosco Diatta

Use each of n exact samples as the initial state for a MCMC sampler run for m steps. We give confidence intervals for accuracy of estimators which are always valid and which, in certain settings, are almost as good as the intervals one…

Probability · Mathematics 2007-05-23 David J. Aldous , Antar Bandyopadhyay

In Markov Chain Monte Carlo (MCMC) simulations, the thermal equilibria quantities are estimated by ensemble average over a sample set containing a large number of correlated samples. These samples are selected in accordance with the…

Data Analysis, Statistics and Probability · Physics 2015-01-08 J. Li , P. Vignal , S. Sun , V. M. Calo

It is widely known that the performance of Markov chain Monte Carlo (MCMC) can degrade quickly when targeting computationally expensive posterior distributions, such as when the sample size is large. This has motivated the search for MCMC…

Computation · Statistics 2024-12-02 James E. Johndrow , Natesh S. Pillai , Aaron Smith