English
Related papers

Related papers: Markov Chain Monte Carlo confidence intervals

200 papers

We prove explicit error bounds for Markov chain Monte Carlo (MCMC) methods to compute expectations of functions with unbounded stationary variance. We assume that there is a $p\in(1,2)$ so that the functions have finite $L_p$-norm. For…

Statistics Theory · Mathematics 2015-01-27 Daniel Rudolf , Nikolaus Schweizer

We consider Markov chains on the space of (countable) partitions of the interval $[0,1]$, obtained first by size biased sampling twice (allowing repetitions) and then merging the parts with probability $\beta_m$ (if the sampled parts are…

Probability · Mathematics 2007-05-23 Eddy Mayer-Wolf , Ofer Zeitouni , Martin P. W. Zerner

The convergence rate of a Markov chain to its stationary distribution is typically assessed using the concept of total variation mixing time. However, this worst-case measure often yields pessimistic estimates and is challenging to infer…

Statistics Theory · Mathematics 2026-02-06 Geoffrey Wolfer , Pierre Alquier

This paper presents a novel theoretical Monte Carlo Markov chain procedure in the framework of graphs. It specifically deals with the construction of a Markov chain whose empirical distribution converges to a given reference one. The Markov…

Probability · Mathematics 2019-07-02 Roy Cerqueti , Emilio De Santis

We study convergence properties of pseudo-marginal Markov chain Monte Carlo algorithms (Andrieu and Roberts [Ann. Statist. 37 (2009) 697-725]). We find that the asymptotic variance of the pseudo-marginal algorithm is always at least as…

Probability · Mathematics 2015-03-31 Christophe Andrieu , Matti Vihola

Markov chain Monte Carlo (MCMC) methods to sample from a probability distribution $\pi$ defined on a space $(\Theta,\mathcal{T})$ consist of the simulation of realisations of Markov chains $\{\theta_{n},n\geq1\}$ of invariant distribution…

Computation · Statistics 2021-01-06 Christophe Andrieu , Sinan Yıldırım , Arnaud Doucet , Nicolas Chopin

Effective sample size is a standard summary of Markov chain Monte Carlo output, but it is usually attached to scalar or Euclidean summaries chosen by the analyst. For manifold-valued samples this choice is not canonical: coordinate-wise…

Machine Learning · Statistics 2026-05-06 Kisung You

Performing numerical integration when the integrand itself cannot be evaluated point-wise is a challenging task that arises in statistical analysis, notably in Bayesian inference for models with intractable likelihood functions. Markov…

Computation · Statistics 2020-06-17 Lawrence Middleton , George Deligiannidis , Arnaud Doucet , Pierre E. Jacob

Testing between hypotheses, when independent sampling is possible, is a well developed subject. In this paper, we propose hypothesis tests that are applicable when the samples are obtained using Markov chain Monte Carlo. These tests are…

Methodology · Statistics 2015-08-14 Benjamin M. Gyori , Daniel Paulin

We develop a new bidirectional algorithm for estimating Markov chain multi-step transition probabilities: given a Markov chain, we want to estimate the probability of hitting a given target state in $\ell$ steps after starting from a given…

Data Structures and Algorithms · Computer Science 2015-11-05 Siddhartha Banerjee , Peter Lofgren

We study the limit behaviour of upper and lower bounds on expected time averages in imprecise Markov chains; a generalised type of Markov chain where the local dynamics, traditionally characterised by transition probabilities, are now…

Probability · Mathematics 2021-02-10 Natan T'Joens , Jasper De Bock

We assume a drift condition towards a small set and bound the mean square error of estimators obtained by taking averages along a single trajectory of a Markov chain Monte Carlo algorithm. We use these bounds to construct fixed-width…

Methodology · Statistics 2011-02-01 Krzysztof Latuszynski , Wojciech Niemiro

The asymptotic variance is an important criterion to evaluate the performance of Markov chains, especially for the central limit theorems. We give the variational formulas for the asymptotic variance of discrete-time (non-reversible) Markov…

Probability · Mathematics 2020-12-29 Lu-Jing Huang , Yong-Hua Mao

We develop exact Markov chain Monte Carlo methods for discretely-sampled, directly and indirectly observed diffusions. The qualification "exact" refers to the fact that the invariant and limiting distribution of the Markov chains is the…

Consider a Markov process $\{\Phi(t) : t\geq 0\}$ evolving on a Polish space ${\sf X}$. A version of the $f$-Norm Ergodic Theorem is obtained: Suppose that the process is $\psi$-irreducible and aperiodic. For a given function $f\colon{\sf…

Probability · Mathematics 2015-12-03 I. Kontoyiannis , S. P. Meyn

We study one-sided and $\alpha$-correct sequential hypothesis testing for data generated by an ergodic Markov chain. The null hypothesis is that the unknown transition matrix belongs to a prescribed set $P$ of stochastic matrices, and the…

Statistics Theory · Mathematics 2026-02-20 Alhad Sethi , Kavali Sofia Sagar , Shubhada Agrawal , Debabrota Basu , P. N. Karthik

This paper proposes a family of weighted batch means variance estimators, which are computationally efficient and can be conveniently applied in practice. The focus is on Markov chain Monte Carlo simulations and estimation of the asymptotic…

Statistics Theory · Mathematics 2018-05-23 Ying Liu , James M. Flegal

We consider continuous-time Markov chain on a finite state space X. We assume X can be clustered into several subsets such that the intra-transition rates within these subsets are of order $\mathcal{O}(\frac{1}{\epsilon})$ comparing to the…

Probability · Mathematics 2016-01-28 Wei Zhang

Two popular classes of methods for approximate inference are Markov chain Monte Carlo (MCMC) and variational inference. MCMC tends to be accurate if run for a long enough time, while variational inference tends to give better approximations…

Machine Learning · Computer Science 2017-06-21 Justin Domke

Use each of n exact samples as the initial state for a MCMC sampler run for m steps. We give confidence intervals for accuracy of estimators which are always valid and which, in certain settings, are almost as good as the intervals one…

Probability · Mathematics 2007-05-23 David J. Aldous , Antar Bandyopadhyay