English
Related papers

Related papers: Rigorous confidence bounds for MCMC under a geomet…

200 papers

Markov chain Monte Carlo (MCMC) provides asymptotically consistent estimates of intractable posterior expectations as the number of iterations tends to infinity. However, in large data applications, MCMC can be computationally expensive per…

Computation · Statistics 2023-11-03 Niloy Biswas , Lester Mackey

Markov chain Monte Carlo (MCMC) is an established approach for uncertainty quantification and propagation in scientific applications. A key challenge in applying MCMC to scientific domains is computation: the target density of interest is…

Machine Learning · Statistics 2022-10-05 Diana Cai , Ryan P. Adams

Markov chain Monte Carlo (MCMC) methods are a very versatile and widely used tool to compute integrals and expectations. In this short survey we focus on error bounds, rules for choosing the burn in, high dimensional problems and…

Statistics Theory · Mathematics 2014-12-03 Erich Novak , Daniel Rudolf

Single-chain Markov chain Monte Carlo simulates realizations from a Markov chain to estimate expectations with the empirical average. The single-chain simulation is generally of considerable length and restricts many advantages of modern…

Statistics Theory · Mathematics 2024-02-01 Austin Brown

For a reversible and ergodic Markov chain $\{X_n,n\geq0\}$ with invariant distribution $\pi$, we show that a valid confidence interval for $\pi(h)$ can be constructed whenever the asymptotic variance $\sigma^2_P(h)$ is finite and positive.…

Statistics Theory · Mathematics 2016-08-14 Yves F. Atchadé

We prove explicit, i.e., non-asymptotic, error bounds for Markov Chain Monte Carlo methods, such as the Metropolis algorithm. The problem is to compute the expectation (or integral) of f with respect to a measure which can be given by a…

Numerical Analysis · Mathematics 2011-01-18 Daniel Rudolf

Markov chain Monte Carlo (MCMC) simulations are modeled as driven by true random numbers. We consider variance bounding Markov chains driven by a deterministic sequence of numbers. The star-discrepancy provides a measure of efficiency of…

Computation · Statistics 2014-12-03 Josef Dick , Daniel Rudolf

The parameters of a discrete stationary Markov model are transition probabilities between states. Traditionally, data consist in sequences of observed states for a given number of individuals over the whole observation period. In such a…

Computation · Statistics 2012-04-30 Alberto Pasanisi , Shuai Fu , Nicolas Bousquet

Constructing unbiased estimators from Markov chain Monte Carlo (MCMC) outputs is a difficult problem that has recently received a lot of attention in the statistics and machine learning communities. However, the current unbiased MCMC…

Computation · Statistics 2022-12-27 Guanyang Wang , Tianze Wang

Markov chain Monte Carlo is a method of producing a correlated sample in order to estimate features of a target distribution via ergodic averages. A fundamental question is when should sampling stop? That is, when are the ergodic averages…

Statistics Theory · Mathematics 2007-06-13 Galin Jones , Murali Haran , Brian Caffo , Ronald Neath

Markov chain Monte Carlo(MCMC) is a popular approach to sample from high dimensional distributions, and the asymptotic variance is a commonly used criterion to evaluate the performance. While most popular MCMC algorithms are reversible,…

Probability · Mathematics 2018-02-06 Chi-Hao Wu , Ting-Li Chen

We consider quantile estimation using Markov chain Monte Carlo and establish conditions under which the sampling distribution of the Monte Carlo error is approximately Normal. Further, we investigate techniques to estimate the associated…

Statistics Theory · Mathematics 2018-04-20 Charles Doss , James M. Flegal , Galin L. Jones , Ronald C. Neath

The aim of this note is to investigate the concentration properties of unbounded functions of geometrically ergodic Markov chains. We derive concentration properties of centered functions with respect to the square of the Lyapunov's…

Statistics Theory · Mathematics 2016-09-14 Olivier Wintenberger

In this paper we consider the parameter estimation problem associated to partially-observed time changed SDEs, with observations that are given at discrete times. In particular we consider both likelihood and Bayesian estimation. We develop…

Numerical Analysis · Mathematics 2026-05-12 Ke Zhao , Ajay Jasra

Two popular classes of methods for approximate inference are Markov chain Monte Carlo (MCMC) and variational inference. MCMC tends to be accurate if run for a long enough time, while variational inference tends to give better approximations…

Machine Learning · Computer Science 2017-06-21 Justin Domke

Stochastic gradient Markov Chain Monte Carlo (SGMCMC) is considered the gold standard for Bayesian inference in large-scale models, such as Bayesian neural networks. Since practitioners face speed versus accuracy tradeoffs in these models,…

Machine Learning · Computer Science 2022-07-19 Antonios Alexos , Alex Boyd , Stephan Mandt

We consider the problem of estimating expectations with respect to a target distribution with an unknown normalizing constant, and where even the unnormalized target needs to be approximated at finite resolution. This setting is ubiquitous…

Numerical Analysis · Mathematics 2023-03-23 Kody J. H. Law , Neil Walton , Shangda Yang , Ajay Jasra

Uncertainty of decisions in safety-critical engineering applications can be estimated on the basis of the Bayesian Markov Chain Monte Carlo (MCMC) technique of averaging over decision models. The use of decision tree (DT) models assists…

Artificial Intelligence · Computer Science 2010-12-03 Vitaly Schetinin , Jonathan Fieldsend , Derek Partridge , Wojtek Krzanowski , Richard Everson , Trevor Bailey , Adolfo Hernandez

In the following article we consider approximate Bayesian parameter inference for observation driven time series models. Such statistical models appear in a wide variety of applications, including econometrics and applied mathematics. This…

Computation · Statistics 2013-04-01 Ajay Jasra , Nikolas Kantas , Elena Ehrlich

Markov chain Monte Carlo (MCMC) methods provide consistent of integrals as the number of iterations goes to infinity. MCMC estimators are generally biased after any fixed number of iterations. We propose to remove this bias by using…

Methodology · Statistics 2019-07-18 Pierre E. Jacob , John O'Leary , Yves F. Atchadé