English
Related papers

Related papers: A central limit theorem for adaptive and interacti…

200 papers

The Markov Chain Monte Carlo (MCMC) algorithm is a widely recognised as an efficient method for sampling a specified posterior distribution. However, when the posterior is multi-modal, conventional MCMC algorithms either tend to become…

Instrumentation and Methods for Astrophysics · Physics 2014-08-19 Yi-Ming Hu , Martin Hendry , Ik Siong Heng

We investigate the increase in efficiency of simulated and parallel tempering MCMC algorithms when using non-reversible updates to give them "momentum". By making a connection to a certain simple discrete Markov chain, we show that, under…

Statistics Theory · Mathematics 2025-01-29 Gareth O. Roberts , Jeffrey S. Rosenthal

We prove a central limit theorem for a class of additive processes that arise naturally in the theory of finite horizon Markov decision problems. The main theorem generalizes a classic result of Dobrushin (1956) for temporally…

Probability · Mathematics 2016-09-28 Alessandro Arlotto , J. Michael Steele

In this paper, a self-triggered adaptive model predictive control (MPC) algorithm is proposed for constrained discrete-time nonlinear systems subject to parametric uncertainties and additive disturbances. To bound the parametric…

Optimization and Control · Mathematics 2019-12-17 Kunwu Zhang , Changxin Liu , Yang Shi

A finite range interacting particle system on a transitive graph is considered. Assuming that the dynamics and the initial measure are invariant, the normalized empirical distribution process converges in distribution to a centered…

Mathematical Physics · Physics 2007-05-23 Paul Doukhan , Gabriel Lang , Sana Louhichi , Bernard Ycart

In this paper we study the functional central limit theorem for stationary Markov chains with self-adjoint operator and general state space. We investigate the case when the variance of the partial sum is not asymptotically linear in n; and…

Probability · Mathematics 2013-05-10 Martial Longla , Costel Peligrad , Magda Peligrad

We consider the problem of estimating the measure of subsets in very large networks. A prime tool for this purpose is the Markov Chain Monte Carlo (MCMC) algorithm. This algorithm, while extremely useful in many cases, still often suffers…

Data Structures and Algorithms · Computer Science 2020-09-01 Ahmad Askarian , Rupei Xu , András Faragó

We introduce interacting particle Markov chain Monte Carlo (iPMCMC), a PMCMC method based on an interacting pool of standard and conditional sequential Monte Carlo samplers. Like related methods, iPMCMC is a Markov chain Monte Carlo sampler…

Markov chain Monte Carlo (MCMC) algorithms are based on the construction of a Markov chain with transition probabilities leaving invariant a probability distribution of interest. In this work, we look at these transition probabilities as…

Probability · Mathematics 2024-10-01 Rocco Caprio , Adam M. Johansen

Monte Carlo methods -- such as Markov chain Monte Carlo (MCMC) and piecewise deterministic Markov process (PDMP) samplers -- provide asymptotically exact estimators of expectations under a target distribution. There is growing interest in…

Computation · Statistics 2024-09-09 Adrien Corenflos , Matthew Sutton , Nicolas Chopin

The Monte Carlo within Metropolis (MCwM) algorithm, interpreted as a perturbed Metropolis-Hastings (MH) algorithm, provides an approach for approximate sampling when the target distribution is intractable. Assuming the unperturbed Markov…

Computation · Statistics 2019-07-31 Felipe Medina-Aguayo , Daniel Rudolf , Nikolaus Schweizer

In this paper we survey the almost sure central limit theorem and its functional form (quenched) for stationary and ergodic processes. For additive functionals of a stationary and ergodic Markov chain these theorems are known under the…

Probability · Mathematics 2013-04-17 Magda Peligrad

The Pseudo-Marginal (PM) algorithm is a popular Markov chain Monte Carlo (MCMC) method used to sample from a target distribution when its density is inaccessible, but can be estimated with a non-negative unbiased estimator. Its performance…

Computation · Statistics 2025-09-30 Sarra Abaoubida , Mylène Bédard , Florian Maire

The Importance Markov chain is a novel algorithm bridging the gap between rejection sampling and importance sampling, moving from one to the other through a tuning parameter. Based on a modified sample of an instrumental Markov chain…

Computation · Statistics 2024-02-27 Charly Andral , Randal Douc , Hugo Marival , Christian P. Robert

Markov Chain Monte Carlo (MCMC) algorithms are commonly used for their versatility in sampling from complicated probability distributions. However, as the dimension of the distribution gets larger, the computational costs for a satisfactory…

Cosmology and Nongalactic Astrophysics · Physics 2020-12-01 Hector J. Hortua , Riccardo Volpi , Dimitri Marinelli , Luigi Malago

This paper aims to establish a central limit theorem for Markov processes conditioned not to be absorbed under a very general assumption on quasi-stationarity for the underlying process. To do so, a central limit theorem has been…

Probability · Mathematics 2023-03-31 William Oçafrain

In dynamic Monte Carlo simulations, using for example the Metropolis dynamic, it is often required to simulate for long times and to simulate large systems. We present an overview of advanced algorithms to simulate for larger times and to…

Statistical Mechanics · Physics 2007-05-23 M. A. Novotny , Alice K. Kolakowska , G. Korniss

This short note investigates convergence of adaptive MCMC algorithms, i.e.\ algorithms which modify the Markov chain update probabilities on the fly. We focus on the Containment condition introduced in \cite{roberts2007coupling}. We show…

Computation · Statistics 2013-12-31 Krzysztof Latuszynski , Jeffrey S. Rosenthal

We propose a new class of interacting Markov chain Monte Carlo (MCMC) algorithms designed for increasing the efficiency of a modified multiple-try Metropolis (MTM) algorithm. The extension with respect to the existing MCMC literature is…

Computation · Statistics 2014-03-19 Roberto Casarin , Radu V. Craiu , Fabrizio Leisen

Markov chain Monte Carlo (MCMC) algorithms provide a very general recipe for estimating properties of complicated distributions. While their use has become commonplace and there is a large literature on MCMC theory and practice, MCMC users…

Computation · Statistics 2012-05-03 Murali Haran , Luke Tierney