English
Related papers

Related papers: Uniform ergodicity of the Particle Gibbs sampler

200 papers

Exploration of the intractable posterior distributions associated with Bayesian versions of the general linear mixed model is often performed using Markov chain Monte Carlo. In particular, if a conditionally conjugate prior is used, then…

Statistics Theory · Mathematics 2016-10-03 Tavis Abrahamsen , James P. Hobert

An Automated Sliced Gibbs framework is proposed for fully automated Markov chain Monte Carlo sampling from arbitrary finite dimensional probability kernels. The method targets unnormalized, non-smooth, heavy tailed, and highly multimodal…

Methodology · Statistics 2026-04-01 Prithwish Ghosh , Sujit K Ghosh

Geodesic slice sampling, introduced in Durmus et al., 2024, is a slice sampling based Markov chain Monte Carlo method for approximate sampling from distributions on Riemannian manifolds. We prove that it is uniformly ergodic for…

Statistics Theory · Mathematics 2025-10-09 Mareike Hasenpflug

Many applications in the field of statistics require Markov chain Monte Carlo methods. Determining appropriate starting values and run lengths can be both analytically and empirically challenging. A desire to overcome these problems has led…

Computation · Statistics 2012-03-09 James M. Flegal , Radu Herbei

Using elementary methods, we prove that for a countable Markov chain $P$ of ergodic degree $d > 0$ the rate of convergence towards the stationary distribution is subgeometric of order $n^{-d}$, provided the initial distribution satisfies…

Probability · Mathematics 2007-05-23 Stefano Isola

This paper introduces a concept of approximate spectral gap to analyze the mixing time of Markov Chain Monte Carlo (MCMC) algorithms for which the usual spectral gap is degenerate or almost degenerate. We use the idea to analyze a class of…

Computation · Statistics 2019-08-26 Yves F. Atchadé

In our earlier paper, a generalized Dobrushin ergodicity coefficient of Markov operators (acting on abstract state spaces) with respect to a projection $P$, has been introduced and studied. It turned out that the introduced coefficient was…

Functional Analysis · Mathematics 2020-01-22 Farrukh Mukhamedov , Ahmed Al-Rawashdeh

The emergence of big data has led to so-called convergence complexity analysis, which is the study of how Markov chain Monte Carlo (MCMC) algorithms behave as the sample size, $n$, and/or the number of parameters, $p$, in the underlying…

Statistics Theory · Mathematics 2020-06-24 Bryant Davis , James P. Hobert

In this short note we prove ``effective" geometric ergodicity (i.e a Perron-Frobenius theorem) for Markov chains in random mixing dynamical environment satisfying a random non-uniform version of the Doeblin condition. Effectivity here means…

Probability · Mathematics 2026-01-05 Yeor Hafouta

We present a novel method in the family of particle MCMC methods that we refer to as particle Gibbs with ancestor sampling (PG-AS). Similarly to the existing PG with backward simulation (PG-BS) procedure, we use backward sampling to…

Computation · Statistics 2014-09-17 Fredrik Lindsten , Michael I. Jordan , Thomas B. Schön

A novel strategy that combines a given collection of $\pi$-reversible Markov kernels is proposed. At each Markov transition, one of the available kernels is selected via a state-dependent probability distribution. In contrast to random-scan…

Methodology · Statistics 2022-03-30 Florian Maire , Pierre Vandekerkhove

Let $(\xi_n)_{n=0}^\infty$ be a nonhomogeneous Markov chain taking values from finite state-space of $\mathbf{X}=\{1,2,\ldots,b\}$. In this paper, we will study the generalized entropy ergodic theorem with almost-everywhere and…

Probability · Mathematics 2015-01-19 Zhongzhi Wang , Weiguo Yang

State space models (SSMs) are widely used to describe dynamic systems. However, when the likelihood of the observations is intractable, parameter inference for SSMs cannot be easily carried out using standard Markov chain Monte Carlo or…

Methodology · Statistics 2023-12-21 Zhaoran Hou , Samuel W. K. Wong

In this paper we study the ergodicity properties of some adaptive Markov chain Monte Carlo algorithms (MCMC) that have been recently proposed in the literature. We prove that under a set of verifiable conditions, ergodic averages calculated…

Probability · Mathematics 2016-08-16 Christophe Andrieu , Éric Moulines

There has been recent interest in developing scalable Bayesian sampling methods such as stochastic gradient MCMC (SG-MCMC) and Stein variational gradient descent (SVGD) for big-data analysis. A standard SG-MCMC algorithm simulates samples…

Machine Learning · Statistics 2018-07-11 Changyou Chen , Ruiyi Zhang , Wenlin Wang , Bai Li , Liqun Chen

We study weighted ensemble, an interacting particle method for sampling distributions of Markov chains that has been used in computational chemistry since the 1990s. Many important applications of weighted ensemble require the computation…

Numerical Analysis · Mathematics 2022-04-22 David Aristoff

We study geometric ergodicity of the Gibbs sampler for linear latent non-Gaussian models (LLnGMs), a class of hierarchical models in which conditional Gaussian structure is preserved through generalized inverse Gaussian (GIG)…

Statistics Theory · Mathematics 2026-02-10 Elsiddig Awadelkarim , David Bolin , Xiaotian Jin , Alexandre B. Simas , Jonas Wallin

\emph{Sampling} constitutes an important tool in a variety of areas: from machine learning and combinatorial optimization to computational physics and biology. A central class of sampling algorithms is the \emph{Markov Chain Monte Carlo}…

Data Structures and Algorithms · Computer Science 2018-05-16 Manuela Fischer , Mohsen Ghaffari

The Partially Collapsed Gibbs (PCG) sampler offers a new strategy for improving the convergence of a Gibbs sampler. PCG achieves faster convergence by reducing the conditioning in some of the draws of its parent Gibbs sampler. Although this…

Computation · Statistics 2016-02-19 David A. van Dyk , Xiyun Jiao

Sampling from matrix generalized inverse Gaussian (MGIG) distributions is required in Markov Chain Monte Carlo (MCMC) algorithms for a variety of statistical models. However, an efficient sampling scheme for the MGIG distributions has not…

Methodology · Statistics 2023-11-08 Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa