English
Related papers

Related papers: Limit theorems for some adaptive MCMC algorithms w…

200 papers

The goal of this paper is to describe conditions which guarantee a central limit theorem for random variables, which distributions are controled by hidden Markov chains. We proved that when a Markov chain is ergodic and random variables…

Statistics Theory · Mathematics 2018-10-11 Anna Czapkiewicz , Antoni Dawidowicz

Our purpose is to prove central limit theorem for countable nonhomogeneous Markov chain under the condition of uniform convergence of transition probability matrices for countable nonhomogeneous Markov chain in Ces\`aro sense. Furthermore,…

Probability · Mathematics 2020-10-15 Mingzhou Xu , Yunzheng Ding , Yongzheng Zhou

A natural method for the introduction of second-order derivatives of the log likelihood into MCMC algorithms is introduced, based on Taylor expansion of the Langevin equation followed by exact solution of the truncated system.

Computation · Statistics 2015-07-24 Thomas House

Bayesian inverse problems highly rely on efficient and effective inference methods for uncertainty quantification (UQ). Infinite-dimensional MCMC algorithms, directly defined on function spaces, are robust under refinement of physical…

Computation · Statistics 2019-05-22 Shiwei Lan

A new methodology is presented for the construction of control variates to reduce the variance of additive functionals of Markov Chain Monte Carlo (MCMC) samplers. Our control variates are definedthrough the minimization of the asymptotic…

Methodology · Statistics 2019-07-09 Nicolas Brosse , Alain Durmus , Sean Meyn , Eric Moulines , Anand Radhakrishnan

Delayed-acceptance Markov chain Monte Carlo (DA-MCMC) samples from a probability distribution via a two-stages version of the Metropolis-Hastings algorithm, by combining the target distribution with a "surrogate" (i.e. an approximate and…

We study the limit behaviour of a generally non-linear ordinary differential equation whose solution is a superadditive generalisation of a stochastic matrix, and provide necessary and sufficient conditions for this solution to be ergodic,…

Probability · Mathematics 2016-09-21 Jasper De Bock

Recently, Stochastic Gradient Markov Chain Monte Carlo (SG-MCMC) methods have been proposed for scaling up Monte Carlo computations to large data problems. Whilst these approaches have proven useful in many applications, vanilla SG-MCMC…

Machine Learning · Statistics 2016-12-13 Umut Şimşekli , Roland Badeau , A. Taylan Cemgil , Gaël Richard

To sample from a given target distribution, Markov chain Monte Carlo (MCMC) sampling relies on constructing an ergodic Markov chain with the target distribution as its invariant measure. For any MCMC method, an important question is how to…

Probability · Mathematics 2023-08-15 Federica Milinanni , Pierre Nyquist

Convergence rate analyses of random walk Metropolis-Hastings Markov chains on general state spaces have largely focused on establishing sufficient conditions for geometric ergodicity or on analysis of mixing times. Geometric ergodicity is a…

Statistics Theory · Mathematics 2023-07-24 Riddhiman Bhattacharya , Galin L. Jones

We investigate the problem of quantifying contraction coefficients of Markov transition kernels in Kantorovich ($L^1$ Wasserstein) distances. For diffusion processes, relatively precise quantitative bounds on contraction rates have recently…

Probability · Mathematics 2018-08-22 Andreas Eberle , Mateusz B. Majka

Recently, many Markov chain Monte Carlo methods have been developed with deterministic reversible transform proposals inspired by the Hamiltonian Monte Carlo method. The deterministic transform is relatively easy to reconcile with the local…

Methodology · Statistics 2021-11-12 Kengo Kamatani , Xiaolin Song

Markov chain Monte Carlo (MCMC) algorithms provide a very general recipe for estimating properties of complicated distributions. While their use has become commonplace and there is a large literature on MCMC theory and practice, MCMC users…

Computation · Statistics 2012-05-03 Murali Haran , Luke Tierney

Performing numerical integration when the integrand itself cannot be evaluated point-wise is a challenging task that arises in statistical analysis, notably in Bayesian inference for models with intractable likelihood functions. Markov…

Computation · Statistics 2020-06-17 Lawrence Middleton , George Deligiannidis , Arnaud Doucet , Pierre E. Jacob

We prove the Local Limit Theorems for bounded additive functionals of uniformly elliptic inhomogeneous Markov arrays. As an application we obtain the precise asymptotics in the large deviation regime for bounded additive functionals of…

Probability · Mathematics 2025-07-31 Dmitry Dolgopyat , Omri Sarig

Hamiltonian Monte Carlo (HMC) is a widely used sampler for continuous probability distributions. In many cases, the underlying Hamiltonian dynamics exhibit a phenomenon of resonance which decreases the efficiency of the algorithm and makes…

Computation · Statistics 2023-02-23 Lionel Riou-Durand , Pavel Sountsov , Jure Vogrinc , Charles C. Margossian , Sam Power

Markov chain Monte Carlo (MCMC) algorithms are used to estimate features of interest of a distribution. The Monte Carlo error in estimation has an asymptotic normal distribution whose multivariate nature has so far been ignored in the MCMC…

Statistics Theory · Mathematics 2016-07-05 Dootika Vats , James M. Flegal , Galin L. Jones

Markov chain (MC) algorithms are ubiquitous in machine learning and statistics and many other disciplines. Typically, these algorithms can be formulated as acceptance rejection methods. In this work we present a novel estimator applicable…

Machine Learning · Statistics 2020-08-07 Ingmar Schuster , Ilja Klebanov

Elliptical slice sampling is a widely used gradient-free Markov chain Monte Carlo algorithm that is tuning-free and capable of adapting to local characteristics of the target distribution. However, its primary limitation is that sampling…

Computation · Statistics 2026-05-22 Nicholas Marco , Surya T. Tokdar

We propose two algorithms for the solution of the optimal control of ergodic McKean-Vlasov dynamics. Both algorithms are based on approximations of the theoretical solutions by neural networks, the latter being characterized by their…

Optimization and Control · Mathematics 2021-03-30 René Carmona , Mathieu Laurière