English
Related papers

Related papers: Complexity Results for MCMC derived from Quantitat…

200 papers

Convergence rate analyses of random walk Metropolis-Hastings Markov chains on general state spaces have largely focused on establishing sufficient conditions for geometric ergodicity or on analysis of mixing times. Geometric ergodicity is a…

Statistics Theory · Mathematics 2023-07-24 Riddhiman Bhattacharya , Galin L. Jones

We propose cube thinning, a novel method for compressing the output of a MCMC (Markov chain Monte Carlo) algorithm when control variates are available. It amounts to resampling the initial MCMC sample (according to weights derived from…

Computation · Statistics 2021-09-01 Nicolas Chopin , Gabriel Ducrocq

High-throughput characterization often requires estimating parameters and model dimension from experimental data of limited quantity and quality. Such data may result in an ill-posed inverse problem, where multiple sets of parameters and…

Quantum Physics · Physics 2026-04-08 Abigail N. Poteshman , Jiwon Yun , Tim H. Taminiau , Giulia Galli

We develop clustering procedures for longitudinal trajectories based on a continuous-time hidden Markov model (CTHMM) and a generalized linear observation model. Specifically in this paper, we carry out finite and infinite mixture…

Methodology · Statistics 2021-12-08 Yu Luo , David A. Stephens , David L. Buckeridge

Markov Chain Monte Carlo (MCMC) methods such as Gibbs sampling are finding widespread use in applied statistics and machine learning. These often lead to difficult computational problems, which are increasingly being solved on parallel and…

Machine Learning · Statistics 2018-06-05 Alexander Terenin , Eric P. Xing

In this paper, we give quantitative bounds on the $f$-total variation distance from convergence of an Harris recurrent Markov chain on an arbitrary under drift and minorisation conditions implying ergodicity at a sub-geometric rate. These…

Probability · Mathematics 2007-05-23 Randal Douc , Eric Moulines , Philippe Soulier

We prove new upper and lower bounds for sample complexity of finding an $\epsilon$-optimal policy of an infinite-horizon average-reward Markov decision process (MDP) given access to a generative model. When the mixing time of the…

Machine Learning · Computer Science 2021-06-15 Yujia Jin , Aaron Sidford

We consider Markov chain Monte Carlo (MCMC) algorithms for Bayesian high-dimensional regression with continuous shrinkage priors. A common challenge with these algorithms is the choice of the number of iterations to perform. This is…

Methodology · Statistics 2021-07-13 Niloy Biswas , Anirban Bhattacharya , Pierre E. Jacob , James E. Johndrow

Sampling from high-dimensional Gibbs measures poses a challenge when the energy landscape consists of multiple metastable states. Enhanced-sampling methods mitigate this difficulty by introducing adaptive biasing potentials to facilitate…

Numerical Analysis · Mathematics 2026-05-06 Liyao Lyu , Siyu Guo , Huan Lei

Mixture models, such as Gaussian mixture models, are widely used in machine learning to represent complex data distributions. A key challenge, especially in high-dimensional settings, is to determine the mixture order and estimate the…

Optimization and Control · Mathematics 2025-09-30 Srećko Đurašinović , Jean-Bernard Lasserre , Victor Magron

We elaborate the idea behind Markov chain Monte Carlo (MCMC) methods in a mathematically coherent, yet simple and understandable way. To this end, we proof a pivotal convergence theorem for finite Markov chains and a minimal version of the…

Statistics Theory · Mathematics 2019-07-30 Tobias Siems

The goal of this expository paper is to describe conditions which guarantee a central limit theorem for functionals of general state space Markov chains. This is done with a view towards Markov chain Monte Carlo settings and hence the focus…

Probability · Mathematics 2007-06-13 Galin L. Jones

Statistical inference in evolutionary models with site-dependence is a long-standing challenge in phylogenetics and computational biology. We consider the problem of approximating marginal sequence likelihoods under dependent-site models of…

Computation · Statistics 2025-11-12 Joseph Mathews , Scott C. Schmidler

Convergence rate analysis for general state-space Markov chains is fundamentally important in areas such as Markov chain Monte Carlo and algorithmic analysis (for computing explicit convergence bounds). This problem, however, is notoriously…

Machine Learning · Computer Science 2025-07-22 Yanlin Qu , Jose Blanchet , Peter Glynn

A general methodology is introduced for the construction and effective application of control variates to estimation problems involving data from reversible MCMC samplers. We propose the use of a specific class of functions as control…

Computation · Statistics 2010-08-10 Petros Dellaportas , Ioannis Kontoyiannis

We present an exclusion process based approach for sampling densest $k$-sub-graphs from regular graphs $L$ with connected complement. By interpreting an exclusion process as a Markov chain on a corresponding Token Graph $\mathfrak{L}_k$, we…

Probability · Mathematics 2023-01-12 Jens Walter Fischer

We consider Markov chains on general state spaces in stationary random environment which are defined by a random mapping that is contractive up to a bounded perturbation. We prove their convergence to a limiting law, providing convergence…

Probability · Mathematics 2025-12-18 Attila Lovas , Miklós Rásonyi , Lionel Truquet

Gibbs sampling is a Markov chain Monte Carlo method that is often used for learning and inference on graphical models. Minibatching, in which a small random subset of the graph is used at each iteration, can help make Gibbs sampling scale…

Machine Learning · Computer Science 2019-11-25 Ruqi Zhang , Christopher De Sa

For algorithms based on interacting particle systems that admit a mean-field description, convergence analysis is often more accessible at the mean-field level. In order to transfer convergence results obtained at the mean-field level to…

Probability · Mathematics 2025-11-03 Nicolai Jurek Gerber , Franca Hoffmann , Urbain Vaes

The problem of sampling constrained continuous distributions has frequently appeared in many machine/statistical learning models. Many Monte Carlo Markov Chain (MCMC) sampling methods have been adapted to handle different types of…

Computation · Statistics 2023-02-21 Shiwei Lan , Lulu Kang