English
Related papers

Related papers: Approximate spectral gaps for Markov chains mixing…

200 papers

Markov Chain Monte Carlo methods are widely used in signal processing and communications for statistical inference and stochastic optimization. In this work, we introduce an efficient adaptive Metropolis-Hastings algorithm to draw samples…

Computation · Statistics 2016-03-17 David Luengo , Luca Martino

An important problem in the implementation of Markov Chain Monte Carlo algorithms is to determine the convergence time, or the number of iterations before the chain is close to stationarity. For many Markov chains used in practice this time…

Data Structures and Algorithms · Computer Science 2010-07-02 Nayantara Bhatnagar , Andrej Bogdanov , Elchanan Mossel

Adaptive Markov Chain Monte Carlo (AMCMC) is a class of MCMC algorithms where the proposal distribution changes at every iteration of the chain. In this case it is important to verify that such a Markov Chain indeed has a stationary…

Probability · Mathematics 2015-09-07 Gopal K. Basak , Arunangshu Biswas

In this paper, we address the challenge of Markov Chain Monte Carlo (MCMC) algorithms within the approximate Bayesian Computation (ABC) framework, which often get trapped in local optima due to their inherent local exploration mechanism. We…

Computation · Statistics 2025-12-16 Xuefei Cao , Shijia Wang , Yongdao Zhou

MCMC methods (Monte Carlo Markov Chain) are a class of methods used to perform simulations per a probability distribution $P$. These methods are often used when we have difficulties to directly sample per a given probability distribution…

Methodology · Statistics 2014-01-21 Papa Ngom , Badiassiatta Don Bosco Diatta

We consider the computational task of sampling a bit string $x$ from a distribution $\pi(x)=|\langle x|\psi\rangle|^2$, where $\psi$ is the unique ground state of a local Hamiltonian $H$. Our main result describes a direct link between the…

Quantum Physics · Physics 2023-11-09 Sergey Bravyi , Giuseppe Carleo , David Gosset , Yinchen Liu

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such…

Machine Learning · Statistics 2021-10-05 Theodore Papamarkou , Jacob Hinkle , M. Todd Young , David Womble

Gibbs sampling methods are standard tools to perform posterior inference for mixture models. These have been broadly classified into two categories: marginal and conditional methods. While conditional samplers are more widely applicable…

Methodology · Statistics 2023-02-21 Pierpaolo De Blasi , María F. Gil-Leyva

We consider the efficient use of an approximation within Markov chain Monte Carlo (MCMC), with subsequent importance sampling (IS) correction of the Markov chain inexact output, leading to asymptotically exact inference. We detail…

Computation · Statistics 2019-04-15 Jordan Franks

Sparsity has become a key concept for solving of high-dimensional inverse problems using variational regularization techniques. Recently, using similar sparsity-constraints in the Bayesian framework for inverse problems by encoding them in…

Numerical Analysis · Mathematics 2014-11-18 Felix Lucka

In this paper we study asymptotic properties of different data-augmentation-type Markov chain Monte Carlo algorithms sampling from mixture models comprising discrete as well as continuous random variables. Of particular interest to us is…

Computation · Statistics 2014-04-04 Randal Douc , Florian Maire , Jimmy Olsson

High-dimensional distributions, especially those with heavy tails, are notoriously difficult for off-the-shelf MCMC samplers: the combination of unbounded state spaces, diminishing gradient information, and local moves results in…

Computation · Statistics 2024-02-22 Jun Yang , Krzysztof Łatuszyński , Gareth O. Roberts

There is a lack of methodological results for continuous time change detection due to the challenges of noninformative prior specification and efficient posterior inference in this setting. Most methodologies to date assume data are…

Methodology · Statistics 2025-04-28 Dan Cunha , Mark Friedl , Luis Carvalho

Markov chain Monte Carlo (MCMC) methods generate samples that are asymptotically distributed from a target distribution of interest as the number of iterations goes to infinity. Various theoretical results provide upper bounds on the…

Computation · Statistics 2019-10-30 Niloy Biswas , Pierre E. Jacob , Paul Vanetti

The Gibbs sampler (GS) is a crucial algorithm for approximating complex calculations, and it is justified by Markov chain theory, the alternating projection theorem, and $I$-projection, separately. We explore the equivalence between these…

Computation · Statistics 2024-10-15 Kun-Lin Kuo , Yuchung J. Wang

This paper proposes a novel approach to generate samples from target distributions that are difficult to sample from using Markov Chain Monte Carlo (MCMC) methods. Traditional MCMC algorithms often face slow convergence due to the…

Cosmology and Nongalactic Astrophysics · Physics 2023-08-11 Sandro Dias Pinto Vitenti , Eduardo J. Barroso

A common tool in the practice of Markov Chain Monte Carlo is to use approximating transition kernels to speed up computation when the desired kernel is slow to evaluate or intractable. A limited set of quantitative tools exist to assess the…

Probability · Mathematics 2026-01-14 Jeffrey Negrea , Jeffrey S. Rosenthal

Markov chain Monte Carlo (MCMC) methods are ubiquitous tools for simulation-based inference in many fields but designing and identifying good MCMC samplers is still an open question. This paper introduces a novel MCMC algorithm, namely,…

As it has become common to use many computer cores in routine applications, finding good ways to parallelize popular algorithms has become increasingly important. In this paper, we present a parallelization scheme for Markov chain Monte…

Methodology · Statistics 2016-06-01 Guillaume W. Basse , Natesh S. Pillai , Aaron Smith

We introduce a framework for efficient Markov Chain Monte Carlo (MCMC) algorithms targeting discrete-valued high-dimensional distributions, such as posterior distributions in Bayesian variable selection (BVS) problems. We show that many…

Computation · Statistics 2021-10-28 Xitong Liang , Samuel Livingstone , Jim Griffin