English
Related papers

Related papers: MCMC Algorithms for Posteriors on Matrix Spaces

200 papers

Markov Chain Monte Carlo (MCMC) is a flexible approach to approximate sampling from intractable probability distributions, with a rich theoretical foundation and comprising a wealth of exemplar algorithms. While the qualitative correctness…

Computation · Statistics 2025-11-27 Sam Power , Giorgos Vasdekis

For large model spaces, the potential entrapment of Markov chain Monte Carlo (MCMC) based methods with spike-and-slab priors poses significant challenges in posterior computation in regression models. On the other hand, maximum a posteriori…

Methodology · Statistics 2026-02-25 Shamriddha De , Joyee Ghosh

Recent advances in stochastic gradient techniques have made it possible to estimate posterior distributions from large datasets via Markov Chain Monte Carlo (MCMC). However, when the target posterior is multimodal, mixing performance is…

Machine Learning · Statistics 2018-01-12 Yizhe Zhang , Changyou Chen , Zhe Gan , Ricardo Henao , Lawrence Carin

In this paper we study the ergodicity properties of some adaptive Markov chain Monte Carlo algorithms (MCMC) that have been recently proposed in the literature. We prove that under a set of verifiable conditions, ergodic averages calculated…

Probability · Mathematics 2016-08-16 Christophe Andrieu , Éric Moulines

The Markov Chain Monte Carlo (MCMC) methods are popular when considering sampling from a high-dimensional random variable $\mathbf{x}$ with possibly unnormalised probability density $p$ and observed data $\mathbf{d}$. However, MCMC requires…

Computation · Statistics 2020-03-11 Haoyun Ying , Keheng Mao , Klaus Mosegaard

Bayesian inverse problems often involve sampling posterior distributions on infinite-dimensional function spaces. Traditional Markov chain Monte Carlo (MCMC) algorithms are characterized by deteriorating mixing times upon mesh-refinement,…

Computation · Statistics 2017-03-08 Alexandros Beskos , Mark Girolami , Shiwei Lan , Patrick E. Farrell , Andrew M. Stuart

Markov chain Monte Carlo (MCMC) algorithms are indispensable when sampling from a complex, high-dimensional distribution by a conventional method is intractable. Even though MCMC is a powerful tool, it is also hard to control and tune in…

Graphics · Computer Science 2025-10-14 Sascha Holl , Gurprit Singh , Hans-Peter Seidel

Adaptive Markov chain Monte Carlo (MCMC) algorithms, which automatically tune their parameters based on past samples, have proved extremely useful in practice. The self-tuning mechanism makes them `non-Markovian', which means that their…

Probability · Mathematics 2024-08-28 Pietari Laitinen , Matti Vihola

Adaptive and interacting Markov chain Monte Carlo algorithms (MCMC) have been recently introduced in the literature. These novel simulation algorithms are designed to increase the simulation efficiency to sample complex distributions.…

Statistics Theory · Mathematics 2012-03-15 G. Fort , E. Moulines , P. Priouret

We develop a novel Markov chain Monte Carlo (MCMC) method that exploits a hierarchy of models of increasing complexity to efficiently generate samples from an unnormalized target distribution. Broadly, the method rewrites the Multilevel…

Methodology · Statistics 2022-09-05 Mikkel B. Lykkegaard , Tim J. Dodwell , Colin Fox , Grigorios Mingas , Robert Scheichl

Markov chain Monte Carlo (MCMC) lies at the core of modern Bayesian methodology, much of which would be impossible without it. Thus, the convergence properties of MCMCs have received significant attention, and in particular, proving…

Statistics Theory · Mathematics 2015-08-28 Bala Rajaratnam , Doug Sparks

We construct a new framework for accelerating Markov chain Monte Carlo in posterior sampling problems where standard methods are limited by the computational cost of the likelihood, or of numerical models embedded therein. Our approach…

Methodology · Statistics 2017-01-06 Patrick R. Conrad , Youssef M. Marzouk , Natesh S. Pillai , Aaron Smith

Markov chain Monte Carlo (MCMC) provides a feasible method for inferring Hidden Markov models, however, it is often computationally prohibitive, especially constrained by the curse of dimensionality, as the Monte Carlo sampler traverses…

Artificial Intelligence · Computer Science 2023-09-13 Xiongming Dai , Gerald Baumgartner

Performing numerical integration when the integrand itself cannot be evaluated point-wise is a challenging task that arises in statistical analysis, notably in Bayesian inference for models with intractable likelihood functions. Markov…

Computation · Statistics 2020-06-17 Lawrence Middleton , George Deligiannidis , Arnaud Doucet , Pierre E. Jacob

We propose a sequential Markov chain Monte Carlo (SMCMC) algorithm to sample from a sequence of probability distributions, corresponding to posterior distributions at different times in on-line applications. SMCMC proceeds as in usual MCMC…

Statistics Theory · Mathematics 2013-08-20 Yun Yang , David B. Dunson

Hyperbolic models are known to produce networks with properties observed empirically in most network datasets, including heavy-tailed degree distribution, high clustering, and hierarchical structures. As a result, several embeddings…

Computation · Statistics 2025-05-16 Simon Lizotte , Jean-Gabriel Young , Antoine Allard

We develop an Evolutionary Markov Chain Monte Carlo (EMCMC) algorithm for sampling spatial partitions that lie within a large and complex spatial state space. Our algorithm combines the advantages of evolutionary algorithms (EAs) as…

Computation · Statistics 2021-01-19 Wendy K. Tam Cho , Yan Y. Liu

Evaluating the degree of partisan districting (Gerrymandering) in a statistical framework typically requires an ensemble of districting plans which are drawn from a prescribed probability distribution that adheres to a realistic and…

Computation · Statistics 2020-08-19 Gregory Herschlag , Jonathan C. Mattingly , Matthias Sachs , Evan Wyse

Markov chain Monte Carlo (MCMC) methods have existed for a long time and the field is well-explored. The purpose of MCMC methods is to approximate a distribution through repeated sampling; most MCMC algorithms exhibit asymptotically optimal…

Computation · Statistics 2023-07-13 Fareed Sheriff

Bayesian Neural Networks (BNNs) provide a promising framework for modeling predictive uncertainty and enhancing out-of-distribution robustness (OOD) by estimating the posterior distribution of network parameters. Stochastic Gradient Markov…

Machine Learning · Computer Science 2025-03-04 Hyunsu Kim , Giung Nam , Chulhee Yun , Hongseok Yang , Juho Lee