English
Related papers

Related papers: Fast Doubly-Adaptive MCMC to Estimate the Gibbs Pa…

200 papers

Exact approximations of Markov chain Monte Carlo (MCMC) algorithms are a general emerging class of sampling algorithms. One of the main ideas behind exact approximations consists of replacing intractable quantities required to run standard…

Computation · Statistics 2015-10-30 Christophe Andrieu , Matti Vihola

We give algorithms for approximating the partition function of the ferromagnetic $q$-color Potts model on graphs of maximum degree $d$. Our primary contribution is a fully polynomial-time approximation scheme for $d$-regular graphs with an…

Data Structures and Algorithms · Computer Science 2024-11-20 Charlie Carlson , Ewan Davies , Nicolas Fraiman , Alexandra Kolla , Aditya Potukuchi , Corrine Yap

Exponential random graph models are extremely difficult models to handle from a statistical viewpoint, since their normalising constant, which depends on model parameters, is available only in very trivial cases. We show how inference can…

Applications · Statistics 2010-09-30 Alberto Caimo , Nial Friel

Stochastic Gradient (SG) Markov Chain Monte Carlo algorithms (MCMC) are popular algorithms for Bayesian sampling in the presence of large datasets. However, they come with little theoretical guarantees and assessing their empirical…

Machine Learning · Statistics 2024-05-16 Lorenzo Mauri , Giacomo Zanella

We recently introduced a mM-MCMC scheme that is able to accelerate the sampling of Gibbs distributions when there is a time-scale separation between the complete molecular dynamics and the slow dynamics of a low dimensional reaction…

Numerical Analysis · Mathematics 2022-09-28 Hannes Vandecasteele , Giovanni Samaey

There is a tension between robustness and efficiency when designing Markov chain Monte Carlo (MCMC) sampling algorithms. Here we focus on robustness with respect to tuning parameters, showing that more sophisticated algorithms tend to be…

Computation · Statistics 2020-05-12 Samuel Livingstone , Giacomo Zanella

Cyclical MCMC is a novel MCMC framework recently proposed by Zhang et al. (2019) to address the challenge posed by high-dimensional multimodal posterior distributions like those arising in deep learning. The algorithm works by generating a…

Computation · Statistics 2024-03-04 Liwei Wang , Xinru Liu , Aaron Smith , Yves Atchade

Many scientific and engineering problems require to perform Bayesian inferences in function spaces, in which the unknowns are of infinite dimension. In such problems, many standard Markov Chain Monte Carlo (MCMC) algorithms become arbitrary…

Numerical Analysis · Mathematics 2016-04-12 Zhe Feng , Jinglai Li

Sampling from complicated probability distributions is a hard computational problem arising in many fields, including statistical physics, optimization, and machine learning. Quantum computers have recently been used to sample from…

Bayesian inference using Markov Chain Monte Carlo (MCMC) on large datasets has developed rapidly in recent years. However, the underlying methods are generally limited to relatively simple settings where the data have specific forms of…

Methodology · Statistics 2020-02-18 Robert Salomone , Matias Quiroz , Robert Kohn , Mattias Villani , Minh-Ngoc Tran

We consider the question of Markov chain Monte Carlo sampling from a general stick-breaking Dirichlet process mixture model, with concentration parameter alpha. This paper introduces a Gibbs sampling algorithm that combines the slice…

Computation · Statistics 2014-02-21 David I. Hastie , Silvia Liverani , Sylvia Richardson

We present a general framework for accelerating a large class of widely used Markov chain Monte Carlo (MCMC) algorithms. Our approach exploits fast, iterative approximations to the target density to speculatively evaluate many potential…

Machine Learning · Statistics 2014-03-31 Elaine Angelino , Eddie Kohler , Amos Waterland , Margo Seltzer , Ryan P. Adams

In this paper we consider the problem of computing the stationary distribution of nearly completely decomposable Markov processes, a well-established area in the classical theory of Markov processes with broad applications in the design,…

Numerical Analysis · Mathematics 2025-06-19 Vasileios Kalantzis , Mark S. Squillante , Chai Wah Wu

An autonomous variational inference algorithm for arbitrary graphical models requires the ability to optimize variational approximations over the space of model parameters as well as over the choice of tractable families used for the…

Machine Learning · Computer Science 2012-07-19 Eric P. Xing , Michael I. Jordan , Stuart Russell

Bayesian inference for doubly-intractable pairwise exponential graphical models typically involves variations of the exchange algorithm or approximate Markov chain Monte Carlo (MCMC) samplers. However, existing methods for both classes of…

Computation · Statistics 2026-03-30 Yujie Chen , Antik Chakraborty , Anindya Bhadra

The rapid development of computing power and efficient Markov Chain Monte Carlo (MCMC) simulation algorithms have revolutionized Bayesian statistics, making it a highly practical inference method in applied work. However, MCMC algorithms…

Methodology · Statistics 2018-09-21 Matias Quiroz , Mattias Villani , Robert Kohn , Minh-Ngoc Tran , Khue-Dung Dang

We give the first rigorous proof of the convergence of Riemannian Hamiltonian Monte Carlo, a general (and practical) method for sampling Gibbs distributions. Our analysis shows that the rate of convergence is bounded in terms of natural…

Data Structures and Algorithms · Computer Science 2017-10-18 Yin Tat Lee , Santosh S. Vempala

This paper derives two new optimization-driven Monte Carlo algorithms inspired from variable splitting and data augmentation. In particular, the formulation of one of the proposed approaches is closely related to the alternating direction…

Methodology · Statistics 2019-03-27 Maxime Vono , Nicolas Dobigeon , Pierre Chainais

Gibbs sampling is fundamental to a wide range of computer algorithms. Such algorithms are set to be replaced by physics based processors$-$be it quantum or stochastic annealing devices$-$which embed problem instances and evolve a physical…

Quantum Physics · Physics 2019-06-27 H. Philathong , V. Akshay , I. Zacharov , J. Biamonte

A new algorithm based on bayesian inference for learning local graph conductance based on Gaussian Process(GP) is given that uses advanced MCMC convergence ideas to create a scalable and fast algorithm for convergence to stationary…

Machine Learning · Computer Science 2022-04-28 Farshad Noravesh