English
Related papers

Related papers: A Simple Parallel and Distributed Sampling Techniq…

200 papers

We study the single-site Glauber dynamics for the fugacity $\lambda$, Hard-core model on the random graph $G(n, d/n)$. We show that for the typical instances of the random graph $G(n,d/n)$ and for fugacity $\lambda <…

Discrete Mathematics · Computer Science 2023-02-14 Charilaos Efthymiou , Weiming Feng

Markov Chain Monte Carlo (MCMC) methods such as Gibbs sampling are finding widespread use in applied statistics and machine learning. These often lead to difficult computational problems, which are increasingly being solved on parallel and…

Machine Learning · Statistics 2018-06-05 Alexander Terenin , Eric P. Xing

We consider the performance of Glauber dynamics for the random cluster model with real parameter $q>1$ and temperature $\beta>0$. Recent work by Helmuth, Jenssen and Perkins detailed the ordered/disordered transition of the model on random…

Probability · Mathematics 2025-04-30 Andreas Galanis , Leslie Ann Goldberg , Paulina Smolarova

It is common practice in Markov chain Monte Carlo to update the simulation one variable (or sub-block of variables) at a time, rather than conduct a single full-dimensional update. When it is possible to draw from each full-conditional…

Computation · Statistics 2013-10-03 Alicia A. Johnson , Galin L. Jones , Ronald C. Neath

We address the convergence rate of Markov chains for randomly generating an edge coloring of a given tree. Our focus is on the Glauber dynamics which updates the color at a randomly chosen edge in each step. For a tree $T$ with $n$ vertices…

Discrete Mathematics · Computer Science 2024-07-08 Charlie Carlson , Xiaoyu Chen , Weiming Feng , Eric Vigoda

Markov chain sampling methods that automatically adapt to characteristics of the distribution being sampled can be constructed by exploiting the principle that one can sample from a distribution by sampling uniformly from the region under…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Radford M. Neal

The Gibbs sampler (a.k.a. Glauber dynamics and heat-bath algorithm) is a popular Markov Chain Monte Carlo algorithm which iteratively samples from the conditional distributions of a probability measure $\pi$ of interest. Under the…

Probability · Mathematics 2026-01-21 Filippo Ascolani , Hugo Lavenant , Giacomo Zanella

We study Markov chains for randomly sampling $k$-colorings of a graph with maximum degree $\Delta$. Our main result is a polynomial upper bound on the mixing time of the single-site update chain known as the Glauber dynamics for planar…

Probability · Mathematics 2011-09-01 Thomas P. Hayes , Juan C. Vera , Eric Vigoda

Markov chain Monte Carlo (MCMC) algorithms are simple and extremely powerful techniques to sample from almost arbitrary distributions. The flaw in practice is that it can take a large and/or unknown amount of time to converge to the…

Machine Learning · Computer Science 2014-11-13 Xianghang Liu , Justin Domke

Probabilistic models are conceptually powerful tools for finding structure in data, but their practical effectiveness is often limited by our ability to perform inference in them. Exact inference is frequently intractable, so approximate…

Computation · Statistics 2014-07-25 Robert Nishihara , Iain Murray , Ryan P. Adams

This paper proposes a new sampling scheme based on Langevin dynamics that is applicable within pseudo-marginal and particle Markov chain Monte Carlo algorithms. We investigate this algorithm's theoretical properties under standard…

Methodology · Statistics 2016-05-30 Christopher Nemeth , Chris Sherlock , Paul Fearnhead

The maximum independent set (MIS) problem is a well-studied combinatorial optimization problem that naturally arises in many applications, such as wireless communication, information theory and statistical mechanics. MIS problem is NP-hard,…

Discrete Mathematics · Computer Science 2015-04-20 Rémi Varloot , Ana Bušić , Anne Bouillard

The hardcore model is a fundamental probabilistic model extensively studied in statistical physics, probability theory, and computer science. For graphs of maximum degree $\Delta$, a well-known computational phase transition occurs at the…

Data Structures and Algorithms · Computer Science 2025-11-13 Xiaoyu Chen , Zejia Chen , Zongchen Chen , Yitong Yin , Xinyuan Zhang

We prove that the single-site Glauber dynamics for sampling proper $q$-colorings mixes in $O_\Delta(n\log n)$ time on line graphs with $n$ vertices and maximum degree $\Delta$ when $q>(1+o(1))\Delta$. The main tool in our proof is the…

Data Structures and Algorithms · Computer Science 2024-03-25 Yulin Wang , Chihao Zhang , Zihan Zhang

We consider local Markov chain Monte-Carlo algorithms for sampling from the weighted distribution of independent sets with activity $\l$, where the weight of an independent set $I$ is $\l^{|I|}$. A recent result has established that Gibbs…

Probability · Mathematics 2007-05-23 Elchanan Mossel , Dror Weitz , Nicholas Wormald

We give a systematic development of the application of matrix norms to rapid mixing in spin systems. We show that rapid mixing of both random update Glauber dynamics and systematic scan Glauber dynamics occurs if any matrix norm of the…

Probability · Mathematics 2009-03-06 Martin Dyer , Leslie Ann Goldberg , Mark Jerrum

The Gibbs sampler, also known as the coordinate hit-and-run algorithm, is a Markov chain that is widely used to draw samples from probability distributions in arbitrary dimensions. At each iteration of the algorithm, a randomly selected…

Statistics Theory · Mathematics 2024-12-25 Neha S. Wadia

Markov chain Monte Carlo (MCMC) methods are widely used in machine learning. One of the major problems with MCMC is the question of how to design chains that mix fast over the whole state space; in particular, how to select the parameters…

Machine Learning · Computer Science 2019-07-16 Kiarash Shaloudegi , András György

The pairwise influence matrix of Dobrushin has long been used as an analytical tool to bound the rate of convergence of Gibbs sampling. In this work, we use Dobrushin influence as the basis of a practical tool to certify and efficiently…

Machine Learning · Statistics 2017-07-20 Ioannis Mitliagkas , Lester Mackey

We show that the natural Glauber dynamics mixes rapidly and generates a random proper edge-coloring of a graph with maximum degree $\Delta$ whenever the number of colors is at least $q\geq (\frac{10}{3} + \epsilon)\Delta$, where…

Data Structures and Algorithms · Computer Science 2021-11-17 Dorna Abdolazimi , Kuikui Liu , Shayan Oveis Gharan