English
Related papers

Related papers: Rapid Mixing of Gibbs Sampling on Graphs that are …

200 papers

We consider the problem of learning the structure of ferromagnetic Ising models Markov on sparse Erdos-Renyi random graph. We propose simple local algorithms and analyze their performance in the regime of correlation decay. We prove that an…

Statistics Theory · Mathematics 2015-03-17 Animashree Anandkumar , Vincent Tan , Alan Willsky

We analyze the mixing time of a natural local Markov chain (the Glauber dynamics) on configurations of the solid-on-solid model of statistical physics. This model has been proposed, among other things, as an idealization of the behavior of…

Mathematical Physics · Physics 2010-08-03 Fabio Martinelli , Alistair Sinclair

In the Wishart model for sparse PCA we are given $n$ samples $Y_1,\ldots, Y_n$ drawn independently from a $d$-dimensional Gaussian distribution $N({0, Id + \beta vv^\top})$, where $\beta > 0$ and $v\in \mathbb{R}^d$ is a $k$-sparse unit…

Machine Learning · Computer Science 2023-11-10 Gleb Novikov

We consider spin systems on general $n$-vertex graphs of unbounded degree and explore the effects of spectral independence on the rate of convergence to equilibrium of global Markov chains. Spectral independence is a novel way of…

Probability · Mathematics 2023-08-30 Antonio Blanca , Xusheng Zhang

Gibbs sampling is a common procedure used to fit finite mixture models. However, it is known to be slow to converge when exploring correlated regions of a parameter space and so blocking correlated parameters is sometimes implemented in…

Statistics Theory · Mathematics 2024-11-04 David Michael Swanson

We give a simple, multiplicative-weight update algorithm for learning undirected graphical models or Markov random fields (MRFs). The approach is new, and for the well-studied case of Ising models or Boltzmann machines, we obtain an…

Machine Learning · Computer Science 2017-06-21 Adam Klivans , Raghu Meka

We prove that a polynomial fraction of the set of $k$-component forests in the $m \times n$ grid graph have equal numbers of vertices in each component, for any constant $k$. This resolves a conjecture of Charikar, Liu, Liu, and Vuong, and…

Discrete Mathematics · Computer Science 2024-01-12 Sarah Cannon , Wesley Pegden , Jamie Tucker-Foltz

We consider a dynamic random graph on $n$ vertices that is obtained by starting from a random graph generated according to the configuration model with a prescribed degree sequence and at each unit of time randomly rewiring a fraction…

Probability · Mathematics 2018-03-14 Luca Avena , Hakan Guldas , Remco van der Hofstad , Frank den Hollander

This paper presents a new anytime algorithm for the marginal MAP problem in graphical models. The algorithm is described in detail, its complexity and convergence rate are studied, and relations to previous theoretical results for the…

Artificial Intelligence · Computer Science 2012-12-21 Denis Maua , Cassio De Campos

Asynchronous Gibbs sampling has been recently shown to be fast-mixing and an accurate method for estimating probabilities of events on a small number of variables of a graphical model satisfying Dobrushin's condition~\cite{DeSaOR16}. We…

Machine Learning · Computer Science 2018-11-27 Constantinos Daskalakis , Nishanth Dikkala , Siddhartha Jayanti

Standard Gibbs sampling applied to a multivariate normal distribution with a specified precision matrix is equivalent in fundamental ways to the Gauss-Seidel iterative solution of linear equations in the precision matrix. Specifically, the…

Computation · Statistics 2015-05-14 Colin Fox , Albert Parker

In this paper we present a study of the mixing time of a random walk on the largest component of a supercritical random graph, also known as the giant component. We identify local obstructions that slow down the random walk, when the…

Combinatorics · Mathematics 2007-05-23 Nikolaos Fountoulakis , Bruce Reed

Recently, Eldan, Koehler, and Zeitouni (2020) showed that Glauber dynamics mixes rapidly for general Ising models so long as the difference between the largest and smallest eigenvalues of the coupling matrix is at most $1 - \epsilon$ for…

Data Structures and Algorithms · Computer Science 2023-12-01 Dmitriy Kunisky

We study the fixed-magnetization ferromagnetic Ising model on random $d$-regular graphs for $d\ge 3$ and inverse temperature below the tree reconstruction threshold. Our main result is that for each magnetization $\eta$, the free energy…

Probability · Mathematics 2025-11-21 Reza Gheissari , Will Perkins , Corrine Yap

We consider polynomial long-range Ising models in one dimension, with ferromagnetic pair interactions decaying with power $2-\alpha$ (for $0 \leq \alpha < 1$), and prepared with randomly chosen boundary conditions. We show that at low…

Mathematical Physics · Physics 2024-05-17 Eric O. Endo , Aernout C. D. van Enter , Arnaud Le Ny

We consider (annealed) large deviation principles for component empirical measures of several families of marked sparse random graphs, including (i) uniform graphs on $n$ vertices with a fixed degree distribution; (ii) uniform graphs on $n$…

Probability · Mathematics 2023-12-27 Kavita Ramanan , Sarath Yasodharan

This paper deals with the problem of graph matching or network alignment for Erd\H{o}s--R\'enyi graphs, which can be viewed as a noisy average-case version of the graph isomorphism problem. Let $G$ and $G'$ be $G(n, p)$ Erd\H{o}s--R\'enyi…

Statistics Theory · Mathematics 2022-07-08 Cheng Mao , Mark Rudelson , Konstantin Tikhomirov

In this paper we consider alignment of sparse graphs, for which we introduce the Neighborhood Tree Matching Algorithm (NTMA). For correlated Erd\H{o}s-R\'{e}nyi random graphs, we prove that the algorithm returns -- in polynomial time -- a…

Data Structures and Algorithms · Computer Science 2020-11-02 Luca Ganassali , Laurent Massoulié

Gibbs samplers are popular algorithms to approximate posterior distributions arising from Bayesian hierarchical models. Despite their popularity and good empirical performances, however, there are still relatively few quantitative results…

Computation · Statistics 2023-10-31 Filippo Ascolani , Giacomo Zanella

We consider the random geometric graph on $n$ vertices drawn uniformly from a $d$--dimensional sphere. We focus on the sparse regime, when the expected degree is constant independent of $d$ and $n$. We show that, when $d$ is larger than $n$…

Probability · Mathematics 2021-10-22 Elliot Paquette , Andrew Vander Werf