English
Related papers

Related papers: Weak Poincar\'e Inequalities, Simulated Annealing,…

200 papers

We investigate the use of a certain class of functional inequalities known as weak Poincar\'e inequalities to bound convergence of Markov chains to equilibrium. We show that this enables the straightforward and transparent derivation of…

Computation · Statistics 2024-09-25 Christophe Andrieu , Anthony Lee , Sam Power , Andi Q. Wang

We consider the problem of algorithmically sampling from the Gibbs measure of a mixed $p$-spin spherical spin glass. We give a polynomial-time algorithm that samples from the Gibbs measure up to vanishing total variation error, for any…

Probability · Mathematics 2024-04-25 Brice Huang , Andrea Montanari , Huy Tuan Pham

We consider the problem of sampling a multimodal distribution with a Markov chain given a small number of samples from the stationary measure. Although mixing can be arbitrarily slow, we show that if the Markov chain has a $k$th order…

Machine Learning · Computer Science 2024-11-15 Frederic Koehler , Holden Lee , Thuy-Duong Vuong

It is well known that Glauber dynamics on spin systems typically suffer exponential slowdowns at low temperatures. This is due to the emergence of multiple metastable phases in the state space, separated by narrow bottlenecks that are hard…

Probability · Mathematics 2024-12-24 Reza Gheissari , Alistair Sinclair

Gibbs sampling is a common procedure used to fit finite mixture models. However, it is known to be slow to converge when exploring correlated regions of a parameter space and so blocking correlated parameters is sometimes implemented in…

Statistics Theory · Mathematics 2024-11-04 David Michael Swanson

Using the framework of weak Poincar\'{e} inequalities, we analyze the convergence properties of deterministic-scan Metropolis-within-Gibbs samplers, an important class of Markov chain Monte Carlo algorithms. Our analysis applies to…

Computation · Statistics 2026-02-17 Mengxi Gao , Gareth O. Roberts , Andi Q. Wang

Simulated annealing - moving from a tractable distribution to a distribution of interest via a sequence of intermediate distributions - has traditionally been used as an inexact method of handling isolated modes in Markov chain samplers.…

Computational Physics · Physics 2007-05-23 Radford M. Neal

In this paper we prove the weak convergence, in a high-temperature phase, of the finite marginals of the Gibbs measure associated to a symmetric spherical spin glass model with correlated couplings towards an explicit asymptotic decoupled…

Probability · Mathematics 2021-12-06 Jean Barbier , Manuel Sáenz

Gibbs sampling is a Markov chain Monte Carlo technique commonly used for estimating marginal distributions. To speed up Gibbs sampling, there has recently been interest in parallelizing it by executing asynchronously. While empirical…

Machine Learning · Computer Science 2016-06-20 Christopher De Sa , Kunle Olukotun , Christopher Ré

The ferromagnetic Ising model on an $n\times n$ square lattice region $\Lambda$ with mixed boundary conditions can exhibit a phase transition as temperature varies. For this spin system, if we fix the spins on the top and bottom sides of…

Discrete Mathematics · Computer Science 2026-05-26 David Gillman , Dana Randall

Many important challenges in science and technology can be cast as optimization problems. When viewed in a statistical physics framework, these can be tackled by simulated annealing, where a gradual cooling procedure helps search for…

Disordered Systems and Neural Networks · Physics 2024-01-17 Mohamed Hibat-Allah , Estelle M. Inack , Roeland Wiersema , Roger G. Melko , Juan Carrasquilla

We consider Markov random fields of discrete spins on the lattice $\Zd$. We use a technique of coupling of conditional distributions. If under the coupling the disagreement cluster is "sufficiently" subcritical, then we prove the Poincar\'e…

Probability · Mathematics 2011-09-21 J. -R. Chazottes , F. Redig , F. Völlering

We consider the problem of inference in discrete probabilistic models, that is, distributions over subsets of a finite ground set. These encompass a range of well-known models in machine learning, such as determinantal point processes and…

Machine Learning · Computer Science 2018-07-10 Alkis Gotovos , Hamed Hassani , Andreas Krause , Stefanie Jegelka

We study sampling problems associated with non-convex potentials that meanwhile lack smoothness. In particular, we consider target distributions that satisfy either logarithmic-Sobolev inequality or Poincar\'e inequality. Rather than…

Machine Learning · Computer Science 2023-02-21 Jiaming Liang , Yongxin Chen

We consider spin systems on the integer lattice graph $\mathbb{Z}^d$ with nearest-neighbor interactions. We develop a combinatorial framework for establishing that exponential decay with distance of spin correlations, specifically the…

Discrete Mathematics · Computer Science 2017-08-09 Antonio Blanca , Pietro Caputo , Alistair Sinclair , Eric Vigoda

We discuss convergence and coupling of Markov chains, and present general relations between the transfer matrices describing these two processes. We then analyze a recently developed local-patch algorithm, which computes rigorous upper…

Statistical Mechanics · Physics 2013-05-29 Cedric Chanal , Werner Krauth

A sampling algorithm is presented that generates spin glass configurations of the 2D Edwards-Anderson Ising spin glass at finite temperature, with probabilities proportional to their Boltzmann weights. Such an algorithm overcomes the slow…

Disordered Systems and Neural Networks · Physics 2009-10-30 Creighton K. Thomas , A. Alan Middleton

We study the landscapes of multi-species spherical spin glasses. Our results determine the phase boundary for annealed trivialization of the number of critical points, and establish its equivalence with a quenched strong topological…

Probability · Mathematics 2025-05-27 Brice Huang , Mark Sellke

We present a perfect marginal sampler of the unique Gibbs measure of a spin system on $\mathbb Z^2$. The algorithm is an adaptation of a previous `lazy depth-first' approach by the authors, but relaxes the requirement of strong spatial…

Data Structures and Algorithms · Computer Science 2023-02-16 Konrad Anand , Mark Jerrum

In this paper, we prove that optimizability of any function F using Gradient Flow from all initializations implies a Poincar\'e Inequality for Gibbs measures mu_{beta} = e^{-beta F}/Z at low temperature. In particular, under mild regularity…

Machine Learning · Statistics 2025-07-08 August Y. Chen , Karthik Sridharan
‹ Prev 1 2 3 10 Next ›