English
Related papers

Related papers: Weak Poincar\'e Inequalities, Simulated Annealing,…

200 papers

Annealing algorithms such as simulated annealing and population annealing are widely used both for sampling the Gibbs distribution and solving optimization problems (i.e. finding ground states). For both statistical mechanics and…

Statistical Mechanics · Physics 2024-05-13 Amin Barzegar , Firas Hamze , Christopher Amey , Jonathan Machta

We present the parallel and interacting stochastic approximation annealing (PISAA) algorithm, a stochastic simulation procedure for global optimisation, that extends and improves the stochastic approximation annealing (SAA) by using…

Computation · Statistics 2015-08-21 Georgios Karagiannis , Bledar A. Konomi , Guang Lin , Faming Liang

A key task in Bayesian statistics is sampling from distributions that are only specified up to a partition function (i.e., constant of proportionality). However, without any assumptions, sampling (even approximately) can be #P-hard, and few…

Machine Learning · Computer Science 2018-12-03 Rong Ge , Holden Lee , Andrej Risteski

We introduce a new framework for analyzing Glauber dynamics for the Ising model. The traditional approach for obtaining sharp mixing results has been to appeal to estimates on spatial properties of the stationary measure from within a…

Probability · Mathematics 2015-05-29 Eyal Lubetzky , Allan Sly

We prove Gibbs distribution of two-state spin systems(also known as binary Markov random fields) without hard constrains on a tree exhibits strong spatial mixing(also known as strong correlation decay), under the assumption that, for…

Discrete Mathematics · Computer Science 2009-03-05 Jinshan Zhang

We present a simple combinatorial framework for establishing approximate tensorization of variance and entropy in the setting of spin systems (a.k.a. undirected graphical models) based on balanced separators of the underlying graph. Such…

Data Structures and Algorithms · Computer Science 2023-07-18 Zongchen Chen

We study sampling problems associated with potentials that lack smoothness. The potentials can be either convex or non-convex. Departing from the standard smooth setting, the potentials are only assumed to be weakly smooth or non-smooth, or…

Machine Learning · Computer Science 2023-07-04 Jiaming Liang , Yongxin Chen

This study proposes an algorithm for modeling compressible flows in spherical shells in nearly incompressible and weakly compressible regimes based on an implicit direction splitting approach. The method retains theoretically expected…

Numerical Analysis · Mathematics 2021-04-21 Roman Frolov , Peter Minev , Aziz Takhirov

We investigate the complexity of covariance matrix estimation for Gibbs distributions based on dependent samples from a Markov chain. We show that when $\pi$ satisfies a Poincar\'e inequality and the chain possesses a spectral gap, we can…

Statistics Theory · Mathematics 2024-10-23 Yunbum Kook , Matthew S. Zhang

We define a discrete-time Markov chain for abstract polymer models and show that under sufficient decay of the polymer weights, this chain mixes rapidly. We apply this Markov chain to polymer models derived from the hard-core and…

Data Structures and Algorithms · Computer Science 2021-04-14 Zongchen Chen , Andreas Galanis , Leslie Ann Goldberg , Will Perkins , James Stewart , Eric Vigoda

Markov chain Monte Carlo (MCMC) algorithms are simple and extremely powerful techniques to sample from almost arbitrary distributions. The flaw in practice is that it can take a large and/or unknown amount of time to converge to the…

Machine Learning · Computer Science 2014-11-13 Xianghang Liu , Justin Domke

A key task in Bayesian machine learning is sampling from distributions that are only specified up to a partition function (i.e., constant of proportionality). One prevalent example of this is sampling posteriors in parametric distributions,…

Machine Learning · Computer Science 2020-09-10 Rong Ge , Holden Lee , Andrej Risteski

Monte Carlo approaches have recently been proposed to quantify connectivity in neuronal networks. The key problem is to sample from the conditional distribution of a single neuronal spike train, given the activity of the other neurons in…

Applications · Statistics 2011-12-01 Yuriy Mishchenko , Liam Paninski

Large-scale graph machine learning is challenging as the complexity of learning models scales with the graph size. Subsampling the graph is a viable alternative, but sampling on graphs is nontrivial as graphs are non-Euclidean. Existing…

Machine Learning · Computer Science 2024-10-10 Thien Le , Luana Ruiz , Stefanie Jegelka

In this paper we study a Markov Chain Monte Carlo (MCMC) Gibbs sampler for solving the integer least-squares problem. In digital communication the problem is equivalent to performing Maximum Likelihood (ML) detection in Multiple-Input…

Information Theory · Computer Science 2009-10-09 Morten Hansen , Babak Hassibi , Alexandros G. Dimakis , Weiyu Xu

The stochastic volatility model is a popular tool for modeling the volatility of assets. The model is a nonlinear and non-Gaussian state space model, and consequently is difficult to fit. Many approaches, both classical and Bayesian, have…

Methodology · Statistics 2019-07-22 Chen Gong , David S. Stoffer

Although quantum annealing is usually considered as a method for locating the ground states of difficult spin-glass and optimization problems, its use in approximate optimization -- finding low- but not zero-energy states in a reasonably…

Quantum Physics · Physics 2026-03-26 Christopher L. Baldwin

Markov Chain Monte Carlo (MCMC) underlies both statistical physics and combinatorial optimization, but mixes slowly near critical points and in rough landscapes. Parallel Tempering (PT) improves mixing by swapping replicas across…

Machine Learning · Computer Science 2025-09-30 Saleh Bunaiyan , Corentin Delacour , Shuvro Chowdhury , Kyle Lee , Kerem Y. Camsari

Our aim is to find sufficient conditions for weak convergence of stochastic integrals with respect to the state occupation measure of a Markov chain. First, we study properties of the state indicator function and the state occupation…

Probability · Mathematics 2017-12-12 H. M. Jansen

Spin glasses are disordered magnets with random interactions that are, generally, in conflict with each other. Finding the ground states of spin glasses is not only essential for the understanding of the nature of disordered magnetic and…

Disordered Systems and Neural Networks · Physics 2021-09-30 Changjun Fan , Mutian Shen , Zohar Nussinov , Zhong Liu , Yizhou Sun , Yang-Yu Liu