English
Related papers

Related papers: Random optimization problems at fixed temperatures

200 papers

The maximum a-posteriori (MAP) perturbation framework has emerged as a useful approach for inference and learning in high dimensional complex models. By maximizing a randomly perturbed potential function, MAP perturbations generate unbiased…

Machine Learning · Computer Science 2013-10-17 Francesco Orabona , Tamir Hazan , Anand D. Sarwate , Tommi Jaakkola

We consider the problem of estimating the common mean of independently sampled data, where samples are drawn in a possibly non-identical manner from symmetric, unimodal distributions with a common mean. This generalizes the setting of…

Statistics Theory · Mathematics 2019-07-09 Ankit Pensia , Varun Jog , Po-Ling Loh

We give a comprehensive self-contained review on the rigorous analysis of the thermodynamics of a class of random spin systems of mean field type whose most prominent example is the Hopfield model. We focus on the low temperature phase and…

Disordered Systems and Neural Networks · Physics 2008-02-03 Anton Bovier , Veronique Gayrard

We study random composite structures considered up to symmetry that are sampled according to weights on the inner and outer structures. This model may be viewed as an unlabelled version of Gibbs partitions and encompasses multisets of…

Combinatorics · Mathematics 2020-04-01 Benedikt Stufler

We analyze the Block Averaging Transformation applied to the two--dimensional Ising model in the uniqueness region. We discuss the Gibbs property of the renormalized measure and the convergence of renormalized potential under iteration of…

Statistical Mechanics · Physics 2011-10-28 L. Bertini , Emilio N. M. Cirillo , E. Olivieri

The paper gives a bound on the generalization error of the Gibbs algorithm, which recovers known data-independent bounds for the high temperature range and extends to the low-temperature range, where generalization depends critically on the…

Machine Learning · Computer Science 2025-04-07 Andreas Maurer

We consider a collection of independent random variables that are identically distributed, except for a small subset which follows a different, anomalous distribution. We study the problem of detecting which random variables in the…

Information Theory · Computer Science 2018-06-21 Natalie Durgin , Rachel Grotheer , Chenxi Huang , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Standard Gibbs sampling applied to a multivariate normal distribution with a specified precision matrix is equivalent in fundamental ways to the Gauss-Seidel iterative solution of linear equations in the precision matrix. Specifically, the…

Computation · Statistics 2015-05-14 Colin Fox , Albert Parker

In this paper we deal with the regression problem in a random design setting. We investigate asymptotic optimality under minimax point of view of various Bayesian rules based on warped wavelets and show that they nearly attain optimal…

Statistics Theory · Mathematics 2009-08-21 Thanh Mai Pham Ngoc

We introduce a modified Consensus-Based Optimization model that admits a fully unified and rigorous analysis of its finite-particle dynamics, the associated McKean--Vlasov equation, and their optimization behavior under a single set of…

Probability · Mathematics 2025-11-25 Young-Pil Choi , Seungchan Lee , Sihyun Song

Randomness is ubiquitous in many applications across data science and machine learning. Remarkably, systems composed of random components often display emergent global behaviors that appear deterministic, manifesting a transition from…

Machine Learning · Computer Science 2025-05-16 Luca Muscarnera , Luigi Loreti , Giovanni Todeschini , Alessio Fumagalli , Francesco Regazzoni

We study the convergence properties of the Gibbs Sampler in the context of posterior distributions arising from Bayesian analysis of conditionally Gaussian hierarchical models. We develop a multigrid approach to derive analytic expressions…

Computation · Statistics 2019-06-27 Giacomo Zanella , Gareth Roberts

This paper develops several average-case reduction techniques to show new hardness results for three central high-dimensional statistics problems, implying a statistical-computational gap induced by robustness, a detection-recovery gap and…

Computational Complexity · Computer Science 2020-05-20 Matthew Brennan , Guy Bresler

Combinatorial optimization is a fertile testing ground for statistical physics methods developed in the context of disordered systems, allowing one to confront theoretical mean field predictions with actual properties of finite dimensional…

Disordered Systems and Neural Networks · Physics 2009-10-31 J. Houdayer , J. H. Boutet de Monvel , O. C. Martin

The consensus problem in distributed computing involves a network of agents aiming to compute the average of their initial vectors through local communication, represented by an undirected graph. This paper focuses on the studying of this…

Optimization and Control · Mathematics 2024-11-26 Nhat Trung Nguyen , Alexander Rogozin , Alexander Gasnikov

In this work we consider a problem related to the equilibrium statistical mechanics of spin glasses, namely the study of the Gibbs measure of the random energy model. For solving this problem, new results of independent interest on sums of…

Probability · Mathematics 2007-05-23 Marie F. Kratz , Pierre Picco

This paper studies the Gibbs measure of an interacting particle system with a general interaction kernel at various temperature regimes. We are particularly interested in fine features of the convergence to the mean-field density as the…

Probability · Mathematics 2025-06-17 David Padilla-Garza

For a given homogeneous Poisson point process in $\mathbb{R}^d$ two points are connected by an edge if their distance is bounded by a prescribed distance parameter. The behaviour of the resulting random graph, the Gilbert graph or random…

Probability · Mathematics 2017-11-06 Matthias Reitzner , Matthias Schulte , Christoph Thaele

Computational couplings of Markov chains provide a practical route to unbiased Monte Carlo estimation that can utilize parallel computation. However, these approaches depend crucially on chains meeting after a small number of transitions.…

Methodology · Statistics 2021-04-14 Brian L. Trippe , Tin D. Nguyen , Tamara Broderick

We consider the canonical ensemble of a system of point particles on the sphere interacting via a logarithmic pair potential. In this setting, we study the associated Gibbs measure and partition function, and we derive explicit formulas…

Mathematical Physics · Physics 2025-10-31 Rolf Andreasson , Ludvig Svensson