Related papers: TAP free energy, spin glasses, and variational inf…
In a companion paper we developed the generalized TAP approach for general multi-species spherical mixed $p$-spin models. In this paper, we use it to compute the limit of the free energy at any temperature for all pure multi-species…
We analyse the Hessian of the Thouless-Anderson-Palmer (TAP) free energy for the Sherrington-Kirkpatrick model, below the de Almeida-Thouless line, evaluated in Bolthausen's approximate solutions of the TAP equations. We show that the…
We compute analytically the probability distribution of large deviations in the spin-glass free energy for the Sherrington-Kirkpatrick mean field model, i.e. we compute the exponentially small probability of finding a system with intensive…
We prove the Thouless-Anderson-Palmer (TAP) equations for the local magnetization in the multi-species Sherrington-Kirkpatrick (MSK) spin glass model. One of the key ingredients is based on concentration results established…
An approach is proposed to the Hopfield model where the mean-field treatment is made for a given set of stored patterns (sample) and then the statistical average over samples is taken. This corresponds to the approach made by Thouless,…
We study a finite range spin glass model in arbitrary dimension, where the intensity of the coupling between spins decays to zero over some distance $\gamma^{-1}$. We prove that, under a positivity condition for the interaction potential,…
We study mean-field variational inference in a Bayesian linear model when the sample size n is comparable to the dimension p. In high dimensions, the common approach of minimizing a Kullback-Leibler divergence from the posterior…
The free energy of TAP-solutions for the SK-model of mean field spin glasses can be expressed as a nonlinear functional of local terms: we exploit this feature in order to contrive abstract REM-like models which we then solve by a classical…
The field theory of a short range spin glass with Gaussian random interactions, is considered near the upper critical dimension six. In the glassy phase, replica symmetry breaking is accompanied with massless Goldstone modes, generated by…
The Thouless, Anderson, Palmer (TAP) approach to thermodynamics of mean field spin-glasses is generalised to dynamics. A method to compute the dynamical TAP equations is developed and applied to the p-spin spherical model. In this context…
We derive the Thouless-Anderson-Palmer (TAP) equations for the Ghatak and Sherrington model. Our derivation, based on the cavity method, holds at high temperature and at all values of the crystal field. It confirms the prediction of Yokota.
From the study of a functional equation of Gibbs measures we calculate the limiting free energy of the Sherrington-Kirkpatrick spin glass model at a particular value of (low) temperature. This implies the following lower bound for the…
We focus on spherical spin glasses whose Parisi distribution has support of the form $[0,q]$. For such models we construct paths from the origin to the sphere which consistently remain close to the ground-state energy on the sphere of…
In this paper, we show that the replica symmetry of the Gibbs measure of spherical spin systems is a property of the eigenvalue spacing at the edge of the interaction matrix. In particular, our interaction matrix has \textbf{two} large…
In this letter we analyze the TAP approach to the spherical $p$-spin spin glass model in zero external field. The TAP free energy is derived by summing up all the relevant diagrams for $N\to\infty$ of a diagrammatic expansion of the free…
In many problems in modern statistics and machine learning, it is often of interest to establish that a first order method on a non-convex risk function eventually enters a region of parameter space in which the risk is locally convex. We…
The Sherrington-Kirkpatrick spin-glass model is investigated by means of Monte Carlo simulations employing a combination of the multi-overlap algorithm with parallel tempering methods. We investigate the finite-size scaling behaviour of the…
Different sets of metastable states can be reached in glassy systems below some transition temperature depending on initial conditions and details of the dynamics. This is investigated for the Sherrington-Kirkpatrick spin glass model with…
By using a simple interpolation argument, in previous work we have proven the existence of the thermodynamic limit, for mean field disordered models, including the Sherrington-Kirkpatrick model, and the Derrida p-spin model. Here we extend…
We compute the probability of positive large deviations of the free energy per spin in mean-field Spin-Glass models. The probability vanishes in the thermodynamic limit as $P(\Delta f) \propto \exp[-N^2 L_2(\Delta f)]$. For the…