English
Related papers

Related papers: Replica Symmetry Breaking in Attractor Neural Netw…

200 papers

We apply statistical mechanics to an inverse problem of linear mapping to investigate the physics of the irreversible compression. We use the replica symmetry breaking (RSB) technique with a toy model to demonstrate the Shannon's result.…

Disordered Systems and Neural Networks · Physics 2009-11-07 Tatsuto Murayama , Masato Okada

This work presents a statistical mechanics characterization of neural networks, motivated by the replica symmetry breaking (RSB) phenomenon in spin glasses. A Hopfield-type spin glass model is constructed from a given feedforward neural…

Disordered Systems and Neural Networks · Physics 2025-08-12 Jun Li

The fully-connected Ising $p$-spin model has for $p >2$ a discontinuous phase transition from the paramagnetic phase to a stable state with one-step replica symmetry breaking (1RSB). However, simulations in three dimension do not look like…

Disordered Systems and Neural Networks · Physics 2020-04-01 J. Yeo , M. A. Moore

We study the 2D vortex-free XY model in a random field, a model for randomly pinned flux lines in a plane. We construct controlled RG recursion relations which allow for replica symmetry breaking (RSB). The fixed point previously found by…

Condensed Matter · Physics 2009-10-22 P. Le Doussal , T. Giamarchi

We have studied in detail the $M$-$p$ balanced spin glass model, especially the case $p=4$. These types of model have relevance to structural glasses. The models possess two kinds of broken replica states; those with one-step replica…

Disordered Systems and Neural Networks · Physics 2023-11-29 J. Yeo , M. A. Moore

The one-step replica symmetry breaking (RSB) is used to study a two-sublattice fermionic infinite-range Ising spin glass (SG) model in a transverse field $\Gamma$. The problem is formulated in a Grassmann path integral formalism within the…

Strongly Correlated Electrons · Physics 2009-11-13 F. M. Zimmer , S. G. Magalhaes

We study analytically and numerically a Hopfield fully-connected network with $d$-dimensional vector spins. These networks are models of associative memory that generalize the standard Hopfield with Ising spins, where $P$ examples are…

Disordered Systems and Neural Networks · Physics 2026-02-17 Flavio Nicoletti , Francesco D'Amico , Matteo Negri

The Hopfield model is a pioneering neural network model with associative memory retrieval. The analytical solution of the model in mean field limit revealed that memories can be retrieved without any error up to a finite storage capacity of…

Disordered Systems and Neural Networks · Physics 2017-10-31 Do-Hyun Kim , Jinha Park , B. Kahng

We prove the existence of full replica symmetry breaking (FRSB) for the Sherrington-Kirkpatrick (SK) model at low temperature. More specifically, we prove that slightly beyond the critical temperature, the Parisi measure for the SK model is…

Probability · Mathematics 2025-04-17 Yuxin Zhou

The Hopfield model describes a neural network that stores memories using all-to-all-coupled spins. Memory patterns are recalled under equilibrium dynamics. Storing too many patterns breaks the associative recall process because frustration…

We propose and analyze a new variation of the so-called {\em exponential Hopfield model}, a recently introduced family of associative neural networks with unprecedented storage capacity. Our construction is based on a cost function defined…

Disordered Systems and Neural Networks · Physics 2025-09-09 Linda Albanese , Andrea Alessandrelli , Adriano Barra , Peter Sollich

We discuss replica symmetry breaking (RSB) in spin glasses. We update work in this area, from both the analytical and numerical points of view. We give particular attention to the difficulties stressed by Newman and Stein concerning the…

Disordered Systems and Neural Networks · Physics 2014-08-11 E. Marinari , G. Parisi , F. Ricci-Tersenghi , J. Ruiz-Lorenzo , F. Zuliani

We provide the first examples of two-step replica symmetry breaking (2-RSB) models for the spherical mixed p-spin glass at zero temperature. Precisely, we show that for a certain class of mixtures, the Parisi measure at zero temperature is…

Probability · Mathematics 2018-10-17 Antonio Auffinger , Qiang Zeng

We start with a rather detailed, general discussion of recent results of the replica approach to statistical mechanics of a single classical particle placed in a random $N (\gg 1)$-dimensional Gaussian landscape and confined by a…

Disordered Systems and Neural Networks · Physics 2008-01-03 Yan V Fyodorov , Ian Williams

The Bose Hubbard model (BHM) is an archetypal quantum lattice system exhibiting a quantum phase transition between its superfluid (SF) and Mott-insulator (MI) phase. Unlike in higher dimensions the phase diagram of the BHM in one dimension…

Quantum Gases · Physics 2015-06-11 M. Pino , J. Prior , S. R. Clark

The thermodynamic and retrieval properties of the Ashkin-Teller neural network model storing an infinite number of patterns are examined in the replica-symmetric mean-field approximation. In particular, for linked patterns…

Disordered Systems and Neural Networks · Physics 2009-10-31 D. Bolle , P. Kozlowski

The low-temperature phase of discontinuous mean-field spin glasses is generally described by a one-step replica symmetry breaking (1RSB) Ansatz. The Gardner transition, i.e. a very-low-temperature phase transition to a full replica symmetry…

Disordered Systems and Neural Networks · Physics 2009-11-10 Andrea Montanari , Federico Ricci-Tersenghi

Parisi's formal replica-symmetry--breaking (RSB) scheme for mean-field spin glasses has long been interpreted in terms of many pure states organized ultrametrically. However, the early version of this interpretation, as applied to the…

Statistical Mechanics · Physics 2014-10-08 N. Read

In \cite{Hop82}, Hopfield introduced a \emph{Hebbian} learning rule based neural network model and suggested how it can efficiently operate as an associative memory. Studying random binary patterns, he also uncovered that, if a small…

Machine Learning · Statistics 2024-03-05 Mihailo Stojnic

We study hierarchies of replica-symmetry-breaking solutions of the Sherrington-Kirkpatrick model. Stationarity equations for order parameters of solutions with an arbitrary number of hierarchies are set and the limit to infinite number of…

Disordered Systems and Neural Networks · Physics 2008-09-16 V Janis , A. Klic , M. Ringel