English
Related papers

Related papers: Replica Symmetry Breaking in Attractor Neural Netw…

200 papers

The variational principle (VP) has been used to capture the metastable states of a glass-forming molecular system without quenched disorder. It has been shown that VP naturally leads to a self-consistent random field Ginzburg-Landau model…

Disordered Systems and Neural Networks · Physics 2007-05-23 V. G. Rostiashvili , T. A. Vilgis

Recent generalizations of the Hopfield model of associative memories are able to store a number $P$ of random patterns that grows exponentially with the number $N$ of neurons, $P=\exp(\alpha N)$. Besides the huge storage capacity, another…

Disordered Systems and Neural Networks · Physics 2024-02-14 Carlo Lucibello , Marc Mézard

We introduce a mathematical framework based on simple combinatorial arguments (Kernel Representation) that allows to deal successfully with spin glass problems, among others. Let $\Omega^{N}$ be the space of configurations of an $N-$ spins…

Statistical Mechanics · Physics 2023-01-18 Simone Franchini

Neural computations emerge from myriads of neuronal interactions occurring in intricate spiking networks. Due to the inherent complexity of neural models, relating the spiking activity of a network to its structure requires simplifying…

Dynamical Systems · Mathematics 2019-02-12 François Baccelli , Thibaud Taillefumier

Artificial Neural Networks (ANN) comprise important symmetry properties, which can influence the performance of Monte Carlo methods in Neuroevolution. The problem of the symmetries is also known as the competing conventions problem or…

Neural and Evolutionary Computing · Computer Science 2011-07-25 Onay Urfalioglu , Orhan Arikan

In this paper we discuss a disordered $d$-dimensional Euclidean $\lambda\varphi^{4}$ model. The dominant contribution to the average free energy of this system is written as a series of the replica partition functions of the model. In each…

High Energy Physics - Theory · Physics 2017-09-20 R. Acosta Diaz , G. Menezes , N. F. Svaiter , C. A. D. Zarro

Background: The Hartree-Fock mean-field approximation is standard in combination with energy density functionals (EDF) that account for some dynamical correlations. Breaking and restoring the symmetries of the system allow for the inclusion…

Nuclear Theory · Physics 2023-11-20 Joshua Cesca , Cédric Simenel

We analyze the quantum Hopfield model in which an extensive number of patterns are embedded in the presence of a uniform transverse field. This analysis employs the replica method under the replica symmetric ansatz on the Suzuki-Trotter…

Disordered Systems and Neural Networks · Physics 2025-03-17 Koki Okajima , Yoshiyuki Kabashima

We extend the replica liquid theory in order to describe the multiple glass transitions of binary mixtures with large size disparities, by taking into account the two-step replica symmetry breaking (2RSB). We determine the glass phase…

Soft Condensed Matter · Physics 2021-03-03 Harukuni Ikeda , Kunimasa Miyazaki , Hajime Yoshino , Atsushi Ikeda

We investigate stability of replica symmetry breaking solutions in generalized $p$-spin models. It is shown that the kind of the transition to the one-step replica symmetry breaking state depends not only on the presence or absence of the…

Disordered Systems and Neural Networks · Physics 2011-11-10 T. I. Schelkacheva , N. M. Chtchelkatchev

We present the full phase diagram of the spherical $2+p$ spin glass model with $p\geq 4$. The main outcome is the presence of a new phase with both properties of Full Replica Symmetry Breaking (FRSB) phases of discrete models, e.g, the…

Disordered Systems and Neural Networks · Physics 2009-11-10 A. Crisanti , L. Leuzzi

We compute the Functional Renormalization Group (FRG) disorder- correlator function R(v) for d-dimensional elastic manifolds pinned by a random potential in the limit of infinite embedding space dimension N. It measures the equilibrium…

Disordered Systems and Neural Networks · Physics 2008-02-22 Pierre Le Doussal , Markus Mueller , Kay Joerg Wiese

Phase retrieval refers to the problem of recovering some signal (which is often modelled as an element of a Hilbert space) from phaseless measurements. It has been shown that in the deterministic setting phase retrieval from frame…

Numerical Analysis · Mathematics 2021-11-11 Rima Alaifari , Matthias Wellershoff

In a recent letter Marinari et al [Phys. Rev. Lett. 81, 1698 (1998)] introduced a new method to study spin glass transitions and argued that by probing replica symmetry (RS) as opposed to time reversal symmetry (TRS), their method…

Disordered Systems and Neural Networks · Physics 2009-10-31 Hemant Bokil , A. J. Bray , Barbara Drossel , M. A. Moore

In this work we approach attractor neural networks from a machine learning perspective: we look for optimal network parameters by applying a gradient descent over a regularized loss function. Within this framework, the optimal…

Machine Learning · Computer Science 2024-02-21 Elena Agliari , Francesco Alemanno , Miriam Aquaro , Alberto Fachechi

We investigate the p-state mean-field model of the Potts glass ($2\le p \le 4$) below the continuous phase transition to a glassy phase. We find that apart from a solution with a first hierarchical level of replica-symmetry breaking (1RSB),…

Disordered Systems and Neural Networks · Physics 2010-12-17 V. Janis , A. Klic

The Hopfield recurrent neural network is a classical auto-associative model of memory, in which collections of symmetrically-coupled McCulloch-Pitts neurons interact to perform emergent computation. Although previous researchers have…

Adaptation and Self-Organizing Systems · Physics 2015-06-09 Christopher Hillar , Ngoc M. Tran

The Hebbian unlearning algorithm, i.e. an unsupervised local procedure used to improve the retrieval properties in Hopfield-like neural networks, is numerically compared to a supervised algorithm to train a linear symmetric perceptron. We…

Disordered Systems and Neural Networks · Physics 2022-03-15 Marco Benedetti , Enrico Ventura , Enzo Marinari , Giancarlo Ruocco , Francesco Zamponi

The concept of replica symmetry breaking found in the solution of the mean-field Sherrington-Kirkpatrick spin-glass model has been applied to a variety of problems in science ranging from biological to computational and even financial…

Disordered Systems and Neural Networks · Physics 2008-03-25 Helmut G. Katzgraber , Alexander K. Hartmann , A. P. Young

We investigate the computational limits of the memory retrieval dynamics of modern Hopfield models from the fine-grained complexity analysis. Our key contribution is the characterization of a phase transition behavior in the efficiency of…

Machine Learning · Computer Science 2024-06-04 Jerry Yao-Chieh Hu , Thomas Lin , Zhao Song , Han Liu