English
Related papers

Related papers: Beyond storage capacity in a single model neuron: …

200 papers

We study the problem of determining the capacity of the binary perceptron for two variants of the problem where the corresponding constraint is symmetric. We call these variants the rectangle-binary-perceptron (RPB) and the…

Disordered Systems and Neural Networks · Physics 2019-11-05 Benjamin Aubin , Will Perkins , Lenka Zdeborová

To test the stability of the Parisi solution near T=0, we study the spectrum of the Hessian of the Sherrington-Kirkpatrick model near T=0, whose eigenvalues are the masses of the bare propagators in the expansion around the mean-field…

Disordered Systems and Neural Networks · Physics 2011-02-28 A. Crisanti , C. De Dominicis

We discuss the mean-field theory of spin-glass models with frustrated long-range random spin exchange. We analyze the reasons for breakdown of the simple mean-field theory of Sherrington and Kirkpatrick. We relate the replica-symmetry…

Disordered Systems and Neural Networks · Physics 2015-06-24 Václav Janiš

The phenomenon of replica symmetry breaking is investigated for the retrieval phases of Hopfield-type network models. The basic calculation is done for the generalized version of the standard model introduced by Horner [1] and by…

Condensed Matter · Physics 2009-10-22 H. Steffan , R. Kühn

Upper and lower bounds for the typical storage capacity of a constructive algorithm, the Tilinglike Learning Algorithm for the Parity Machine [M. Biehl and M. Opper, Phys. Rev. A {\bf 44} 6888 (1991)], are determined in the asymptotic limit…

Disordered Systems and Neural Networks · Physics 2009-10-31 Arnaud Buhot , Mirta B. Gordon

In this work we analyse the Parisi's infinity-replica symmetry breaking solution of the Sherrington - Kirkpatrick model without external field using high order perturbative expansions. The predictions are compared with those obtained from…

Disordered Systems and Neural Networks · Physics 2009-11-07 A. Crisanti , T. Rizzo

We construct a N-dimensional Gaussian landscape with multiscale, translation invariant, logarithmic correlations and investigate the statistical mechanics of a single particle in this environment. In the limit of high dimension N>>1 the…

Disordered Systems and Neural Networks · Physics 2009-11-13 Yan V Fyodorov , Jean-Philippe Bouchaud

We consider models of Bayesian inference of signals with vectorial components of finite dimensionality. We show that, under a proper perturbation, these models are replica symmetric in the sense that the overlap matrix concentrates. The…

Information Theory · Computer Science 2020-01-27 Jean Barbier

By using a simple interpolation argument, in previous work we have proven the existence of the thermodynamic limit, for mean field disordered models, including the Sherrington-Kirkpatrick model, and the Derrida p-spin model. Here we extend…

Disordered Systems and Neural Networks · Physics 2007-05-23 Francesco Guerra

The mean field spin glass model is analyzed by a combination of mathematically rigororous methods and a powerful Ansatz. The method exploited is general, and can be applied to others disordered mean field models such as, e.g., neural…

Disordered Systems and Neural Networks · Physics 2009-10-31 Francesco Baffioni , Francesco Rosati

Motivated by the celebrated discrete-time model of nervous activity outlined by McCulloch and Pitts in 1943, we propose a novel continuous-time model, the McCulloch-Pitts network (MPN), for sequence learning in spiking neural networks. Our…

Disordered Systems and Neural Networks · Physics 2022-01-28 Zuozhu Liu , Thiparat Chotibut , Christopher Hillar , Shaowei Lin

We consider feed-forward neural networks with one hidden layer, tree architecture and a fixed hidden-to-output Boolean function. Focusing on the saturation limit of the storage problem the influence of replica symmetry breaking on the…

Disordered Systems and Neural Networks · Physics 2009-10-31 D. Malzahn , A. Engel

We study the binary symmetric perceptron model, and in particular its atypical solutions. While the solution-space of this problem is dominated by isolated configurations, it is also solvable for a certain range of constraint density…

Disordered Systems and Neural Networks · Physics 2025-04-02 Damien Barbier

In this article, we study an elastic manifold in quenched disorder in the limit of zero temperature. Naively it is equivalent to a free theory with elasticity in Fourier-space proportional to k^4 instead of k^2, i.e. a model without…

Disordered Systems and Neural Networks · Physics 2015-06-24 Kay Joerg Wiese

In this paper we present a simple microscopic stochastic model describing short term plasticity within a large homogeneous network of interacting neurons. Each neuron is represented by its membrane potential and by the residual calcium…

Probability · Mathematics 2020-01-29 Antonio Galves , Eva Löcherbach , Christophe Pouzat , Errico Presutti

A formalism capable of handling the first step of hierarchical replica symmetry breaking in finite-connectivity models is introduced. The emerging order parameter is claimed to be a probability distribution over the space of field…

Disordered Systems and Neural Networks · Physics 2009-10-30 Remi Monasson

We prove the existence of correlations between the equilibrium states at different temperatures of the multi-$p$-spin spherical spin-glass models with continuous replica symmetry breaking: there is no chaos in temperature in these models.…

Disordered Systems and Neural Networks · Physics 2012-10-31 Tommaso Rizzo

In previous work, we have developed a simple method to study the behavior of the Sherrington-Kirkpatrick mean field spin glass model for high temperatures, or equivalently for high external fields. The basic idea was to couple two different…

Disordered Systems and Neural Networks · Physics 2007-05-23 Francesco Guerra

We study increasing subsequences (IS) for an ensemble of sequences given by permutation of numbers {1,2,...,n}. We consider a Boltzmann ensemble at temperature T. Thus each IS appears with the corresponding Boltzmann probability where the…

Disordered Systems and Neural Networks · Physics 2023-03-08 P. Krabbe , H. Schawe , A. K. Hartmann

Spontaneous symmetry breaking in statistical mechanics primarily occurs during phase transitions at the thermodynamic limit where the Hamiltonian preserves inversion symmetry, yet the low-temperature free energy exhibits reduced symmetry.…

Computation and Language · Computer Science 2026-03-02 Shalom Rosner , Ronit D. Gross , Ella Koresh , Ido Kanter