English
Related papers

Related papers: Some rigorous results for the Hopfield Model

200 papers

The set of the fixed points of the Hopfield type network is under investigation. The connection matrix of the network is constructed according to the Hebb rule from the set of memorized patterns which are treated as distorted copies of the…

Disordered Systems and Neural Networks · Physics 2009-10-31 Leonid B. Litinskii

The set of the fixed points of the Hopfield type network is under investigation. The connection matrix of the network is constructed according the Hebb rule from the set of memorized patterns which are treated as distorted copies of the…

Disordered Systems and Neural Networks · Physics 2007-05-23 Leonid B. Litinskii

A set of fixed points of the Hopfield type neural network was under investigation. Its connection matrix is constructed with regard to the Hebb rule from a highly symmetric set of the memorized patterns. Depending on the external parameter…

Biological Physics · Physics 2007-05-23 Hong-Liang Lu , Xi-Jun Qiu

A set of fixed points of the Hopfield type neural network is under investigation. Its connection matrix is constructed with regard to the Hebb rule from a highly symmetric set of the memorized patterns. Depending on the external parameter…

Disordered Systems and Neural Networks · Physics 2007-05-23 Leonid B. Litinsky

The gap between the huge volumes of data needed to train artificial neural networks and the relatively small amount of data needed by their biological counterparts is a central puzzle in machine learning. Here, inspired by biological…

Disordered Systems and Neural Networks · Physics 2022-04-19 Miriam Aquaro , Francesco Alemanno , Ido Kanter , Fabrizio Durante , Elena Agliari , Adriano Barra

While Hopfield networks are known as paradigmatic models for memory storage and retrieval, modern artificial intelligence systems mainly stand on the machine learning paradigm. We show that it is possible to formulate a teacher-student…

Disordered Systems and Neural Networks · Physics 2024-01-02 Francesco Alemanno , Luca Camanzi , Gianluca Manzan , Daniele Tantari

The Hopfield model is a paradigmatic model of neural networks that has been analyzed for many decades in the statistical physics, neuroscience, and machine learning communities. Inspired by the manifold hypothesis in machine learning, we…

Disordered Systems and Neural Networks · Physics 2023-05-01 Matteo Negri , Clarissa Lauditi , Gabriele Perugini , Carlo Lucibello , Enrico Malatesta

We discuss prototype formation in the Hopfield network. Typically, Hebbian learning with highly correlated states leads to degraded memory performance. We show this type of learning can lead to prototype formation, where unlearned states…

Neural and Evolutionary Computing · Computer Science 2024-07-08 Hayden McAlister , Anthony Robins , Lech Szymanski

We study some features of learning models based on "delayed" and undifferentiated reinforcement and realized by simple algorithms which may be considered of a very elementary nature. We show that a modification of the Hebb-rule works well…

Condensed Matter · Physics 2007-05-23 Ion-Olimpiu Stamatescu

In neural network's Literature, Hebbian learning traditionally refers to the procedure by which the Hopfield model and its generalizations store archetypes (i.e., definite patterns that are experienced just once to form the synaptic…

Disordered Systems and Neural Networks · Physics 2024-02-21 Francesco Alemanno , Miriam Aquaro , Ido Kanter , Adriano Barra , Elena Agliari

The Hebbian unlearning algorithm, i.e. an unsupervised local procedure used to improve the retrieval properties in Hopfield-like neural networks, is numerically compared to a supervised algorithm to train a linear symmetric perceptron. We…

Disordered Systems and Neural Networks · Physics 2022-03-15 Marco Benedetti , Enrico Ventura , Enzo Marinari , Giancarlo Ruocco , Francesco Zamponi

It has been recently shown that a learning transition happens when a Hopfield Network stores examples generated as superpositions of random features, where new attractors corresponding to such features appear in the model. In this work we…

Disordered Systems and Neural Networks · Physics 2024-07-09 Silvio Kalaj , Clarissa Lauditi , Gabriele Perugini , Carlo Lucibello , Enrico M. Malatesta , Matteo Negri

Learning or memory formation are associated with the strengthening of the synaptic connections between neurons according to a pattern reflected by the input. According to this theory a retained memory sequence is associated to a dynamic…

Dynamical Systems · Mathematics 2016-03-23 Pascal Chossat , Martin Krupa

This article delves into the Hopfield neural network model, drawing inspiration from biological neural systems. The exploration begins with an overview of the model's foundations, incorporating insights from mechanical statistics to deepen…

Disordered Systems and Neural Networks · Physics 2024-10-29 Matteo Silvestri

To improve the storage capacity of the Hopfield model, we develop a version of the dreaming algorithm that perpetually reinforces the patterns to be stored (as in the Hebb rule), and erases the spurious memories (as in dreaming algorithms).…

Disordered Systems and Neural Networks · Physics 2025-06-03 Ludovica Serricchio , Dario Bocchi , Claudio Chilin , Raffaele Marino , Matteo Negri , Chiara Cammarota , Federico Ricci-Tersenghi

Recent studies point to the potential storage of a large number of patterns in the celebrated Hopfield associative memory model, well beyond the limits obtained previously. We investigate the properties of new fixed points to discover that…

Disordered Systems and Neural Networks · Physics 2017-11-22 Jacopo Rocchi , David Saad , Daniele Tantari

The ability to quickly learn new knowledge (e.g. new classes or data distributions) is a big step towards human-level intelligence. In this paper, we consider scenarios that require learning new classes or data distributions quickly and…

Machine Learning · Computer Science 2021-09-13 Fei Mi , Tao Lin , Boi Faltings

In the Hopfield model the ability of the network to generalization is studied in the case of the network trained by one input image ({\it the standard}).

Disordered Systems and Neural Networks · Physics 2007-05-23 Leonid B. Litinskii

Unsupervised learning in a generalized Hopfield associative-memory network is investigated in this work. First, we prove that the (generalized) Hopfield model is equivalent to a semi-restricted Boltzmann machine with a layer of visible…

Neural and Evolutionary Computing · Computer Science 2017-07-26 Huiling Zhen , Shang-Nan Wang , Hai-Jun Zhou

In the present paper, an effort has been made for storing and recalling images with Hopfield Neural Network Model of auto-associative memory. Images are stored by calculating a corresponding weight matrix. Thereafter, starting from an…

Neural and Evolutionary Computing · Computer Science 2011-05-03 C. Ramya , G. Kavitha , Dr. K. S. Shreedhara
‹ Prev 1 2 3 10 Next ›