English
Related papers

Related papers: Supervised perceptron learning vs unsupervised Heb…

200 papers

Sequence memory is an essential attribute of natural and artificial intelligence that enables agents to encode, store, and retrieve complex sequences of stimuli and actions. Computational models of sequence memory have been proposed where…

Neural and Evolutionary Computing · Computer Science 2023-11-06 Hamza Tahir Chaudhry , Jacob A. Zavatone-Veth , Dmitry Krotov , Cengiz Pehlevan

In the present paper, an effort has been made for storing and recalling images with Hopfield Neural Network Model of auto-associative memory. Images are stored by calculating a corresponding weight matrix. Thereafter, starting from an…

Neural and Evolutionary Computing · Computer Science 2011-05-03 C. Ramya , G. Kavitha , Dr. K. S. Shreedhara

The state space of a conventional Hopfield network typically exhibits many different attractors of which only a small subset satisfy constraints between neurons in a globally optimal fashion. It has recently been demonstrated that combining…

Adaptation and Self-Organizing Systems · Physics 2014-09-02 Alexander Woodward , Tom Froese , Takashi Ikegami

Understanding the theoretical foundations of how memories are encoded and retrieved in neural populations is a central challenge in neuroscience. A popular theoretical scenario for modeling memory function is the attractor neural network…

Neurons and Cognition · Quantitative Biology 2016-02-17 Alireza Alemi , Carlo Baldassi , Nicolas Brunel , Riccardo Zecchina

Unsupervised learning permits the development of algorithms that are able to adapt to a variety of different data sets using the same underlying rules thanks to the autonomous discovery of discriminating features during training. Recently,…

Neural and Evolutionary Computing · Computer Science 2018-01-30 Yanis Bahroun , Andrea Soltoggio

In this paper we study robust synchronization of time-fractional Hopfield neural networks with memristive couplings and Hebbian learning rules. This new model of artificial neural networks exhibits strong memory and long-range…

Analysis of PDEs · Mathematics 2025-10-27 Yuncheng You

We consider $L$-directional associative memories, composed of $L$ Hopfield networks, displaying imitative Hebbian intra-network interactions and anti-imitative Hebbian inter-network interactions, where couplings are built over a set of…

Disordered Systems and Neural Networks · Physics 2025-04-11 Elena Agliari , Andrea Alessandrelli , Paulo Duarte Mourao , Alberto Fachechi

This paper is concerned with the modeling and analysis of two of the most commonly used recurrent neural network models (i.e., Hopfield neural network and firing-rate neural network) with dynamic recurrent connections undergoing Hebbian…

Optimization and Control · Mathematics 2024-03-25 Veronica Centorrino , Francesco Bullo , Giovanni Russo

Associative memory or content-addressable memory is an important component function in computer science and information processing, and at the same time a key concept in cognitive and computational brain science. Many different neural…

Neural and Evolutionary Computing · Computer Science 2026-05-05 Anders Lansner , Andreas Knoblauch , Naresh B Ravichandran , Pawel Herman

Associative memory models are content-addressable memory systems fundamental to biological intelligence and are notable for their high interpretability. However, existing models evaluate the quality of retrieval based on proximity, which…

Machine Learning · Computer Science 2025-11-26 Shurong Wang , Yuqi Pan , Zhuoyang Shen , Meng Zhang , Hongwei Wang , Guoqi Li

Neural networks that can capture key principles underlying brain computation offer exciting new opportunities for developing artificial intelligence and brain-like computing algorithms. Such networks remain biologically plausible while…

Neural and Evolutionary Computing · Computer Science 2025-01-10 Naresh Ravichandran , Anders Lansner , Pawel Herman

Recently, unsupervised local learning, based on Hebb's idea that change in synaptic efficacy depends on the activity of the pre- and postsynaptic neuron only, has shown potential as an alternative training mechanism to backpropagation.…

Machine Learning · Computer Science 2021-02-02 Jules Talloen , Joni Dambre , Alexander Vandesompele

The human brain is a complex system that is fascinating scientists since a long time. Its remarkable capabilities include categorization of concepts, retrieval of memories and creative generation of new examples. At the same time, modern…

Disordered Systems and Neural Networks · Physics 2024-10-10 Enrico Ventura

This paper introduces a learning framework for Three-Directional Associative Memory (TAM) models, extending the classical Hebbian paradigm to both supervised and unsupervised protocols within an hetero-associative setting. These neural…

Disordered Systems and Neural Networks · Physics 2025-11-25 Andrea Alessandrelli , Adriano Barra , Andrea Ladiana , Andrea Lepre , Federico Ricci-Tersenghi

Local learning rules in biological neural networks (BNNs) are commonly referred to as Hebbian learning. [26] links a biologically motivated Hebbian learning rule to a specific zeroth-order optimization method. In this work, we study a…

Statistics Theory · Mathematics 2023-11-08 Johannes Schmidt-Hieber , Wouter M Koolen

We present results for two different kinds of high order connections between neurons acting as corrections to the Hopfield model. Equilibrium properties are analyzed using the replica mean-field theory and compared with numerical…

Condensed Matter · Physics 2009-10-22 J. J. Arenzon , R. M. C. de Almeida

In neuroscience, classical Hopfield networks are the standard biologically plausible model of long-term memory, relying on Hebbian plasticity for storage and attractor dynamics for recall. In contrast, memory-augmented neural networks in…

Neurons and Cognition · Quantitative Biology 2021-10-28 Danil Tyulmankov , Ching Fang , Annapurna Vadaparty , Guangyu Robert Yang

Hebbian synaptic plasticity inevitably leads to interference and forgetting when different, overlapping memory patterns are sequentially stored in the same network. Recent work on artificial neural networks shows that an…

Neurons and Cognition · Quantitative Biology 2018-07-16 Michael Deistler , Martino Sorbaro , Michael E. Rule , Matthias H. Hennig

Local Hebbian learning is believed to be inferior in performance to end-to-end training using a backpropagation algorithm. We question this popular belief by designing a local algorithm that can learn convolutional filters at scale on large…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Leopold Grinberg , John Hopfield , Dmitry Krotov

A modern challenge of Artificial Intelligence is learning multiple patterns at once (i.e.parallel learning). While this can not be accomplished by standard Hebbian associative neural networks, in this paper we show how the Multitasking…

Disordered Systems and Neural Networks · Physics 2024-02-21 Elena Agliari , Andrea Alessandrelli , Adriano Barra , Federico Ricci-Tersenghi