English
Related papers

Related papers: Benchmarking local Hebbian learning rules for memo…

200 papers

Networks of interconnected neurons communicating through spiking signals offer the bedrock of neural computations. Our brains spiking neural networks have the computational capacity to achieve complex pattern recognition and cognitive…

Neural and Evolutionary Computing · Computer Science 2024-12-06 Naresh Ravichandran , Anders Lansner , Pawel Herman

Associative memory and probabilistic modeling are two fundamental topics in artificial intelligence. The first studies recurrent neural networks designed to denoise, complete and retrieve data, whereas the second studies learning and…

We complement our previous work [arxiv: 0707.0565] with the full (non diluted) solution describing the stable states of an attractor network that stores correlated patterns of activity. The new solution provides a good fit of simulations of…

Disordered Systems and Neural Networks · Physics 2007-07-23 Emilio Kropff

The ability to recognize and predict temporal sequences of sensory inputs is vital for survival in natural environments. Based on many known properties of cortical neurons, hierarchical temporal memory (HTM) sequence memory is recently…

Neural and Evolutionary Computing · Computer Science 2022-01-03 Yuwei Cui , Subutai Ahmad , Jeff Hawkins

The Hopfield model provides a paradigmatic framework for associative memory. Its classical implementation, based on the Hebbian learning rule, suffers from catastrophic forgetting: when one attempts storing too many patterns, the network…

Disordered Systems and Neural Networks · Physics 2026-03-11 Enzo Marinari , Saverio Rossi , Francesco Zamponi

In neural network's Literature, Hebbian learning traditionally refers to the procedure by which the Hopfield model and its generalizations store archetypes (i.e., definite patterns that are experienced just once to form the synaptic…

Disordered Systems and Neural Networks · Physics 2024-02-21 Francesco Alemanno , Miriam Aquaro , Ido Kanter , Adriano Barra , Elena Agliari

We study the problem of learning associative memory -- a system which is able to retrieve a remembered pattern based on its distorted or incomplete version. Attractor networks provide a sound model of associative memory: patterns are stored…

Machine Learning · Statistics 2021-04-21 Sergey Bartunov , Jack W Rae , Simon Osindero , Timothy P Lillicrap

The aim of this thesis is to compare the capacity of different models of neural networks. We start by analysing the problem solving capacity of a single perceptron using a simple combinatorial argument. After some observations on the…

Disordered Systems and Neural Networks · Physics 2022-11-15 Leonardo Cruciani

An associative memory is a framework of content-addressable memory that stores a collection of message vectors (or a dataset) over a neural network while enabling a neurally feasible mechanism to recover any message in the dataset from its…

Machine Learning · Statistics 2016-11-30 Arya Mazumdar , Ankit Singh Rawat

Learning and the ability to learn are important factors in development and evolutionary processes [1]. Depending on the level, the complexity of learning can strongly vary. While associative learning can explain simple learning behaviour…

Neurons and Cognition · Quantitative Biology 2007-05-23 Reimer Kuehn , Ion-Olimpiu Stamatescu

The classic paradigms for learning and memory recall focus on strengths of synaptic couplings and how these can be modulated to encode memories. In a previous paper [A. K. Behera, M. Rao, S. Sastry, and S. Vaikuntanathan, Physical Review X…

Disordered Systems and Neural Networks · Physics 2024-10-10 Agnish Kumar Behera , Matthew Du , Uday Jagadisan , Srikanth Sastry , Madan Rao , Suriyanarayanan Vaikuntanathan

This paper introduces a neural network model that learns multiple attributes as images and performs associated, sequential recall of the learned memories. Briefly, the model presented here is an associative memory model that extends…

Neural and Evolutionary Computing · Computer Science 2026-03-27 Hiroshi Inazawa

Learning in the brain is poorly understood and learning rules that respect biological constraints, yet yield deep hierarchical representations, are still unknown. Here, we propose a learning rule that takes inspiration from neuroscience and…

Neural and Evolutionary Computing · Computer Science 2021-10-27 Bernd Illing , Jean Ventura , Guillaume Bellec , Wulfram Gerstner

This paper introduces a learning framework for Three-Directional Associative Memory (TAM) models, extending the classical Hebbian paradigm to both supervised and unsupervised protocols within an hetero-associative setting. These neural…

Disordered Systems and Neural Networks · Physics 2025-11-25 Andrea Alessandrelli , Adriano Barra , Andrea Ladiana , Andrea Lepre , Federico Ricci-Tersenghi

Memory is a key component of biological neural systems that enables the retention of information over a huge range of temporal scales, ranging from hundreds of milliseconds up to years. While Hebbian plasticity is believed to play a pivotal…

Neural and Evolutionary Computing · Computer Science 2022-05-24 Thomas Limbacher , Ozan Özdenizci , Robert Legenstein

An established normative approach for understanding the algorithmic basis of neural computation is to derive online algorithms from principled computational objectives and evaluate their compatibility with anatomical and physiological…

Neurons and Cognition · Quantitative Biology 2023-08-04 David Lipshutz , Yanis Bahroun , Siavash Golkar , Anirvan M. Sengupta , Dmitri B. Chklovskii

Hebbian plasticity is a powerful principle that allows biological brains to learn from their lifetime experience. By contrast, artificial neural networks trained with backpropagation generally have fixed connection weights that do not…

Neural and Evolutionary Computing · Computer Science 2016-10-20 Thomas Miconi

A fundamental aspect of learning in biological neural networks is the plasticity property which allows them to modify their configurations during their lifetime. Hebbian learning is a biologically plausible mechanism for modeling the…

Neural and Evolutionary Computing · Computer Science 2021-03-16 Anil Yaman , Giovanni Iacca , Decebal Constantin Mocanu , Matt Coler , George Fletcher , Mykola Pechenizkiy

Neuron models of associative memory provide a new and prospective technology for reliable date storage and patterns recognition. However, even when the patterns are uncorrelated, the efficiency of most known models of associative memory is…

Disordered Systems and Neural Networks · Physics 2007-05-23 B. V. Kryzhanovsky , L. B. Litinskii , A. Fonarev

In this paper we study robust synchronization of time-fractional Hopfield neural networks with memristive couplings and Hebbian learning rules. This new model of artificial neural networks exhibits strong memory and long-range…

Analysis of PDEs · Mathematics 2025-10-27 Yuncheng You