English
Related papers

Related papers: Associative memory model with arbitrary Hebbian le…

200 papers

We have recently shown that the statistical properties of goal directed reaching in human subjects depends on recent experience in a way that is consistent with the presence of adaptive Bayesian priors (Verstynen and Sabes, 2011). We also…

Disordered Systems and Neural Networks · Physics 2011-06-16 Timothy Verstynen , Philip N. Sabes

Associative memory refers to the ability to relate a memory with an input and targets the restoration of corrupted patterns. It has been intensively studied in classical physical systems, as in neural networks where an attractor dynamics…

Quantum Physics · Physics 2024-08-27 Adrià Labay-Mora , Eliana Fiorelli , Roberta Zambrini , Gian Luca Giorgi

In [7] Krotov and Hopfield suggest a generalized version of the well-known Hopfield model of associative memory. In their version they consider a polynomial interaction function and claim that this increases the storage capacity of the…

Probability · Mathematics 2017-07-03 Mete Demircigil , Judith Heusel , Matthias Löwe , Sven Upgang , Franck Vermet

The Hopfield model provides a paradigmatic framework for associative memory. Its classical implementation, based on the Hebbian learning rule, suffers from catastrophic forgetting: when one attempts storing too many patterns, the network…

Disordered Systems and Neural Networks · Physics 2026-03-11 Enzo Marinari , Saverio Rossi , Francesco Zamponi

Spin-glass models of associative memories are a cornerstone between statistical physics and theoretical neuroscience. In these networks, stochastic spin-like units interact through a synaptic matrix shaped by local Hebbian learning. In…

Disordered Systems and Neural Networks · Physics 2025-04-08 Gianni V. Vinci , Andrea Galluzzi , Maurizio Mattia

Neural networks are susceptible to catastrophic forgetting. They fail to preserve previously acquired knowledge when adapting to new tasks. Inspired by human associative memory system, we propose a brain-like approach that imitates the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Yi Gu , Jie Li , Yuting Gao , Ruoxin Chen , Chentao Wu , Feiyang Cai , Chao Wang , Zirui Zhang

The brain can reproduce memories from partial data; this ability is critical for memory recall. The process of memory recall has been studied using auto-associative networks such as the Hopfield model. This kind of model reliably converges…

Neurons and Cognition · Quantitative Biology 2016-05-18 James P. Roach , Leonard M Sander , Michal R. Zochowski

Self-sustained, elevated neuronal activity persisting on time scales of ten seconds or longer is thought to be vital for aspects of working memory, including brain representations of real space. Continuous-attractor neural networks, one of…

Neurons and Cognition · Quantitative Biology 2020-08-19 Joseph L. Natale , H. George E. Hentschel , Ilya Nemenman

Algorithms for associative memory typically rely on a network of many connected units. The prototypical example is the Hopfield model, whose generalizations to the quantum realm are mainly based on open quantum Ising models. We propose a…

Quantum Physics · Physics 2023-05-17 Adrià Labay-Mora , Roberta Zambrini , Gian Luca Giorgi

Autoassociative networks were proposed in the 80's as simplified models of memory function in the brain, using recurrent connectivity with hebbian plasticity to store patterns of neural activity that can be later recalled. This type of…

Disordered Systems and Neural Networks · Physics 2011-11-10 Emilio Kropff , Alessandro Treves

Dense Associative Memories or Modern Hopfield Networks have many appealing properties of associative memory. They can do pattern completion, store a large number of memories, and can be described using a recurrent neural network with a…

Neural and Evolutionary Computing · Computer Science 2021-07-29 Dmitry Krotov

Long-term memory is a critical challenge for Large Language Model agents, as fixed context windows cannot preserve coherence across extended interactions. Existing memory systems represent conversation history as unstructured embedding…

Computation and Language · Computer Science 2026-04-21 Jinchang Zhu , Jindong Li , Cheng Zhang , Jiahong Liu , Menglin Yang

We study a neural network model in which both neurons and synaptic interactions evolve in time simultaneously. The time evolution of synaptic interactions is described by a Langevin equation including a Hebbian learning term, and a bias…

Biological Physics · Physics 2009-03-12 T. Uezu , K. Abe , S. Miyoshi , M. Okada

In \cite{Hop82}, Hopfield introduced a \emph{Hebbian} learning rule based neural network model and suggested how it can efficiently operate as an associative memory. Studying random binary patterns, he also uncovered that, if a small…

Machine Learning · Statistics 2024-03-05 Mihailo Stojnic

We study a model of associative memory based on a neural network with small-world structure. The efficacy of the network to retrieve one of the stored patterns exhibits a phase transition at a finite value of the disorder. The more ordered…

Adaptation and Self-Organizing Systems · Physics 2009-11-10 Luis G. Morelli , Guillermo Abramson , Marcelo N. Kuperman

We show how a Hopfield network with modifiable recurrent connections undergoing slow Hebbian learning can extract the underlying geometry of an input space. First, we use a slow/fast analysis to derive an averaged system whose dynamics…

Neurons and Cognition · Quantitative Biology 2011-02-02 Mathieu N. Galtier , Olivier D. Faugeras , Paul C. Bressloff

Cognitive maps provide a powerful framework for understanding spatial and abstract reasoning in biological and artificial agents. While recent computational models link cognitive maps to hippocampal-entorhinal mechanisms, they often rely on…

Neurons and Cognition · Quantitative Biology 2025-10-07 E. A. Dzhivelikian , A. I. Panov

Humans possess the capability to reason at an abstract level and to structure information into abstract categories, but the underlying neural processes have remained unknown. Experimental evidence has recently emerged for the organization…

Neurons and Cognition · Quantitative Biology 2022-04-05 Michael G. Müller , Christos H. Papadimitriou , Wolfgang Maass , Robert Legenstein

A new approach to describing correlation properties of complex dynamic systems with long-range memory based on a concept of additive Markov chains (Phys. Rev. E 68, 061107 (2003)) is developed. An equation connecting a memory function of…

Classical Physics · Physics 2007-05-23 S. S. Melnyk , O. V. Usatenko , V. A. Yampol'skii

This paper introduces a neural network model that learns multiple attributes as images and performs associated, sequential recall of the learned memories. Briefly, the model presented here is an associative memory model that extends…

Neural and Evolutionary Computing · Computer Science 2026-03-27 Hiroshi Inazawa