English
Related papers

Related papers: Maximum Likelihood Associative Memories

200 papers

We investigate a new method to augment recurrent neural networks with extra memory without increasing the number of network parameters. The system has an associative memory based on complex-valued vectors and is closely related to…

Neural and Evolutionary Computing · Computer Science 2016-05-20 Ivo Danihelka , Greg Wayne , Benigno Uria , Nal Kalchbrenner , Alex Graves

We consider the class of Hopfield models of associative memory with activation function $F$ and state space $\{-1,1\}^N$, where each vertex of the cube describes a configuration of $N$ binary neurons. $M$ randomly chosen configurations,…

Probability · Mathematics 2025-04-08 Véronique Gayrard

Hopfield neural networks are a possible basis for modelling associative memory in living organisms. After summarising previous studies in the field, we take a new look at learning rules, exhibiting them as descent-type algorithms for…

Neural and Evolutionary Computing · Computer Science 2020-10-06 Pavel Tolmachev , Jonathan H. Manton

The Hopfield model is a pioneering neural network model with associative memory retrieval. The analytical solution of the model in mean field limit revealed that memories can be retrieved without any error up to a finite storage capacity of…

Disordered Systems and Neural Networks · Physics 2017-10-31 Do-Hyun Kim , Jinha Park , B. Kahng

Associative memory, a form of content-addressable memory, facilitates information storage and retrieval in many biological and physical systems. In statistical mechanics models, associative memory at equilibrium is represented through…

Disordered Systems and Neural Networks · Physics 2022-03-08 Agnish Kumar Behera , Madan Rao , Srikanth Sastry , Suriyanarayanan Vaikuntanathan

We study a model of associative memory based on a neural network with small-world structure. The efficacy of the network to retrieve one of the stored patterns exhibits a phase transition at a finite value of the disorder. The more ordered…

Adaptation and Self-Organizing Systems · Physics 2009-11-10 Luis G. Morelli , Guillermo Abramson , Marcelo N. Kuperman

Associative memory or content-addressable memory is an important component function in computer science and information processing, and at the same time a key concept in cognitive and computational brain science. Many different neural…

Neural and Evolutionary Computing · Computer Science 2026-05-05 Anders Lansner , Andreas Knoblauch , Naresh B Ravichandran , Pawel Herman

Memory-augmented neural networks consisting of a neural controller and an external memory have shown potentials in long-term sequential learning. Current RAM-like memory models maintain memory accessing every timesteps, thus they do not…

Machine Learning · Computer Science 2019-03-21 Hung Le , Truyen Tran , Svetha Venkatesh

Neuron models of associative memory provide a new and prospective technology for reliable date storage and patterns recognition. However, even when the patterns are uncorrelated, the efficiency of most known models of associative memory is…

Disordered Systems and Neural Networks · Physics 2007-05-23 B. V. Kryzhanovsky , L. B. Litinskii , A. Fonarev

Brain-inspired computing aims to mimic cognitive functions like associative memory, the ability to recall complete patterns from partial cues. Memristor technology offers promising hardware for such neuromorphic systems due to its potential…

Machine Learning · Computer Science 2025-05-20 Chengping He , Mingrui Jiang , Keyi Shan , Szu-Hao Yang , Zefan Li , Shengbo Wang , Giacomo Pedretti , Jim Ignowski , Can Li

Introduction. Neural network models of autoassociative, distributed memory allow storage and retrieval of many items (vectors) where the number of stored items can exceed the vector dimension (the number of neurons in the network). This…

Neural and Evolutionary Computing · Computer Science 2017-09-05 V. I. Gritsenko , D. A. Rachkovskij , A. A. Frolov , R. Gayler , D. Kleyko , E. Osipov

Associative memory architectures such as the Hopfield network have long been important conceptual and theoretical models for neuroscience and artificial intelligence. However, translating these abstract models into spiking neural networks…

Neurons and Cognition · Quantitative Biology 2025-07-02 William F. Podlaski , Christian K. Machens

Recent generalizations of the Hopfield model of associative memories are able to store a number $P$ of random patterns that grows exponentially with the number $N$ of neurons, $P=\exp(\alpha N)$. Besides the huge storage capacity, another…

Disordered Systems and Neural Networks · Physics 2024-02-14 Carlo Lucibello , Marc Mézard

An associative memory is a framework of content-addressable memory that stores a collection of message vectors (or a dataset) over a neural network while enabling a neurally feasible mechanism to recover any message in the dataset from its…

Machine Learning · Statistics 2016-11-30 Arya Mazumdar , Ankit Singh Rawat

The Little-Hopfield network is an auto-associative computational model of neural memory storage and retrieval. This model is known to robustly store collections of randomly generated binary patterns as stable-states of the network dynamics.…

Neurons and Cognition · Quantitative Biology 2015-04-30 Christopher Hillar , Ngoc Tran , Kilian Koepsell

A large number of neural network models of associative memory have been proposed in the literature. These include the classical Hopfield networks (HNs), sparse distributed memories (SDMs), and more recently the modern continuous Hopfield…

Neural and Evolutionary Computing · Computer Science 2022-06-20 Beren Millidge , Tommaso Salvatori , Yuhang Song , Thomas Lukasiewicz , Rafal Bogacz

In the present paper, an effort has been made for storing and recalling images with Hopfield Neural Network Model of auto-associative memory. Images are stored by calculating a corresponding weight matrix. Thereafter, starting from an…

Neural and Evolutionary Computing · Computer Science 2011-05-03 C. Ramya , G. Kavitha , Dr. K. S. Shreedhara

Associative memory or content addressable memory is an important component function in computer science and information processing and is a key concept in cognitive and computational brain science. Many different neural network…

Neural and Evolutionary Computing · Computer Science 2025-02-19 Anders Lansner , Naresh B Ravichandran , Pawel Herman

An autoassociative memory model is a function that, given a set of data points, takes as input an arbitrary vector and outputs the most similar data point from the memorized set. However, popular memory models fail to retrieve images even…

Machine Learning · Computer Science 2024-02-19 Tommaso Salvatori , Beren Millidge , Yuhang Song , Rafal Bogacz , Thomas Lukasiewicz

Natural memories are associative, declarative and distributed. Symbolic computing memories resemble natural memories in their declarative character, and information can be stored and recovered explicitly; however, they lack the associative…

Artificial Intelligence · Computer Science 2020-09-29 Luis A. Pineda , Gibrán Fuentes , Rafael Morales