English
Related papers

Related papers: Recalling of Images using Hopfield Neural Network …

200 papers

Recent research has established a connection between modern Hopfield networks (HNs) and transformer attention heads, with guarantees of exponential storage capacity. However, these models still face challenges scaling storage efficiently.…

Machine Learning · Computer Science 2025-04-11 Saul Santos , António Farinhas , Daniel C. McNamee , André F. T. Martins

A large number of neural network models of associative memory have been proposed in the literature. These include the classical Hopfield networks (HNs), sparse distributed memories (SDMs), and more recently the modern continuous Hopfield…

Neural and Evolutionary Computing · Computer Science 2022-06-20 Beren Millidge , Tommaso Salvatori , Yuhang Song , Thomas Lukasiewicz , Rafal Bogacz

Sequence memory is an essential attribute of natural and artificial intelligence that enables agents to encode, store, and retrieve complex sequences of stimuli and actions. Computational models of sequence memory have been proposed where…

Neural and Evolutionary Computing · Computer Science 2023-11-06 Hamza Tahir Chaudhry , Jacob A. Zavatone-Veth , Dmitry Krotov , Cengiz Pehlevan

Image memorability refers to the phenomenon where certain images are more likely to be remembered than others. It is a quantifiable and intrinsic image attribute, defined as the likelihood of an image being remembered upon a single…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Elham Bagheri , Yalda Mohsenzadeh

In neuroscience, classical Hopfield networks are the standard biologically plausible model of long-term memory, relying on Hebbian plasticity for storage and attractor dynamics for recall. In contrast, memory-augmented neural networks in…

Neurons and Cognition · Quantitative Biology 2021-10-28 Danil Tyulmankov , Ching Fang , Annapurna Vadaparty , Guangyu Robert Yang

Associative memory architectures such as the Hopfield network have long been important conceptual and theoretical models for neuroscience and artificial intelligence. However, translating these abstract models into spiking neural networks…

Neurons and Cognition · Quantitative Biology 2025-07-02 William F. Podlaski , Christian K. Machens

The two main impediments to continual learning are catastrophic forgetting and memory limitations on the storage of data. To cope with these challenges, we propose a novel, cognitively-inspired approach which trains autoencoders with Neural…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Ali Ayub , Alan R. Wagner

Neuroscience and Artificial Intelligence (AI) have progressed in tandem, each contributing to our understanding of the brain, and inspiring recent developments in biologically-plausible neural networks (NNs) and learning rules. Predictive…

Neural and Evolutionary Computing · Computer Science 2024-06-24 Ehsan Ganjidoost , Mallory Snow , Jeff Orchard

The two main challenges faced by continual learning approaches are catastrophic forgetting and memory limitations on the storage of data. To cope with these challenges, we propose a novel, cognitively-inspired approach which trains…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Ali Ayub , Alan R. Wagner

A recurrent neural network model storing multiple spatial maps, or ``charts'', is analyzed. A network of this type has been suggested as a model for the origin of place cells in the hippocampus of rodents. The extremely diluted and fully…

Disordered Systems and Neural Networks · Physics 2009-10-31 Francesco P. Battaglia , Alessandro Treves

Associative memory models, such as Hopfield networks and their modern variants, have garnered renewed interest due to advancements in memory capacity and connections with self-attention in transformers. In this work, we introduce a unified…

Machine Learning · Computer Science 2025-10-28 Saul Santos , Vlad Niculae , Daniel McNamee , André F. T. Martins

For the Hopfield model with the Hebb connection matrix we investigate the case of $p$ memorized patterns that are distorted copies of the same {\it standard}. In other words, we try to simulate that learning always takes place by means of…

Disordered Systems and Neural Networks · Physics 2007-05-23 L. B. Litinskii

This paper proposes quantum image reconstruction. Input-triggered selection of an image among many stored ones, and its reconstruction if the input is occluded or noisy, has been simulated by a computer program implementable in a real…

Quantum Physics · Physics 2009-11-10 Mitja Perus , Horst Bischof , Chu Kiong Loo

We introduce Graph Hopfield Networks, whose energy function couples associative memory retrieval with graph Laplacian smoothing for node classification. Gradient descent on this joint energy yields an iterative update interleaving Hopfield…

Machine Learning · Computer Science 2026-03-05 Abinav Rao , Alex Wa , Rishi Athavale

Automatically generating a natural language description of an image is a task close to the heart of image understanding. In this paper, we present a multi-model neural network method closely related to the human visual system that…

Computer Vision and Pattern Recognition · Computer Science 2017-06-09 Zhongliang Yang , Yu-Jin Zhang , Sadaqat ur Rehman , Yongfeng Huang

This paper describes a new type of auto-associative image classifier that uses a shallow architecture with a very quick learning phase. The image is parsed into smaller areas and each area is saved directly for a region, along with the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Kieran Greer

We study the problem of learning associative memory -- a system which is able to retrieve a remembered pattern based on its distorted or incomplete version. Attractor networks provide a sound model of associative memory: patterns are stored…

Machine Learning · Statistics 2021-04-21 Sergey Bartunov , Jack W Rae , Simon Osindero , Timothy P Lillicrap

We analyze a variant of the Hopfield model that incorporates an unlearning mechanism based on spin correlations in the high-temperature regime. In the large system limit where extensively many patterns are stored, we employ the replica…

Disordered Systems and Neural Networks · Physics 2026-02-10 Shuta Takeuchi , Takashi Takahashi , Yoshiyuki Kabashima

Achieving human-like memory recall in artificial systems remains a challenging frontier in computer vision. Humans demonstrate remarkable ability to recall images after a single exposure, even after being shown thousands of images. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Virgile Foussereau , Robin Dumas

In this paper, we present a neural network system related to about memory and recall that consists of one neuron group (the "cue ball") and a one-layer neural net (the "recall net"). This system realizes the bidirectional memorization…

Neural and Evolutionary Computing · Computer Science 2022-10-11 Hiroshi Inazawa