English
Related papers

Related papers: Associative Memory Model with Neural Networks: Mem…

200 papers

Recently, deep convolutional neural network (CNN) have been widely used in image restoration and obtained great success. However, most of existing methods are limited to local receptive field and equal treatment of different types of…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Yucheng Hang , Qingmin Liao , Wenming Yang , Yupeng Chen , Jie Zhou

We consider the problem of neural association for a network of non-binary neurons. Here, the task is to first memorize a set of patterns using a network of neurons whose states assume values from a finite number of integer levels. Later,…

Neural and Evolutionary Computing · Computer Science 2013-02-18 Amir Hesam Salavati , K. Raj Kumar , Amin Shokrollahi

It has been shown that a neural network model recently proposed to describe basic memory performance is based on a ternary/binary coding/decoding algorithm which leads to a new neural network assembly memory model (NNAMM) providing…

Artificial Intelligence · Computer Science 2007-05-23 Petro M. Gopych

As humans, we can remember certain visuals in great detail, and sometimes even after viewing them once. What is even more interesting is that humans tend to remember and forget the same things, suggesting that there might be some general…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Ananya Sadana , Nikita Thakur , Nikita Poria , Astika Anand , Seeja K. R

The standard model of memory consolidation foresees that memories are initially recorded in the hippocampus, while features that capture higher-level generalisations of data are created in the cortex, where they are stored for a possibly…

Neurons and Cognition · Quantitative Biology 2017-06-20 Alessandro Fontana

In this paper, we propose a mechanism for storing complex patterns within a neural network and subsequently recalling them. This model is based on our work published in 2018(Inazawa, 2018), which we have refined and extended in this work.…

Neural and Evolutionary Computing · Computer Science 2025-04-10 Hiroshi Inazawa

Automatically generating a natural language description of an image is a task close to the heart of image understanding. In this paper, we present a multi-model neural network method closely related to the human visual system that…

Computer Vision and Pattern Recognition · Computer Science 2017-06-09 Zhongliang Yang , Yu-Jin Zhang , Sadaqat ur Rehman , Yongfeng Huang

To solve a navigation task based on experiences, we need a mechanism to associate places with objects and to recall them along the course of action. In a reward-oriented task, if the route to a reward location is simulated in mind after…

Neurons and Cognition · Quantitative Biology 2024-10-28 Hiroki Nakagawa , Katsumi Tateno , Kensuke Takada , Takashi Morie

We consider the problem of training a neural network to store a set of patterns with maximal noise robustness. A solution, in terms of optimal weights and state update rules, is derived by training each individual neuron to perform either…

Neural and Evolutionary Computing · Computer Science 2024-07-24 Georgios Iatropoulos , Johanni Brea , Wulfram Gerstner

Neural networks powered with external memory simulate computer behaviors. These models, which use the memory to store data for a neural controller, can learn algorithms and other complex tasks. In this paper, we introduce a new memory to…

Neural and Evolutionary Computing · Computer Science 2019-12-30 Hung Le , Truyen Tran , Svetha Venkatesh

A recurrent neural network model storing multiple spatial maps, or ``charts'', is analyzed. A network of this type has been suggested as a model for the origin of place cells in the hippocampus of rodents. The extremely diluted and fully…

Disordered Systems and Neural Networks · Physics 2009-10-31 Francesco P. Battaglia , Alessandro Treves

Visual attention is a mechanism closely intertwined with vision and memory. Top-down information influences visual processing through attention. We designed a neural network model inspired by aspects of human visual attention. This model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ruoyang Hu , Robert A. Jacobs

Associative memories are structures that store data in such a way that it can later be retrieved given only a part of its content -- a sort-of error/erasure-resilience property. They are used in applications ranging from caches and memory…

Information Theory · Computer Science 2013-04-23 Vincent Gripon , Michael Rabbat

We study a model of associative memory based on a neural network with small-world structure. The efficacy of the network to retrieve one of the stored patterns exhibits a phase transition at a finite value of the disorder. The more ordered…

Adaptation and Self-Organizing Systems · Physics 2009-11-10 Luis G. Morelli , Guillermo Abramson , Marcelo N. Kuperman

The potential for associative recall of diluted neuronal networks is investigated with respect to several biologically relevant configurations, more specifically the position of the cells along the input space and the spatial distribution…

Statistical Mechanics · Physics 2015-06-24 Luciano da Fontoura Costa , Dietrich Stauffer

While deep convolutional neural networks (CNNs) have shown a great success in single-label image classification, it is important to note that real world images generally contain multiple labels, which could correspond to different objects,…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Jiang Wang , Yi Yang , Junhua Mao , Zhiheng Huang , Chang Huang , Wei Xu

We consider two models of Hopfield-like associative memory with $q$-valued neurons: Potts-glass neural network (PGNN) and parametrical neural network (PNN). In these models neurons can be in more than two different states. The models have…

Disordered Systems and Neural Networks · Physics 2007-05-23 B. V. Kryzhanovsky , L. B. Litinskii , A. L. Mikaelian

An autoassociative memory model is a function that, given a set of data points, takes as input an arbitrary vector and outputs the most similar data point from the memorized set. However, popular memory models fail to retrieve images even…

Machine Learning · Computer Science 2024-02-19 Tommaso Salvatori , Beren Millidge , Yuhang Song , Rafal Bogacz , Thomas Lukasiewicz

We investigate a recurrent neural network model with common external and bias inputs that can retrieve branching sequences. Retrieval of memory sequences is one of the most important functions of the brain. A lot of research has been done…

Disordered Systems and Neural Networks · Physics 2009-11-13 Kentaro Katahira , Masaki Kawamura , Kazuo Okanoya , Masato Okada

Dense Associative Memories or modern Hopfield networks permit storage and reliable retrieval of an exponentially large (in the dimension of feature space) number of memories. At the same time, their naive implementation is non-biological,…

Neurons and Cognition · Quantitative Biology 2021-04-29 Dmitry Krotov , John Hopfield