English

Coupled Neural Associative Memories

Neural and Evolutionary Computing 2013-08-26 v5 Information Theory Machine Learning math.IT

Abstract

We propose a novel architecture to design a neural associative memory that is capable of learning a large number of patterns and recalling them later in presence of noise. It is based on dividing the neurons into local clusters and parallel plains, very similar to the architecture of the visual cortex of macaque brain. The common features of our proposed architecture with those of spatially-coupled codes enable us to show that the performance of such networks in eliminating noise is drastically better than the previous approaches while maintaining the ability of learning an exponentially large number of patterns. Previous work either failed in providing good performance during the recall phase or in offering large pattern retrieval (storage) capacities. We also present computational experiments that lend additional support to the theoretical analysis.

Keywords

Cite

@article{arxiv.1301.1555,
  title  = {Coupled Neural Associative Memories},
  author = {Amin Karbasi and Amir Hesam Salavati and Amin Shokrollahi},
  journal= {arXiv preprint arXiv:1301.1555},
  year   = {2013}
}

Comments

A shorter version of this paper is going to be submitted to International symposium on Information Theory (ISIT 2013) in Istanbul, Turkey

R2 v1 2026-06-21T23:05:52.050Z