Storing non-uniformly distributed messages in networks of neural cliques
Abstract
Associative memories are data structures that allow retrieval of stored messages from part of their content. They thus behave similarly to human brain that is capable for instance of retrieving the end of a song given its beginning. Among different families of associative memories, sparse ones are known to provide the best efficiency (ratio of the number of bits stored to that of bits used). Nevertheless, it is well known that non-uniformity of the stored messages can lead to dramatic decrease in performance. We introduce several strategies to allow efficient storage of non-uniform messages in recently introduced sparse associative memories. We analyse and discuss the methods introduced. We also present a practical application example.
Keywords
Cite
@article{arxiv.1307.6410,
title = {Storing non-uniformly distributed messages in networks of neural cliques},
author = {Bartosz Boguslawski and Vincent Gripon and Fabrice Seguin and Frédéric Heitzmann},
journal= {arXiv preprint arXiv:1307.6410},
year = {2013}
}
Comments
21 pages, 8 figures, submitted to Neurocomputing