English

Non-Convex Multi-species Hopfield models

Disordered Systems and Neural Networks 2018-07-11 v1 Mathematical Physics math.MP

Abstract

In this work we introduce a multi-species generalization of the Hopfield model for associative memory, where neurons are divided into groups and both inter-groups and intra-groups pair-wise interactions are considered, with different intensities. Thus, this system contains two of the main ingredients of modern Deep neural network architectures: Hebbian interactions to store patterns of information and multiple layers coding different levels of correlations. The model is completely solvable in the low-load regime with a suitable generalization of the Hamilton-Jacobi technique, despite the Hamiltonian can be a non-definite quadratic form of the magnetizations. The family of multi-species Hopfield model includes, as special cases, the 3-layers Restricted Boltzmann Machine (RBM) with Gaussian hidden layer and the Bidirectional Associative Memory (BAM) model.

Keywords

Cite

@article{arxiv.1807.03609,
  title  = {Non-Convex Multi-species Hopfield models},
  author = {Elena Agliari and Danila Migliozzi and Daniele Tantari},
  journal= {arXiv preprint arXiv:1807.03609},
  year   = {2018}
}

Comments

This is a pre-print of an article published in J. Stat. Phys

R2 v1 2026-06-23T02:56:16.482Z