English

Accuracy and capacity of Modern Hopfield networks with synaptic noise

Disordered Systems and Neural Networks 2025-03-04 v1

Abstract

We study the retrieval accuracy and capacity of modern Hopfield networks of with two-state (Ising) spins interacting via modified Hebbian nn-spin interactions. In particular, we consider systems where the interactions deviate from the Hebb rule through additive or multiplicative noise or through clipping or deleting interactions. We find that the capacity scales as Nn1N^{n-1} with the number of spins NN in all cases, but with a prefactor reduced compared to the Hebbian case. For n=2n=2 our results agree with the previously known results for the conventional n=2n = 2 Hopfield network.

Keywords

Cite

@article{arxiv.2503.00241,
  title  = {Accuracy and capacity of Modern Hopfield networks with synaptic noise},
  author = {Sharba Bhattacharjee and Ivar Martin},
  journal= {arXiv preprint arXiv:2503.00241},
  year   = {2025}
}

Comments

24 pages, 9 figures