Accuracy and capacity of Modern Hopfield networks with synaptic noise
Disordered Systems and Neural Networks
2025-03-04 v1
Abstract
We study the retrieval accuracy and capacity of modern Hopfield networks of with two-state (Ising) spins interacting via modified Hebbian -spin interactions. In particular, we consider systems where the interactions deviate from the Hebb rule through additive or multiplicative noise or through clipping or deleting interactions. We find that the capacity scales as with the number of spins in all cases, but with a prefactor reduced compared to the Hebbian case. For our results agree with the previously known results for the conventional Hopfield network.
Keywords
Cite
@article{arxiv.2503.00241,
title = {Accuracy and capacity of Modern Hopfield networks with synaptic noise},
author = {Sharba Bhattacharjee and Ivar Martin},
journal= {arXiv preprint arXiv:2503.00241},
year = {2025}
}
Comments
24 pages, 9 figures