The Capacity of Modern Hopfield Networks under the Data Manifold Hypothesis
Disordered Systems and Neural Networks
2025-03-13 v1
Abstract
We generalize the computation of the capacity of exponential Hopfield model from Lucibello and M\'ezard (2024) to more generic pattern ensembles, including binary patterns and patterns generated from a hidden manifold model.
Keywords
Cite
@article{arxiv.2503.09518,
title = {The Capacity of Modern Hopfield Networks under the Data Manifold Hypothesis},
author = {Beatrice Achilli and Luca Ambrogioni and Carlo Lucibello and Marc Mézard and Enrico Ventura},
journal= {arXiv preprint arXiv:2503.09518},
year = {2025}
}
Comments
ICLR 2025 Workshop Paper, 9 pages, 2 figures