English

Spectral Concentration at the Edge of Stability: Information Geometry of Kernel Associative Memory

Machine Learning 2025-12-23 v5 Neural and Evolutionary Computing Machine Learning

Abstract

High-capacity kernel Hopfield networks exhibit a \textit{Ridge of Optimization} characterized by extreme stability. While previously linked to \textit{Spectral Concentration}, its origin remains elusive. Here, we analyze the network dynamics on a statistical manifold, revealing that the Ridge corresponds to the Edge of Stability, a critical boundary where the Fisher Information Matrix becomes singular. We demonstrate that the apparent Euclidean force antagonism is a manifestation of \textit{Dual Equilibrium} in the Riemannian space. This unifies learning dynamics and capacity via the Minimum Description Length principle, offering a geometric theory of self-organized criticality.

Keywords

Cite

@article{arxiv.2511.23083,
  title  = {Spectral Concentration at the Edge of Stability: Information Geometry of Kernel Associative Memory},
  author = {Akira Tamamori},
  journal= {arXiv preprint arXiv:2511.23083},
  year   = {2025}
}

Comments

5 pages, 4 figures