Spectral Concentration at the Edge of Stability: Information Geometry of Kernel Associative Memory
Machine Learning
2025-12-23 v5 Neural and Evolutionary Computing
Machine Learning
Abstract
High-capacity kernel Hopfield networks exhibit a \textit{Ridge of Optimization} characterized by extreme stability. While previously linked to \textit{Spectral Concentration}, its origin remains elusive. Here, we analyze the network dynamics on a statistical manifold, revealing that the Ridge corresponds to the Edge of Stability, a critical boundary where the Fisher Information Matrix becomes singular. We demonstrate that the apparent Euclidean force antagonism is a manifestation of \textit{Dual Equilibrium} in the Riemannian space. This unifies learning dynamics and capacity via the Minimum Description Length principle, offering a geometric theory of self-organized criticality.
Keywords
Cite
@article{arxiv.2511.23083,
title = {Spectral Concentration at the Edge of Stability: Information Geometry of Kernel Associative Memory},
author = {Akira Tamamori},
journal= {arXiv preprint arXiv:2511.23083},
year = {2025}
}
Comments
5 pages, 4 figures