Kohn-Sham Spectral Embedding on Sparse Graphs at the Nishimori Temperature for Image Classification
Abstract
We introduce Kohn--Sham Spectral Embedding (KSSE), a physics-inspired energy-based model replacing dense CNN classifiers with a sparse-graph spectral embedding evaluated at the Nishimori temperature of an associated Random-Bond Ising Model. By mapping pre-trained features onto quasi-cyclic low-density parity-check graphs and constructing a regularized Laplacian acting as a Kohn--Sham Hamiltonian, we solve independent channel spectral problems in time via FFT on circulant blocks (leveraging Pontryagin self-duality of ) and low-order Rayleigh refinement. Graph topology is optimized using \emph{star-domain surgery}: rather than destroying information-carrying codewords by removing frustrated cycles, we construct edge shifts creating local convexity around codewords while bounding residual frustration to . Multi-scale fractal analysis ( spectrum) and fractal learning-rate landscape certifies a landscape transition from rough regimes () to star-domain basins (), enabling Rayleigh refinement with modes. We prove six theoretical results: a generalized Ihara--Bass identity linking belief propagation to the Laplacian; trapping-set eigenvalue correspondence; additive channel separability with an explicit exchange-correlation bound; a surgery theorem bounding frustration with attractor width ; a quasi-stationarity perturbation bound; and a fixed-point convergence theorem. In a transductive protocol on ImageNet-1000 with frozen EfficientNet-B4 features (), KSSE achieves \textbf{88.93\%} Top-1 accuracy using M parameters, outperforming Swin-L (197M, 86.4--87.3\%) and matching ViT-H/14 (632M, 88.0--89.5\%) under standard inductive setups, while reducing model footprint by and , respectively.
Cite
@article{arxiv.2607.28428,
title = {Kohn-Sham Spectral Embedding on Sparse Graphs at the Nishimori Temperature for Image Classification},
author = {V. S. Usatyuk and D. A. Sapozhnikov and S. I. Egorov},
journal= {arXiv preprint arXiv:2607.28428},
year = {2026}
}
Comments
42 pages, 10 figures, 5 tables, was presented at the 10th International Conference 'Deep Learning on Computational Physics (DLCP2026)', under review for the Moscow University Physics Bulletin, Physics series