English

Geometric and Spectral Alignment for Deep Neural Network I

Machine Learning 2026-05-05 v1 Differential Geometry

Abstract

Deep residual architectures are modeled as products of near-identity Jacobians. This paper proves deterministic quotient-geometric estimates for singular spectra of Frobenius-normalized layer factors, emphasizing a normalized top-radial Cartan coordinate and fitted power-law chart. Full-rank factors are mapped from GL(d)\mathrm{GL}(d) to the positive cone by AAAA\mapsto A^\top A, then to ordered eigenvalue data. Under Frobenius normalization, exact power-law spectra form a trace-normalized Cartan orbit. This orbit is a Gibbs family on ranks, a Fisher information line, and a Bures--Wasserstein curve with line element d/4d/4 times Fisher information. The main rigidity theorem is a slack-aware margin inequality: interface radial amplitude, non-backtracking slack, and signed residual variation control displacement of the fitted Cartan coordinate. In the exact-chart zero-slack case, a depth-LL budget gives exponent drift of order (logM)/L(\log M)/L; generally, slack and residual increments augment the bound. We separate scalar top-radial from full-Cartan spectral control, which also needs Bures/Hellinger residual variation. We prove approximate-power-law and metric-chart versions, converse lower bounds, Fisher--KL/Bures action estimates, and near-identity expansions for normalized residual chains. Near-identity results verify transport budgets; chart quality remains measurable. Effective rank is a spectral-energy quantile, giving finite-width power-law tail bounds and robust rank-window transition estimates. Empirical static-weight exponent profiles serve as diagnostics; full verification also requires interface budgets, slacks, and residuals for the same operator chain.

Keywords

Cite

@article{arxiv.2605.02108,
  title  = {Geometric and Spectral Alignment for Deep Neural Network I},
  author = {Ziran Liu and Wei Wang and Jinhao Wang and Pengcheng Wang and Xinyi Sui and Cihan Ruan and Nam Ling and Wei Jiang},
  journal= {arXiv preprint arXiv:2605.02108},
  year   = {2026}
}

Comments

41 pages, 1 figure

R2 v1 2026-07-01T12:47:48.200Z