Collective Kernel EFT for Pre-activation ResNets
Abstract
In finite-width deep neural networks, the empirical kernel evolves stochastically across layers. We develop a collective kernel effective field theory (EFT) for pre-activation ResNets based on a -only closure hierarchy and diagnose its finite validity window. Exploiting the exact conditional Gaussianity of residual increments, we derive an exact stochastic recursion for . Applying Gaussian approximations systematically yields a continuous-depth ODE system for the mean kernel , the kernel covariance , and the mean correction , which emerges diagrammatically as a one-loop tadpole correction. Numerically, remains accurate at all depths. However, the equation residual accumulates to an error at finite time, primarily driven by approximation errors in the -only transport term. Furthermore, fails due to the breakdown of the source closure, which exhibits a systematic mismatch even at initialization. These findings highlight the limitations of -only state-space reduction and suggest extending the state space to incorporate the sigma-kernel.
Cite
@article{arxiv.2604.15742,
title = {Collective Kernel EFT for Pre-activation ResNets},
author = {Hidetoshi Kawase and Toshihiro Ota},
journal= {arXiv preprint arXiv:2604.15742},
year = {2026}
}
Comments
20 pages