Coupling-Robust Accuracy in Multiphysics Physics Informed Neural Networks via Kronecker-Preconditioned Optimization
Abstract
Physics-informed neural networks (PINNs) for coupled multiphysics systems suffer systematic accuracy degradation as inter-equation coupling strengthens. We provide a theoretical explanation for this phenomenon through neural tangent kernel (NTK) analysis: for linearly coupled systems, we prove that the standard NTK's spectral radius grows as with coupling strength , shrinking the stable learning rate, while block-diagonal Gauss--Newton (GN) preconditioning yields a preconditioned NTK (where is the block-diagonal GN Hessian) whose spectral radius is bounded by ( = number of networks), independent of . We verify the growth numerically across symmetric, asymmetric, and nonlinear coupled PDE systems, and confirm with equality in all cases. Combining the Kronecker-preconditioned optimizer SOAP with inverse-gradient-norm loss balancing (SOAP+GN) yields coupling-robust accuracy: across 234 experiments spanning three 1D systems of increasing nonlinearity and a 2D electroosmotic flow benchmark, SOAP+GN maintains final-epoch degradation (ratio of strong- to weak-coupling error) even as coupling parameters vary over one to two orders of magnitude, compared with for Adam+GN. SOAP+GN further scales to a 2D, 6-PDE electroosmotic flow system at EDL-resolved conditions -- a regime that all prior PINN electrokinetics studies have avoided through simplified physics -- where Adam+GN fails entirely ().
Cite
@article{arxiv.2605.23391,
title = {Coupling-Robust Accuracy in Multiphysics Physics Informed Neural Networks via Kronecker-Preconditioned Optimization},
author = {Youngjae Park and Jaemin Kim and Junghwa Hong},
journal= {arXiv preprint arXiv:2605.23391},
year = {2026}
}
Comments
20 pages, 10 figures. Extended version of AI4Physics Workshop submission (ICML 2026)