English

Coupling-Robust Accuracy in Multiphysics Physics Informed Neural Networks via Kronecker-Preconditioned Optimization

Machine Learning 2026-05-25 v1 Numerical Analysis Numerical Analysis

Abstract

Physics-informed neural networks (PINNs) for coupled multiphysics systems suffer systematic accuracy degradation as inter-equation coupling strengthens. We provide a theoretical explanation for this phenomenon through neural tangent kernel (NTK) analysis: for linearly coupled systems, we prove that the standard NTK's spectral radius grows as Ω(γ2)\Omega(\gamma^2) with coupling strength γ\gamma, shrinking the stable learning rate, while block-diagonal Gauss--Newton (GN) preconditioning yields a preconditioned NTK KP=JH+JK_P = J H^{+} J^\top (where HH is the block-diagonal GN Hessian) whose spectral radius is bounded by SS (SS = number of networks), independent of γ\gamma. We verify the Ω(γ2)\Omega(\gamma^2) growth numerically across symmetric, asymmetric, and nonlinear coupled PDE systems, and confirm λmax(KP)=S\lambda_{\max}(K_P) = S with equality in all cases. Combining the Kronecker-preconditioned optimizer SOAP with inverse-gradient-norm loss balancing (SOAP+GN) yields coupling-robust accuracy: across 234 experiments spanning three 1D systems of increasing nonlinearity and a 2D electroosmotic flow benchmark, SOAP+GN maintains final-epoch L2L_2 degradation 1.1×\leq 1.1\times (ratio of strong- to weak-coupling error) even as coupling parameters vary over one to two orders of magnitude, compared with >102×> 10^2\times for Adam+GN. SOAP+GN further scales to a 2D, 6-PDE electroosmotic flow system at EDL-resolved conditions -- a regime that all prior PINN electrokinetics studies have avoided through simplified physics -- where Adam+GN fails entirely (L2>0.9L_2 > 0.9).

Cite

@article{arxiv.2605.23391,
  title  = {Coupling-Robust Accuracy in Multiphysics Physics Informed Neural Networks via Kronecker-Preconditioned Optimization},
  author = {Youngjae Park and Jaemin Kim and Junghwa Hong},
  journal= {arXiv preprint arXiv:2605.23391},
  year   = {2026}
}

Comments

20 pages, 10 figures. Extended version of AI4Physics Workshop submission (ICML 2026)

R2 v1 2026-07-22T07:27:53.459Z