English

Hyperfastrl: Hypernetwork-based reinforcement learning for unified control of parametric chaotic PDEs

Computational Engineering, Finance, and Science 2026-04-09 v1 Systems and Control Systems and Control

Abstract

Spatiotemporal chaos in fluid systems exhibits severe parametric sensitivity, rendering classical adjoint-based optimal control intractable because each operating regime requires recomputing the control law. We address this bottleneck with hyperFastRL, a parameter-conditioned reinforcement learning framework that leverages Hypernetworks to shift from tuning isolated controllers per-regime to learning a unified parametric control manifold. By mapping a physical forcing parameter {\mu} directly to the weights of a spatial feedback policy, the architecture cleanly decouples parametric adaptation from spatial boundary stabilization. To overcome the extreme variance inherent to chaotic reward landscapes, we deploy a pessimistic distributional value estimation over a massively parallel environment ensemble. We evaluate three Hypernetwork functional forms, ranging from residual MLPs to periodic Fourier and Kolmogorov-Arnold (KAN) representations, on the Kuramoto-Sivashinsky equation under varying spatial forcing. All forms achieve robust stabilization. KAN yields the most consistent energy-cascade suppression and tracking across unseen parametrizations, while Fourier networks exhibit worse extrapolation variability. Furthermore, leveraging high-throughput parallelization allows us to intentionally trade a fraction of peak asymptotic reward for a 37% reduction in training wall-clock time, identifying an optimal operating regime for practical deployment in complex, parameter-varying chaotic PDEs.

Keywords

Cite

@article{arxiv.2604.06497,
  title  = {Hyperfastrl: Hypernetwork-based reinforcement learning for unified control of parametric chaotic PDEs},
  author = {Anil Sapkota and Omer San},
  journal= {arXiv preprint arXiv:2604.06497},
  year   = {2026}
}

Comments

24 pages, 9 figures

R2 v1 2026-07-01T11:58:23.855Z