English

Generative Adaptation of Dynamics to Environmental Shifts via Weight-space Diffusion

Computational Engineering, Finance, and Science 2026-05-05 v2

Abstract

Data-driven dynamics prediction often fails under environmental shifts, while traditional fine-tuning remains computationally prohibitive for hardware-constrained or data-scarce applications. We propose DynaDiff, a generative meta-learning framework that transitions the paradigm from gradient-based tuning or modulation to direct weight-space generation. Specifically, we first abstract expert weights as novel weight graphs, utilizing multi-head attention to explicitly capture topological coupling within weights. Subsequently, we design a functional loss to ensure that the generated models achieve consistency with expert models in physical behavior. Finally, we develop a dynamics-informed prompter that extracts cross-domain physical and spectral features from observation sequences to condition the diffusion model. Experiments demonstrate that DynaDiff boosts average prediction accuracy by 10.78% over competitive baselines. Furthermore, by pre-constructing a model zoo of expert predictors, we amortize the fine-tuning overhead into a one-time offline cost, significantly boosting deployment efficiency in new environments.

Keywords

Cite

@article{arxiv.2505.13919,
  title  = {Generative Adaptation of Dynamics to Environmental Shifts via Weight-space Diffusion},
  author = {Ruikun Li and Huandong Wang and Jingtao Ding and Yuan Yuan and Qingmin Liao and Yong Li},
  journal= {arXiv preprint arXiv:2505.13919},
  year   = {2026}
}

Comments

ICML 2026