English

FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function design

Atmospheric and Oceanic Physics 2025-09-23 v1 Machine Learning

Abstract

Machine learning weather prediction (MLWP) models have demonstrated remarkable potential in delivering accurate forecasts at significantly reduced computational cost compared to traditional numerical weather prediction (NWP) systems. However, challenges remain in ensuring the physical consistency of MLWP outputs, particularly in deterministic settings. This study presents FastNet, a graph neural network (GNN)-based global prediction model, and investigates the impact of alternative loss function designs on improving the physical realism of its forecasts. We explore three key modifications to the standard mean squared error (MSE) loss: (1) a modified spherical harmonic (MSH) loss that penalises spectral amplitude errors to reduce blurring and enhance small-scale structure retention; (2) inclusion of horizontal gradient terms in the loss to suppress non-physical artefacts; and (3) an alternative wind representation that decouples speed and direction to better capture extreme wind events. Results show that while the MSH and gradient-based losses \textit{alone} may slightly degrade RMSE scores, when trained in combination the model exhibits very similar MSE performance to an MSE-trained model while at the same time significantly improving spectral fidelity and physical consistency. The alternative wind representation further improves wind speed accuracy and reduces directional bias. Collectively, these findings highlight the importance of loss function design as a mechanism for embedding domain knowledge into MLWP models and advancing their operational readiness.

Keywords

Cite

@article{arxiv.2509.17601,
  title  = {FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function design},
  author = {Tom Dunstan and Oliver Strickson and Thusal Bennett and Jack Bowyer and Matthew Burnand and James Chappell and Alejandro Coca-Castro and Kirstine Ida Dale and Eric G. Daub and Noushin Eftekhari and Manvendra Janmaijaya and Jon Lillis and David Salvador-Jasin and Nathan Simpson and Ryan Sze-Yin Chan and Mohamad Elmasri and Lydia Allegranza France and Sam Madge and Levan Bokeria and Hannah Brown and Tom Dodds and Anna-Louise Ellis and David Llewellyn-Jones and Theo McCaie and Sophia Moreton and Tom Potter and James Robinson and Adam A. Scaife and Iain Stenson and David Walters and Karina Bett-Williams and Louisa van Zeeland and Peter Yatsyshin and J. Scott Hosking},
  journal= {arXiv preprint arXiv:2509.17601},
  year   = {2025}
}
R2 v1 2026-07-01T05:49:16.666Z