English

Does Aurora Encode Atmospheric Structure? Latent Regime Analysis and Attribution

Machine Learning 2026-06-24 v1 Atmospheric and Oceanic Physics

Abstract

ML foundation models are able to emulate atmospheric dynamics accurately and efficiently but operate as opaque ``black boxes''. We investigate the internal representations of the Aurora model using spatially pooled PCA and layer-wise relevance propagation (LRP). We find evidence that Aurora's latent space is primarily organized by seasonal cycles, whereas extreme storm events do not form a linearly separable cluster. LRP indicates that the model attends to features consistent with the 3D vertical structure of the Great Storm of 1987. Perturbation tests show masking relevant regions degrades forecasts 3.31×3.31\times more than random masking. These findings suggest that Aurora learns meteorological coherence and vertical structure without explicit instruction.

Cite

@article{arxiv.2606.26361,
  title  = {Does Aurora Encode Atmospheric Structure? Latent Regime Analysis and Attribution},
  author = {Emma Kasteleyn and Ana Lucic},
  journal= {arXiv preprint arXiv:2606.26361},
  year   = {2026}
}

Comments

Accepted at the FM4Science and Sci4DL workshops at ICLR 2026