English

Sonny: Breaking the Compute Wall in Medium-Range Weather Forecasting

Machine Learning 2026-03-24 v1 Artificial Intelligence Computer Vision and Pattern Recognition Atmospheric and Oceanic Physics

Abstract

Weather forecasting is a fundamental problem for protecting lives and infrastructure from high-impact atmospheric events. Recently, data-driven weather forecasting methods based on deep learning have demonstrated strong performance, often reaching accuracy levels competitive with operational numerical systems. However, many existing models rely on large-scale training regimes and compute-intensive architectures, which raises the practical barrier for academic groups with limited compute resources. Here we introduce Sonny, an efficient hierarchical transformer that achieves competitive medium-range forecasting performance while remaining feasible within reasonable compute budgets. At the core of Sonny is a two-stage StepsNet design: a narrow slow path first models large-scale atmospheric dynamics, and a subsequent full-width fast path integrates thermodynamic interactions. To stabilize medium-range rollout without an additional fine-tuning stage, we apply exponential moving average (EMA) during training. On WeatherBench2, Sonny yields robust medium-range forecast skill, remains competitive with operational baselines, and demonstrates clear advantages over FastNet, particularly at extended tropical lead times. In practice, Sonny can be trained to convergence on a single NVIDIA A40 GPU in approximately 5.5 days.

Keywords

Cite

@article{arxiv.2603.21284,
  title  = {Sonny: Breaking the Compute Wall in Medium-Range Weather Forecasting},
  author = {Minjong Cheon},
  journal= {arXiv preprint arXiv:2603.21284},
  year   = {2026}
}
R2 v1 2026-07-01T11:32:16.853Z