English

Radar DataTree: A FAIR and Cloud-Native Framework for Scalable Weather Radar Archives

Distributed, Parallel, and Cluster Computing 2025-10-30 v1

Abstract

We introduce Radar DataTree, the first dataset-level framework that extends the WMO FM-301 standard from individual radar volume scans to time-resolved, analysis-ready archives. Weather radar data are among the most scientifically valuable yet structurally underutilized Earth observation datasets. Despite widespread public availability, radar archives remain fragmented, vendor-specific, and poorly aligned with FAIR (Findable, Accessible, Interoperable, Reusable) principles, hindering large-scale research, reproducibility, and cloud-native computation. Radar DataTree addresses these limitations with a scalable, open-source architecture that transforms operational radar archives into FAIR-compliant, cloud-optimized datasets. Built on the FM-301/CfRadial 2.1 standard and implemented using xarray DataTree, Radar DataTree organizes radar volume scans as hierarchical, metadata-rich structures and serializes them to Zarr for scalable analysis. Coupled with Icechunk for ACID-compliant storage and versioning, this architecture enables efficient, parallel computation across thousands of radar scans with minimal preprocessing. We demonstrate significant performance gains in case studies including Quasi-Vertical Profile (QVP) and precipitation accumulation workflows, and release all tools and datasets openly via the Raw2Zarr repository. This work contributes a reproducible and extensible foundation for radar data stewardship, high-performance geoscience, and AI-ready weather infrastructure.

Keywords

Cite

@article{arxiv.2510.24943,
  title  = {Radar DataTree: A FAIR and Cloud-Native Framework for Scalable Weather Radar Archives},
  author = {Alfonso Ladino-Rincon and Stephen W. Nesbitt},
  journal= {arXiv preprint arXiv:2510.24943},
  year   = {2025}
}

Comments

8 pages, 3 figures

R2 v1 2026-07-01T07:10:35.133Z