English

Learning Regional Monsoon Patterns with a Multimodal Attention U-Net

Computer Vision and Pattern Recognition 2025-09-30 v1 Artificial Intelligence Machine Learning

Abstract

Accurate monsoon rainfall prediction is vital for India's agriculture, water management, and climate risk planning, yet remains challenging due to sparse ground observations and complex regional variability. We present a multimodal deep learning framework for high-resolution precipitation classification that leverages satellite and Earth observation data. Unlike previous rainfall prediction models based on coarse 5-50 km grids, we curate a new 1 km resolution dataset for five Indian states, integrating seven key geospatial modalities: land surface temperature, vegetation (NDVI), soil moisture, relative humidity, wind speed, elevation, and land use, covering the June-September 2024 monsoon season. Our approach uses an attention-guided U-Net architecture to capture spatial patterns and temporal dependencies across modalities, combined with focal and dice loss functions to handle rainfall class imbalance defined by the India Meteorological Department (IMD). Experiments demonstrate that our multimodal framework consistently outperforms unimodal baselines and existing deep learning methods, especially in extreme rainfall categories. This work contributes a scalable framework, benchmark dataset, and state-of-the-art results for regional monsoon forecasting, climate resilience, and geospatial AI applications in India.

Keywords

Cite

@article{arxiv.2509.23267,
  title  = {Learning Regional Monsoon Patterns with a Multimodal Attention U-Net},
  author = {Swaib Ilias Mazumder and Manish Kumar and Aparajita Khan},
  journal= {arXiv preprint arXiv:2509.23267},
  year   = {2025}
}

Comments

Accepted in Geospatial AI and Applications with Foundation Models (GAIA) 2025, INSAIT and ELLIS Unit Sofia, Bulgaria

R2 v1 2026-07-01T06:00:47.023Z