English

From Swath to Full-Disc: Advancing Precipitation Retrieval with Multimodal Knowledge Expansion

Computer Vision and Pattern Recognition 2025-06-10 v1 Information Retrieval Multimedia

Abstract

Accurate near-real-time precipitation retrieval has been enhanced by satellite-based technologies. However, infrared-based algorithms have low accuracy due to weak relations with surface precipitation, whereas passive microwave and radar-based methods are more accurate but limited in range. This challenge motivates the Precipitation Retrieval Expansion (PRE) task, which aims to enable accurate, infrared-based full-disc precipitation retrievals beyond the scanning swath. We introduce Multimodal Knowledge Expansion, a two-stage pipeline with the proposed PRE-Net model. In the Swath-Distilling stage, PRE-Net transfers knowledge from a multimodal data integration model to an infrared-based model within the scanning swath via Coordinated Masking and Wavelet Enhancement (CoMWE). In the Full-Disc Adaptation stage, Self-MaskTune refines predictions across the full disc by balancing multimodal and full-disc infrared knowledge. Experiments on the introduced PRE benchmark demonstrate that PRE-Net significantly advanced precipitation retrieval performance, outperforming leading products like PERSIANN-CCS, PDIR, and IMERG. The code will be available at https://github.com/Zjut-MultimediaPlus/PRE-Net.

Keywords

Cite

@article{arxiv.2506.07050,
  title  = {From Swath to Full-Disc: Advancing Precipitation Retrieval with Multimodal Knowledge Expansion},
  author = {Zheng Wang and Kai Ying and Bin Xu and Chunjiao Wang and Cong Bai},
  journal= {arXiv preprint arXiv:2506.07050},
  year   = {2025}
}