English

Task-Driven Prompt Learning: A Joint Framework for Multi-modal Cloud Removal and Segmentation

Computer Vision and Pattern Recognition 2026-04-29 v2

Abstract

Optical remote sensing imagery is indispensable for Earth observation, yet persistent cloud occlusion limits its downstream utility. Most cloud removal (CR) methods are optimized for low-level fidelity and can over-smooth textures and boundaries that are critical for analysis-ready data (ARD), leading to a mismatch between visually plausible restoration and semantic utility. To bridge this gap, we propose TDP-CR, a task-driven multimodal framework that jointly performs cloud removal and land-cover segmentation. Central to our approach is a Prompt-Guided Fusion (PGF) mechanism, which utilizes a learnable degradation prompt to encode cloud thickness and spatial uncertainty. By combining global channel context with local prompt-conditioned spatial bias, PGF adaptively integrates Synthetic Aperture Radar (SAR) information only where optical data is corrupted. We further introduce a parameter-efficient two-phase training strategy that decouples reconstruction and semantic representation learning. Experiments on the LuojiaSET-OSFCR dataset demonstrate the superiority of our framework: TDP-CR surpasses heavy state-of-the-art baselines by 0.18 dB in PSNR while using only 15\% of the parameters, and achieves a 1.4\% improvement in mIoU consistently against multi-task competitors, effectively delivering analysis-ready data.

Keywords

Cite

@article{arxiv.2601.12052,
  title  = {Task-Driven Prompt Learning: A Joint Framework for Multi-modal Cloud Removal and Segmentation},
  author = {Zaiyan Zhang and Jie Li and Shaowei Shi and Qiangqiang Yuan},
  journal= {arXiv preprint arXiv:2601.12052},
  year   = {2026}
}

Comments

Accepted by IGARSS 2026 Conference (Oral)

R2 v1 2026-07-01T09:08:55.448Z