English

Think with Extra-Image: A Farmland Segmentation Agent Driven by Spatio-Temporal Information Gain

Computer Vision and Pattern Recognition 2026-07-30 v1

Abstract

Existing farmland remote sensing image (FRSI) segmentation follows a "Think with Intra-Image" paradigm, assuming that the current image contains sufficient visual evidence for reliable segmentation. Yet farmland appearance varies with phenology and spatial context and is often confused with other land-cover, making instantaneous, local observations inadequate. Thus, segmentation ambiguity stems not only from limited model representation, but more fundamentally from the required spatio-temporal information lying beyond the current image. Based on this insight, we redefine FRSI segmentation from an information bottleneck perspective as a dynamic decision process driven by task-relevant extra spatio-temporal information gain. We further propose FarmSeeker, a dynamic FRSI segmentation agent that identifies ambiguous regions, reasons about their causes, and queries extra spatio-temporal information on demand for accurate segmentation. To evaluate FarmSeeker, we construct GSFS-Bench, the first global-scale, high-resolution FRSI segmentation benchmark that supports reasoning-querying. Experiments show that FarmSeeker achieves more stable segmentation performance than existing methods. The project is publicly available at: https://withoutocean.github.io/FarmSeeker/

Cite

@article{arxiv.2607.28186,
  title  = {Think with Extra-Image: A Farmland Segmentation Agent Driven by Spatio-Temporal Information Gain},
  author = {Haiyang Wu and Weiliang Mu and Zhuofei Du and Dandan Zhong and Kaijie Shi and Haifeng Li and Chao Tao},
  journal= {arXiv preprint arXiv:2607.28186},
  year   = {2026}
}