English

Remote SAMsing: From Segment Anything to Segment Everything

Computer Vision and Pattern Recognition 2026-05-04 v1 Artificial Intelligence

Abstract

SAM2 produces high-quality zero-shot segmentation on natural images, but applying it to large remote sensing scenes exposes two problems: (1) its mask generator faces an inherent quality-coverage trade-off: strict thresholds yield precise masks but leave most of the image unsegmented, while relaxed thresholds increase coverage at the cost of mask quality; and (2) large images must be tiled, fragmenting objects across tile boundaries. We propose Remote SAMsing, an open-source pipeline that solves both problems without modifying SAM2 or requiring training data. For coverage, a multi-pass algorithm runs SAM2 repeatedly on each tile, painting accepted masks black between passes to simplify the scene for the next iteration, and relaxing quality thresholds only when coverage gains stagnate, ensuring that the most precise masks are always captured first. For spatial consistency, contextual padding and a parameter-free best-match merge reconstruct objects fragmented across tile boundaries. Evaluated on seven scenes (5~cm to 4.78~m GSD), the pipeline raises coverage from 30--68\% (single-pass SAM2) to 91--98\%. Ablation experiments quantify the contribution of each component to coverage and detection quality. Per-class evaluation shows that SAM2 transfers well to discrete RS objects (buildings 95\%, cars 82--93\% Det@0.5) with segment boundaries 3--8×\times more precise than SLIC and Felzenszwalb baselines. Tile size functions as an implicit scale parameter: reducing it from 1,0001{,}000 to 250 raises Det@0.5 from 56\% to 85\%, outperforming SAM2's built-in multi-scale mechanism. The pipeline generalizes to MNF false-color imagery without retraining (99.5\% ASA) and scales to production-sized images: a 1.94 billion pixel Potsdam mosaic achieved 97\% coverage without quality degradation.

Keywords

Cite

@article{arxiv.2605.00256,
  title  = {Remote SAMsing: From Segment Anything to Segment Everything},
  author = {Osmar Luiz Ferreira de Carvalho and Osmar Abílio de Carvalho Júnior and Anesmar Olino de Albuquerque and Daniel Guerreiro e Silva},
  journal= {arXiv preprint arXiv:2605.00256},
  year   = {2026}
}

Comments

31 pages, 8 figures, 7 tables

R2 v1 2026-07-01T12:44:33.992Z