English

Towards PerSense++: Advancing Training-Free Personalized Instance Segmentation in Dense Images

Computer Vision and Pattern Recognition 2025-08-21 v1

Abstract

Segmentation in dense visual scenes poses significant challenges due to occlusions, background clutter, and scale variations. To address this, we introduce PerSense, an end-to-end, training-free, and model-agnostic one-shot framework for Personalized instance Segmentation in dense images. PerSense employs a novel Instance Detection Module (IDM) that leverages density maps (DMs) to generate instance-level candidate point prompts, followed by a Point Prompt Selection Module (PPSM) that filters false positives via adaptive thresholding and spatial gating. A feedback mechanism further enhances segmentation by automatically selecting effective exemplars to improve DM quality. We additionally present PerSense++, an enhanced variant that incorporates three additional components to improve robustness in cluttered scenes: (i) a diversity-aware exemplar selection strategy that leverages feature and scale diversity for better DM generation; (ii) a hybrid IDM combining contour and peak-based prompt generation for improved instance separation within complex density patterns; and (iii) an Irrelevant Mask Rejection Module (IMRM) that discards spatially inconsistent masks using outlier analysis. Finally, to support this underexplored task, we introduce PerSense-D, a dedicated benchmark for personalized segmentation in dense images. Extensive experiments across multiple benchmarks demonstrate that PerSense++ outperforms existing methods in dense settings.

Keywords

Cite

@article{arxiv.2508.14660,
  title  = {Towards PerSense++: Advancing Training-Free Personalized Instance Segmentation in Dense Images},
  author = {Muhammad Ibraheem Siddiqui and Muhammad Umer Sheikh and Hassan Abid and Kevin Henry and Muhammad Haris Khan},
  journal= {arXiv preprint arXiv:2508.14660},
  year   = {2025}
}

Comments

arXiv admin note: text overlap with arXiv:2405.13518

R2 v1 2026-07-01T04:58:24.329Z