English

Supervise Less, See More: Training-free Nuclear Instance Segmentation with Prototype-Guided Prompting

Computer Vision and Pattern Recognition 2026-05-19 v2

Abstract

Accurate nuclear instance segmentation is a pivotal task in computational pathology, supporting data-driven clinical insights and facilitating downstream translational applications. While large vision foundation models have shown promise for zero-shot biomedical segmentation, most existing approaches still depend on dense supervision and computationally expensive fine-tuning. Consequently, training-free methods present a compelling research direction, yet remain largely unexplored. In this work, we introduce SPROUT, a fully training- and annotation-free prompting framework for nuclear instance segmentation. SPROUT leverages histology-informed priors to construct slide-specific reference prototypes that mitigate domain gaps. These prototypes progressively guide feature alignment through a partial optimal transport scheme. The resulting foreground and background features are transformed into positive and negative point prompts, enabling the Segment Anything Model (SAM) to produce precise nuclear delineations without any parameter updates. Extensive experiments across multiple histopathology benchmarks demonstrate that SPROUT achieves competitive performance without supervision or retraining, establishing a novel paradigm for scalable, training-free nuclear instance segmentation in pathology.

Keywords

Cite

@article{arxiv.2511.19953,
  title  = {Supervise Less, See More: Training-free Nuclear Instance Segmentation with Prototype-Guided Prompting},
  author = {Wen Zhang and Qin Ren and Wenjing Liu and Haibin Ling and Chenyu You},
  journal= {arXiv preprint arXiv:2511.19953},
  year   = {2026}
}

Comments

ICML 2026; 44 pages, 25 figures, 26 tables; Code at https://github.com/Y-Research-SBU/SPROUT

R2 v1 2026-07-01T07:53:37.783Z