English

Edge2Prompt: Modality-Agnostic Model for Out-of-Distribution Liver Segmentation

Image and Video Processing 2025-08-12 v3

Abstract

Liver segmentation is essential for preoperative planning in interventions like tumor resection or transplantation, but implementation in clinical workflows faces challenges due to modality-specific tools and data scarcity. We propose Edge2Prompt, a novel pipeline for modality-agnostic liver segmentation that generalizes to out-of-distribution (OOD) data. Our method integrates classical edge detection with foundation models. Modality-agnostic edge maps are first extracted from input images, then processed by a U-Net to generate logit-based prompts. These prompts condition the Segment Anything Model 2 (SAM-2) to generate 2D liver segmentations, which can then be reconstructed into 3D volumes. Evaluated on the multi-modal CHAOS dataset, Edge2Prompt achieves competitive results compared to classical segmentation methods when trained and tested in-distribution (ID), and outperforms them in data-scarce scenarios due to the SAM-2 module. Furthermore, it achieves a mean Dice Score of 86.4% on OOD tasks, outperforming U-Net baselines by 27.4% and other self-prompting methods by 9.1%, demonstrating its effectiveness. This work bridges classical and foundation models for clinically adaptable, data-efficient segmentation.

Keywords

Cite

@article{arxiv.2508.04305,
  title  = {Edge2Prompt: Modality-Agnostic Model for Out-of-Distribution Liver Segmentation},
  author = {Nathan Hollet and Oumeymah Cherkaoui and Philippe C. Cattin and Sidaty El Hadramy},
  journal= {arXiv preprint arXiv:2508.04305},
  year   = {2025}
}

Comments

8 pages, 3 figures, 3 tables