English

Segmentation Style Discovery: Application to Skin Lesion Images

Computer Vision and Pattern Recognition 2024-08-07 v1

Abstract

Variability in medical image segmentation, arising from annotator preferences, expertise, and their choice of tools, has been well documented. While the majority of multi-annotator segmentation approaches focus on modeling annotator-specific preferences, they require annotator-segmentation correspondence. In this work, we introduce the problem of segmentation style discovery, and propose StyleSeg, a segmentation method that learns plausible, diverse, and semantically consistent segmentation styles from a corpus of image-mask pairs without any knowledge of annotator correspondence. StyleSeg consistently outperforms competing methods on four publicly available skin lesion segmentation (SLS) datasets. We also curate ISIC-MultiAnnot, the largest multi-annotator SLS dataset with annotator correspondence, and our results show a strong alignment, using our newly proposed measure AS2, between the predicted styles and annotator preferences. The code and the dataset are available at https://github.com/sfu-mial/StyleSeg.

Keywords

Cite

@article{arxiv.2408.02787,
  title  = {Segmentation Style Discovery: Application to Skin Lesion Images},
  author = {Kumar Abhishek and Jeremy Kawahara and Ghassan Hamarneh},
  journal= {arXiv preprint arXiv:2408.02787},
  year   = {2024}
}

Comments

Medical Image Computing and Computer-Assisted Intervention (MICCAI) ISIC Skin Image Analysis Workshop (MICCAI ISIC) 2024; 13 pages, 2 tables, 3 figures

R2 v1 2026-06-28T18:04:44.370Z