English

Effect of latent space distribution on the segmentation of images with multiple annotations

Computer Vision and Pattern Recognition 2023-07-03 v1 Machine Learning Image and Video Processing

Abstract

We propose the Generalized Probabilistic U-Net, which extends the Probabilistic U-Net by allowing more general forms of the Gaussian distribution as the latent space distribution that can better approximate the uncertainty in the reference segmentations. We study the effect the choice of latent space distribution has on capturing the variation in the reference segmentations for lung tumors and white matter hyperintensities in the brain. We show that the choice of distribution affects the sample diversity of the predictions and their overlap with respect to the reference segmentations. We have made our implementation available at https://github.com/ishaanb92/GeneralizedProbabilisticUNet

Keywords

Cite

@article{arxiv.2304.13476,
  title  = {Effect of latent space distribution on the segmentation of images with multiple annotations},
  author = {Ishaan Bhat and Josien P. W. Pluim and Max A. Viergever and Hugo J. Kuijf},
  journal= {arXiv preprint arXiv:2304.13476},
  year   = {2023}
}

Comments

Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://melba-journal.org/2023:005. arXiv admin note: text overlap with arXiv:2207.12872