English

Does an ensemble of GANs lead to better performance when training segmentation networks with synthetic images?

Computer Vision and Pattern Recognition 2023-03-14 v2 Image and Video Processing

Abstract

Large annotated datasets are required to train segmentation networks. In medical imaging, it is often difficult, time consuming and expensive to create such datasets, and it may also be difficult to share these datasets with other researchers. Different AI models can today generate very realistic synthetic images, which can potentially be openly shared as they do not belong to specific persons. However, recent work has shown that using synthetic images for training deep networks often leads to worse performance compared to using real images. Here we demonstrate that using synthetic images and annotations from an ensemble of 20 GANs, instead of from a single GAN, increases the Dice score on real test images with 4.7 % to 14.0 % on specific classes.

Keywords

Cite

@article{arxiv.2211.04086,
  title  = {Does an ensemble of GANs lead to better performance when training segmentation networks with synthetic images?},
  author = {Måns Larsson and Muhammad Usman Akbar and Anders Eklund},
  journal= {arXiv preprint arXiv:2211.04086},
  year   = {2023}
}

Comments

5 pages, submitted to ISBI 2023