English

Random Style Transfer based Domain Generalization Networks Integrating Shape and Spatial Information

Computer Vision and Pattern Recognition 2020-09-04 v2 Image and Video Processing

Abstract

Deep learning (DL)-based models have demonstrated good performance in medical image segmentation. However, the models trained on a known dataset often fail when performed on an unseen dataset collected from different centers, vendors and disease populations. In this work, we present a random style transfer network to tackle the domain generalization problem for multi-vendor and center cardiac image segmentation. Style transfer is used to generate training data with a wider distribution/ heterogeneity, namely domain augmentation. As the target domain could be unknown, we randomly generate a modality vector for the target modality in the style transfer stage, to simulate the domain shift for unknown domains. The model can be trained in a semi-supervised manner by simultaneously optimizing a supervised segmentation and an unsupervised style translation objective. Besides, the framework incorporates the spatial information and shape prior of the target by introducing two regularization terms. We evaluated the proposed framework on 40 subjects from the M\&Ms challenge2020, and obtained promising performance in the segmentation for data from unknown vendors and centers.

Keywords

Cite

@article{arxiv.2008.12205,
  title  = {Random Style Transfer based Domain Generalization Networks Integrating Shape and Spatial Information},
  author = {Lei Li and Veronika A. Zimmer and Wangbin Ding and Fuping Wu and Liqin Huang and Julia A. Schnabel and Xiahai Zhuang},
  journal= {arXiv preprint arXiv:2008.12205},
  year   = {2020}
}

Comments

11 pages

R2 v1 2026-06-23T18:08:44.427Z