English

Auxiliary CycleGAN-guidance for Task-Aware Domain Translation from Duplex to Monoplex IHC Images

Computer Vision and Pattern Recognition 2024-10-23 v2 Artificial Intelligence Image and Video Processing

Abstract

Generative models enable the translation from a source image domain where readily trained models are available to a target domain unseen during training. While Cycle Generative Adversarial Networks (GANs) are well established, the associated cycle consistency constrain relies on that an invertible mapping exists between the two domains. This is, however, not the case for the translation between images stained with chromogenic monoplex and duplex immunohistochemistry (IHC) assays. Focusing on the translation from the latter to the first, we propose - through the introduction of a novel training design, an alternative constrain leveraging a set of immunofluorescence (IF) images as an auxiliary unpaired image domain. Quantitative and qualitative results on a downstream segmentation task show the benefit of the proposed method in comparison to baseline approaches.

Keywords

Cite

@article{arxiv.2403.07389,
  title  = {Auxiliary CycleGAN-guidance for Task-Aware Domain Translation from Duplex to Monoplex IHC Images},
  author = {Nicolas Brieu and Nicolas Triltsch and Philipp Wortmann and Dominik Winter and Shashank Saran and Marlon Rebelatto and Günter Schmidt},
  journal= {arXiv preprint arXiv:2403.07389},
  year   = {2024}
}

Comments

5 pages