The automated analysis of medical images is currently limited by technical and biological noise and bias. The same source tissue can be represented by vastly different images if the image acquisition or processing protocols vary. For an image analysis pipeline, it is crucial to compensate such biases to avoid misinterpretations. Here, we evaluate, compare, and improve existing generative model architectures to overcome domain shifts for immunofluorescence (IF) and Hematoxylin and Eosin (H&E) stained microscopy images. To determine the performance of the generative models, the original and transformed images were segmented or classified by deep neural networks that were trained only on images of the target bias. In the scope of our analysis, U-Net cycleGANs trained with an additional identity and an MS-SSIM-based loss and Fixed-Point GANs trained with an additional structure loss led to the best results for the IF and H&E stained samples, respectively. Adapting the bias of the samples significantly improved the pixel-level segmentation for human kidney glomeruli and podocytes and improved the classification accuracy for human prostate biopsies by up to 14%.
@article{arxiv.2105.11765,
title = {Deep learning-based bias transfer for overcoming laboratory differences of microscopic images},
author = {Ann-Katrin Thebille and Esther Dietrich and Martin Klaus and Lukas Gernhold and Maximilian Lennartz and Christoph Kuppe and Rafael Kramann and Tobias B. Huber and Guido Sauter and Victor G. Puelles and Marina Zimmermann and Stefan Bonn},
journal= {arXiv preprint arXiv:2105.11765},
year = {2021}
}
Comments
Accepted as a regular conference paper at MIUA 2021