English

Attention-Guided Generative Adversarial Network to Address Atypical Anatomy in Modality Transfer

Image and Video Processing 2021-04-16 v3 Computer Vision and Pattern Recognition

Abstract

Recently, interest in MR-only treatment planning using synthetic CTs (synCTs) has grown rapidly in radiation therapy. However, developing class solutions for medical images that contain atypical anatomy remains a major limitation. In this paper, we propose a novel spatial attention-guided generative adversarial network (attention-GAN) model to generate accurate synCTs using T1-weighted MRI images as the input to address atypical anatomy. Experimental results on fifteen brain cancer patients show that attention-GAN outperformed existing synCT models and achieved an average MAE of 85.22±\pm12.08, 232.41±\pm60.86, 246.38±\pm42.67 Hounsfield units between synCT and CT-SIM across the entire head, bone and air regions, respectively. Qualitative analysis shows that attention-GAN has the ability to use spatially focused areas to better handle outliers, areas with complex anatomy or post-surgical regions, and thus offer strong potential for supporting near real-time MR-only treatment planning.

Keywords

Cite

@article{arxiv.2006.15264,
  title  = {Attention-Guided Generative Adversarial Network to Address Atypical Anatomy in Modality Transfer},
  author = {Hajar Emami and Ming Dong and Carri K. Glide-Hurst},
  journal= {arXiv preprint arXiv:2006.15264},
  year   = {2021}
}

Comments

IEEE 21st International Conference on Information Reuse and Integration for Data Science