English

Robust Divergence Learning for Missing-Modality Segmentation

Image and Video Processing 2024-11-14 v1 Computer Vision and Pattern Recognition

Abstract

Multimodal Magnetic Resonance Imaging (MRI) provides essential complementary information for analyzing brain tumor subregions. While methods using four common MRI modalities for automatic segmentation have shown success, they often face challenges with missing modalities due to image quality issues, inconsistent protocols, allergic reactions, or cost factors. Thus, developing a segmentation paradigm that handles missing modalities is clinically valuable. A novel single-modality parallel processing network framework based on H\"older divergence and mutual information is introduced. Each modality is independently input into a shared network backbone for parallel processing, preserving unique information. Additionally, a dynamic sharing framework is introduced that adjusts network parameters based on modality availability. A H\"older divergence and mutual information-based loss functions are used for evaluating discrepancies between predictions and labels. Extensive testing on the BraTS 2018 and BraTS 2020 datasets demonstrates that our method outperforms existing techniques in handling missing modalities and validates each component's effectiveness.

Keywords

Cite

@article{arxiv.2411.08305,
  title  = {Robust Divergence Learning for Missing-Modality Segmentation},
  author = {Runze Cheng and Zhongao Sun and Ye Zhang and Chun Li},
  journal= {arXiv preprint arXiv:2411.08305},
  year   = {2024}
}