English

Unveiling Incomplete Modality Brain Tumor Segmentation: Leveraging Masked Predicted Auto-Encoder and Divergence Learning

Image and Video Processing 2024-06-14 v1 Computer Vision and Pattern Recognition Machine Learning

Abstract

Brain tumor segmentation remains a significant challenge, particularly in the context of multi-modal magnetic resonance imaging (MRI) where missing modality images are common in clinical settings, leading to reduced segmentation accuracy. To address this issue, we propose a novel strategy, which is called masked predicted pre-training, enabling robust feature learning from incomplete modality data. Additionally, in the fine-tuning phase, we utilize a knowledge distillation technique to align features between complete and missing modality data, simultaneously enhancing model robustness. Notably, we leverage the Holder pseudo-divergence instead of the KLD for distillation loss, offering improve mathematical interpretability and properties. Extensive experiments on the BRATS2018 and BRATS2020 datasets demonstrate significant performance enhancements compared to existing state-of-the-art methods.

Keywords

Cite

@article{arxiv.2406.08634,
  title  = {Unveiling Incomplete Modality Brain Tumor Segmentation: Leveraging Masked Predicted Auto-Encoder and Divergence Learning},
  author = {Zhongao Sun and Jiameng Li and Yuhan Wang and Jiarong Cheng and Qing Zhou and Chun Li},
  journal= {arXiv preprint arXiv:2406.08634},
  year   = {2024}
}
R2 v1 2026-06-28T17:03:47.056Z