English

Multi-dimensional Fusion and Consistency for Semi-supervised Medical Image Segmentation

Computer Vision and Pattern Recognition 2023-12-19 v3 Tissues and Organs

Abstract

In this paper, we introduce a novel semi-supervised learning framework tailored for medical image segmentation. Central to our approach is the innovative Multi-scale Text-aware ViT-CNN Fusion scheme. This scheme adeptly combines the strengths of both ViTs and CNNs, capitalizing on the unique advantages of both architectures as well as the complementary information in vision-language modalities. Further enriching our framework, we propose the Multi-Axis Consistency framework for generating robust pseudo labels, thereby enhancing the semisupervised learning process. Our extensive experiments on several widelyused datasets unequivocally demonstrate the efficacy of our approach.

Keywords

Cite

@article{arxiv.2309.06618,
  title  = {Multi-dimensional Fusion and Consistency for Semi-supervised Medical Image Segmentation},
  author = {Yixing Lu and Zhaoxin Fan and Min Xu},
  journal= {arXiv preprint arXiv:2309.06618},
  year   = {2023}
}

Comments

Accepted by the 30th International Conference on MultiMedia Modeling

R2 v1 2026-06-28T12:19:49.758Z