English
Related papers

Related papers: Robust Semi-supervised Multimodal Medical Image Se…

200 papers

Recently, machine learning-based semantic segmentation algorithms have demonstrated their potential to accurately segment regions and contours in medical images, allowing the precise location of anatomical structures and abnormalities.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yifei Wang , Chuhong Zhu

In this paper, we propose a novel mutual consistency network (MC-Net+) to effectively exploit the unlabeled data for semi-supervised medical image segmentation. The MC-Net+ model is motivated by the observation that deep models trained with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yicheng Wu , Zongyuan Ge , Donghao Zhang , Minfeng Xu , Lei Zhang , Yong Xia , Jianfei Cai

Multimodal semantic segmentation enhances model robustness by exploiting cross-modal complementarities. However, existing methods often suffer from imbalanced modal dependencies, where overall performance degrades significantly once a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Jiaqi Tan , Xu Zheng , Fangyu Li , Yang Liu

Malignant brain tumors have become an aggressive and dangerous disease that leads to death worldwide.Multi-modal MRI data is crucial for accurate brain tumor segmentation, but missing modalities common in clinical practice can severely…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Bingcang Huang , Kai Chen , Lin Gu , Zhe Wang , Sai Wu , Chang Yao

Multi-modal learning is typically performed with network architectures containing modality-specific layers and shared layers, utilizing co-registered images of different modalities. We propose a novel learning scheme for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Qi Dou , Quande Liu , Pheng Ann Heng , Ben Glocker

The limited availability of annotated data in medical imaging makes semi-supervised learning increasingly appealing for its ability to learn from imperfect supervision. Recently, teacher-student frameworks have gained popularity for their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Thanh-Huy Nguyen , Hoang-Thien Nguyen , Vi Vu , Ba-Thinh Lam , Phat Huynh , Tianyang Wang , Xingjian Li , Ulas Bagci , Min Xu

Unpaired Multi-Modal Learning (UMML) which leverages unpaired multi-modal data to boost model performance on each individual modality has attracted a lot of research interests in medical image analysis. However, existing UMML methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Lei Zhu , Yanyu Xu , Huazhu Fu , Xinxing Xu , Rick Siow Mong Goh , Yong Liu

Partially-supervised learning can be challenging for segmentation due to the lack of supervision for unlabeled structures, and the methods directly applying fully-supervised learning could lead to incompatibility, meaning ground truth is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ke Zhang , Xiahai Zhuang

Accurate prediction of cardiovascular diseases remains imperative for early diagnosis and intervention, necessitating robust and precise predictive models. Recently, there has been a growing interest in multi-modal learning for uncovering…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Francesco Girlanda , Olga Demler , Bjoern Menze , Neda Davoudi

Learning to reliably perceive and understand the scene is an integral enabler for robots to operate in the real-world. This problem is inherently challenging due to the multitude of object types as well as appearance changes caused by…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Abhinav Valada , Rohit Mohan , Wolfram Burgard

Multimodal learning, which aims to understand and analyze information from multiple modalities, has achieved substantial progress in the supervised regime in recent years. However, the heavy dependence on data paired with expensive human…

Machine Learning · Computer Science 2024-08-19 Yongshuo Zong , Oisin Mac Aodha , Timothy Hospedales

Semi-supervised 3D medical image segmentation aims to achieve accurate segmentation using few labelled data and numerous unlabelled data. The main challenge in the design of semi-supervised learning methods consists in the effective use of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yanyan Wang , Kechen Song , Yuyuan Liu , Shuai Ma , Yunhui Yan , Gustavo Carneiro

Deep learning-based computer-aided diagnosis is gradually deployed to review and analyze medical images. However, this paradigm is restricted in real-world clinical applications due to the poor robustness and generalization. The issue is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yurong Chen

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Radiologists must utilize multiple modal images for tumor segmentation and diagnosis due to the limitations of medical imaging and the diversity of tumor signals. This leads to the development of multimodal learning in segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Chuyun Shen , Wenhao Li , Haoqing Chen , Xiaoling Wang , Fengping Zhu , Yuxin Li , Xiangfeng Wang , Bo Jin

Obtaining pixel-level annotations in the medical domain is both expensive and time-consuming, often requiring close collaboration between clinical experts and developers. Semi-supervised medical image segmentation aims to leverage limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Lin Xi , Yingliang Ma , Cheng Wang , Sandra Howell , Aldo Rinaldi , Kawal S. Rhode

Semi-supervised learning relaxes the need of large pixel-wise labeled datasets for image segmentation by leveraging unlabeled data. A prominent way to exploit unlabeled data is to regularize model predictions. Since the predictions of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Sukesh Adiga , Jose Dolz , Herve Lombaert

Semi-supervised learning has gained considerable popularity in medical image segmentation tasks due to its capability to reduce reliance on expert-examined annotations. Several mean-teacher (MT) based semi-supervised methods utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Kaiwen Huang , Tao Zhou , Huazhu Fu , Yizhe Zhang , Yi Zhou , Xiao-Jun Wu

Multimodal representation learning has demonstrated remarkable potential in enabling models to process and integrate diverse data modalities, such as text and images, for improved understanding and performance. While the medical domain can…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Shuvendu Roy , Franklin Ogidi , Ali Etemad , Elham Dolatabadi , Arash Afkanpour

Medical image segmentation typically demands extensive dense annotations for model training, which is both time-consuming and skill-intensive. To mitigate this burden, exemplar-based medical image segmentation methods have been introduced…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Qing En , Yuhong Guo