English
Related papers

Related papers: Semantic-guided Masked Mutual Learning for Multi-m…

200 papers

Multi-modal image segmentation faces real-world deployment challenges from incomplete/corrupted modalities degrading performance. While existing methods address training-inference modality gaps via specialized per-combination models, they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Xiaoqi Zhao , Youwei Pang , Chenyang Yu , Lihe Zhang , Huchuan Lu , Shijian Lu , Georges El Fakhri , Xiaofeng Liu

Brain tumor segmentation based on multi-modal magnetic resonance imaging (MRI) plays a pivotal role in assisting brain cancer diagnosis, treatment, and postoperative evaluations. Despite the achieved inspiring performance by existing…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Haoran Li , Cheng Li , Weijian Huang , Xiawu Zheng , Yan Xi , Shanshan Wang

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Using multiple spatial modalities has been proven helpful in improving semantic segmentation performance. However, there are several real-world challenges that have yet to be addressed: (a) improving label efficiency and (b) enhancing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Harsh Maheshwari , Yen-Cheng Liu , Zsolt Kira

The missing modality issue is critical but non-trivial to be solved by multi-modal models. Current methods aiming to handle the missing modality problem in multi-modal tasks, either deal with missing modalities only during evaluation or…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Hu Wang , Yuanhong Chen , Congbo Ma , Jodie Avery , Louise Hull , Gustavo Carneiro

Semi-supervised learning has become increasingly popular in medical image segmentation due to its ability to leverage large amounts of unlabeled data to extract additional information. However, most existing semi-supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Shengbo Gao , Ziji Zhang , Jiechao Ma , Zihao Li , Shu Zhang

Accurate brain tumor segmentation from Magnetic Resonance Imaging (MRI) is desirable to joint learning of multimodal images. However, in clinical practice, it is not always possible to acquire a complete set of MRIs, and the problem of…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yao Zhang , Nanjun He , Jiawei Yang , Yuexiang Li , Dong Wei , Yawen Huang , Yang Zhang , Zhiqiang He , Yefeng Zheng

Deep learning (DL) models for segmenting various anatomical structures have achieved great success via a static DL model that is trained in a single source domain. Yet, the static DL model is likely to perform poorly in a continually…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Xiaofeng Liu , Helen A. Shih , Fangxu Xing , Emiliano Santarnecchi , Georges El Fakhri , Jonghye Woo

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Accurate and reliable brain tumor segmentation, particularly when dealing with missing modalities, remains a critical challenge in medical image analysis. Previous studies have not fully resolved the challenges of tumor boundary…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shenghao Zhu , Yifei Chen , Weihong Chen , Yuanhan Wang , Chang Liu , Shuo Jiang , Feiwei Qin , Changmiao Wang

Combining images from multi-modalities is beneficial to explore various information in computer vision, especially in the medical domain. As an essential part of clinical diagnosis, multi-modal brain tumor segmentation aims to delineate the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhongzhen Huang , Linda Wei , Shaoting Zhang , Xiaofan Zhang

The success of deep learning methods in medical image segmentation tasks usually requires a large amount of labeled data. However, obtaining reliable annotations is expensive and time-consuming. Semi-supervised learning has attracted much…

Image and Video Processing · Electrical Eng. & Systems 2021-07-13 Yichi Zhang , Jicong Zhang

A large labeled dataset is a key to the success of supervised deep learning, but for medical image segmentation, it is highly challenging to obtain sufficient annotated images for model training. In many scenarios, unannotated images are…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Hao Zheng , Jun Han , Hongxiao Wang , Lin Yang , Zhuo Zhao , Chaoli Wang , Danny Z. Chen

Brain tissue segmentation from multimodal MRI is a key building block of many neuroscience analysis pipelines. It could also play an important role in many clinical imaging scenarios. Established tissue segmentation approaches have however…

Image and Video Processing · Electrical Eng. & Systems 2020-04-15 Reuben Dorent , Wenqi Li , Jinendra Ekanayake , Sebastien Ourselin , Tom Vercauteren

The segmentation of substantial brain lesions is a significant and challenging task in the field of medical image segmentation. Substantial brain lesions in brain imaging exhibit high heterogeneity, with indistinct boundaries between lesion…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Hongming Wang , Yifeng Wu , Huimin Huang , Hongtao Wu , Jia-Xuan Jiang , Xiaodong Zhang , Hao Zheng , Xian Wu , Yefeng Zheng , Jinping Xu , Jing Cheng

Multimodal remote sensing data provide complementary information for semantic segmentation, but in real-world deployments, some modalities may be unavailable due to sensor failures, acquisition issues, or challenging atmospheric conditions.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Irem Ulku , Erdem Akagündüz , Ömer Özgür Tanrıöver

Magnetic resonance imaging (MRI) image segmentation is crucial in diagnosing and treating many diseases, such as brain tumors. Existing MRI image segmentation methods mainly fall into a centralized multimodal paradigm, which is inapplicable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Guyue Hu , Siyuan Song , Jingpeng Sun , Zhe Jin , Chenglong Li , Jin Tang

Multimodal learning seeks to combine data from multiple input sources to enhance the performance of different downstream tasks. In real-world scenarios, performance can degrade substantially if some input modalities are missing. Existing…

Machine Learning · Computer Science 2024-10-10 Niki Nezakati , Md Kaykobad Reza , Ameya Patil , Mashhour Solh , M. Salman Asif

Brain tumor is one of the most high-risk cancers which causes the 5-year survival rate of only about 36%. Accurate diagnosis of brain tumor is critical for the treatment planning. However, complete data are not always available in clinical…

Image and Video Processing · Electrical Eng. & Systems 2021-05-28 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Traditional brain lesion segmentation models for multi-modal MRI are typically tailored to specific pathologies, relying on datasets with predefined modalities. Adapting to new MRI modalities or pathologies often requires training separate…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Yousef Sadegheih , Pratibha Kumari , Dorit Merhof