English
Related papers

Related papers: Robust Divergence Learning for Missing-Modality Se…

200 papers

Accurate and automatic segmentation of brain tumors in multi-parametric magnetic resonance imaging (mpMRI) is essential for quantitative measurements, which play an increasingly important role in clinical diagnosis and prognosis. The…

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

Segmentation of structural and diffusion MRI (sMRI/dMRI) is usually performed independently in neuroimaging pipelines. However, some brain structures (e.g., globus pallidus, thalamus and its nuclei) can be extracted more accurately by…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Juan Eugenio Iglesias , Koen Van Leemput , Polina Golland , Anastasia Yendiki

In this work, we propose a multi-modal Convolutional Neural Network (CNN) approach for brain tumor segmentation. We investigate how to combine different modalities efficiently in the CNN framework.We adapt various fusion methods, which are…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mehmet Aygün , Yusuf Hüseyin Şahin , Gözde Ünal

Manual segmentation of medical images (e.g., segmenting tumors in CT scans) is a high-effort task that can be accelerated with machine learning techniques. However, selecting the right segmentation approach depends on the evaluation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Seyed M. R. Modaresi , Aomar Osmani , Mohammadreza Razzazi , Abdelghani Chibani

Accurate segmentation of brain tissue in magnetic resonance images (MRI) is a diffcult task due to different types of brain abnormalities. Using information and features from multimodal MRI including T1, T1-weighted inversion recovery…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Yongpei Zhu , Zicong Zhou , Guojun Liao , Qianxi Yang , Kehong Yuan

Magnetic resonance imaging (MRI) is a widely used neuroimaging technique that can provide images of different contrasts (i.e., modalities). Fusing this multi-modal data has proven particularly effective for boosting model performance in…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Tao Zhou , Huazhu Fu , Geng Chen , Jianbing Shen , Ling Shao

Multimodal networks have demonstrated remarkable performance improvements over their unimodal counterparts. Existing multimodal networks are designed in a multi-branch fashion that, due to the reliance on fusion strategies, exhibit…

Existing brain tumor segmentation methods usually utilize multiple Magnetic Resonance Imaging (MRI) modalities in brain tumor images for segmentation, which can achieve better segmentation performance. However, in clinical applications,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Ming Kang , Fung Fung Ting , Shier Nee Saw , Raphaël C. -W. Phan , Zongyuan Ge , Chee-Ming Ting

Brain Tumor Segmentation (BraTS) plays a critical role in clinical diagnosis, treatment planning, and monitoring the progression of brain tumors. However, due to the variability in tumor appearance, size, and intensity across different MRI…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Hongjun Zhu , Jiaohang Huang , Kuo Chen , Xuehui Ying , Ying Qian

Learning with multiple modalities is crucial for automated brain tumor segmentation from magnetic resonance imaging data. Explicitly optimizing the common information shared among all modalities (e.g., by maximizing the total correlation)…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Yongsheng Mei , Guru Venkataramani , Tian Lan

Brain tumor is one of the most high-risk cancers which causes the 5-year survival rate of only about 36%. Accurate diagnosis of brain tumor is critical for the treatment planning. However, complete data are not always available in clinical…

Image and Video Processing · Electrical Eng. & Systems 2021-05-28 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

In real-world clinical settings, magnetic resonance imaging (MRI) frequently suffers from missing modalities due to equipment variability or patient cooperation issues, which can significantly affect model performance. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Zhejia Zhang , Junjie Wang , Le Zhang

Multi-modal MR imaging is routinely used in clinical practice to diagnose and investigate brain tumors by providing rich complementary information. Previous multi-modal MRI segmentation methods usually perform modal fusion by concatenating…

Image and Video Processing · Electrical Eng. & Systems 2022-09-01 Zhaohu Xing , Lequan Yu , Liang Wan , Tong Han , Lei Zhu

Medical multi-modal learning is critical for integrating information from a large set of diverse modalities. However, when leveraging a high number of modalities in real clinical applications, it is often impractical to obtain full-modality…

Machine Learning · Computer Science 2026-03-03 Chenwei Wu , Zitao Shuai , Liyue Shen

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

Multimodal brain tumor segmentation challenge (BraTS) brings together researchers to improve automated methods for 3D MRI brain tumor segmentation. Tumor segmentation is one of the fundamental vision tasks necessary for diagnosis and…

Image and Video Processing · Electrical Eng. & Systems 2020-01-08 Andriy Myronenko , Ali Hatamizadeh

Multimodal Magnetic Resonance (MR) Imaging plays a crucial role in disease diagnosis due to its ability to provide complementary information by analyzing a relationship between multimodal images on the same subject. Acquiring all MR…

Image and Video Processing · Electrical Eng. & Systems 2024-02-02 Jihoon Cho , Xiaofeng Liu , Fangxu Xing , Jinsong Ouyang , Georges El Fakhri , Jinah Park , Jonghye Woo

Magnetic Resonance Imaging (MRI) is a principal diagnostic approach used in the field of radiology to create images of the anatomical and physiological structure of patients. MRI is the prevalent medical imaging practice to find…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Yusuf Brima , Mossadek Hossain Kamal Tushar , Upama Kabir , Tariqul Islam

Multi-modality imaging is widely used in clinical practice and biomedical research to gain a comprehensive understanding of an imaging subject. Currently, multi-modality imaging is accomplished by post hoc fusion of independently…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Lingting Zhu , Yizheng Chen , Lianli Liu , Lei Xing , Lequan Yu