English
Related papers

Related papers: M3AE: Multimodal Representation Learning for Brain…

200 papers

Accurate medical image segmentation commonly requires effective learning of the complementary information from multimodal data. However, in clinical practice, we often encounter the problem of missing imaging modalities. We tackle this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Cheng Chen , Qi Dou , Yueming Jin , Hao Chen , Jing Qin , Pheng-Ann Heng

Learning a robust Variational Autoencoder (VAE) is a fundamental step for many deep learning applications in medical image analysis, such as MRI synthesizes. Existing brain VAEs predominantly focus on single-modality data (i.e., T1-weighted…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Mingjie Li , Edward Kim , Yue Zhao , Ehsan Adeli , Kilian M. Pohl

In medical vision, different imaging modalities provide complementary information. However, in practice, not all modalities may be available during inference or even training. Previous approaches, e.g., knowledge distillation or image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Aishik Konwer , Xiaoling Hu , Joseph Bae , Xuan Xu , Chao Chen , Prateek Prasanna

Unsupervised anomaly detection (UAD) presents a complementary alternative to supervised learning for brain tumor segmentation in magnetic resonance imaging (MRI), particularly when annotated datasets are limited, costly, or inconsistent. In…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Gerard Comas-Quiles , Carles Garcia-Cabrera , Julia Dietlmeier , Noel E. O'Connor , Ferran Marques

Malignant brain tumors have become an aggressive and dangerous disease that leads to death worldwide.Multi-modal MRI data is crucial for accurate brain tumor segmentation, but missing modalities common in clinical practice can severely…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Bingcang Huang , Kai Chen , Lin Gu , Zhe Wang , Sai Wu , Chang Yao

Brain tumor segmentation based on multi-modal magnetic resonance imaging (MRI) plays a pivotal role in assisting brain cancer diagnosis, treatment, and postoperative evaluations. Despite the achieved inspiring performance by existing…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Haoran Li , Cheng Li , Weijian Huang , Xiawu Zheng , Yan Xi , Shanshan Wang

Medical vision-and-language pre-training provides a feasible solution to extract effective vision-and-language representations from medical images and texts. However, few studies have been dedicated to this field to facilitate medical…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Zhihong Chen , Yuhao Du , Jinpeng Hu , Yang Liu , Guanbin Li , Xiang Wan , Tsung-Hui Chang

Accurate brain tumor segmentation is essential for preoperative evaluation and personalized treatment. Multi-modal MRI is widely used due to its ability to capture complementary tumor features across different sequences. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Shenghao Zhu , Yifei Chen , Weihong Chen , Shuo Jiang , Guanyu Zhou , Yuanhan Wang , Feiwei Qin , Changmiao Wang , Qiyuan Tian

Gliomas are one of the most prevalent types of primary brain tumours, accounting for more than 30\% of all cases and they develop from the glial stem or progenitor cells. In theory, the majority of brain tumours could well be identified…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Reza Azad , Nika Khosravi , Dorit Merhof

Semantic segmentation of brain tumours is a fundamental task in medical image analysis that can help clinicians in diagnosing the patient and tracking the progression of any malignant entities. Accurate segmentation of brain lesions is…

Image and Video Processing · Electrical Eng. & Systems 2023-08-29 Aditya Kasliwal , Sankarshanaa Sagaram , Laven Srivastava , Pratinav Seth , Adil Khan

Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly. Accurate identification of the type and grade of tumor in the early stages plays an important role in choosing a precise…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Dunyuan Xu , Xi Wang , Jinyue Cai , Pheng-Ann Heng

The accurate segmentation of brain tumors from multi-modal MRI is critical for clinical diagnosis and treatment planning. While integrating complementary information from various MRI sequences is a common practice, the frequent absence of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Dongqing Xie , Yonghuang Wu , Zisheng Ai , Jun Min , Zhencun Jiang , Shaojin Geng , Lei Wang

Accurate segmentation of brain tumors from magnetic resonance imaging (MRI) is clinically relevant in diagnoses, prognoses and surgery treatment, which requires multiple modalities to provide complementary morphological and physiopathologic…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Yixin Wang , Yang Zhang , Yang Liu , Zihao Lin , Jiang Tian , Cheng Zhong , Zhongchao Shi , Jianping Fan , Zhiqiang He

Multimodal self-supervised pretraining offers a promising route to cancer prognosis by integrating histopathology whole-slide images, gene expression, and pathology reports, yet most existing approaches require fully paired and complete…

Machine Learning · Computer Science 2026-04-08 Kai Yu , Shuang Zhou , Yiran Song , Zaifu Zhan , Jie Peng , Kaixiong Zhou , Tianlong Chen , Feng Xie , Meng Wang , Huazhu Fu , Mingquan Lin , Rui Zhang

Automated segmentation of brain tumors from 3D magnetic resonance images (MRIs) is necessary for the diagnosis, monitoring, and treatment planning of the disease. Manual delineation practices require anatomical knowledge, are expensive,…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Andriy Myronenko

Multi-modal magnetic resonance (MR) imaging provides great potential for diagnosing and analyzing brain gliomas. In clinical scenarios, common MR sequences such as T1, T2 and FLAIR can be obtained simultaneously in a single scanning…

Image and Video Processing · Electrical Eng. & Systems 2022-03-10 Ziqi Huang , Li Lin , Pujin Cheng , Linkai Peng , Xiaoying Tang

Automatic brain tumor segmentation from multi-modality Magnetic Resonance Images (MRI) using deep learning methods plays an important role in assisting the diagnosis and treatment of brain tumor. However, previous methods mostly ignore the…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Yixin Wang , Yao Zhang , Feng Hou , Yang Liu , Jiang Tian , Cheng Zhong , Yang Zhang , Zhiqiang He

Leveraging multimodal information from Magnetic Resonance Imaging (MRI) plays a vital role in lesion segmentation, especially for brain tumors. However, in clinical practice, multimodal MRI data are often incomplete, making it challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yulong Zou , Bo Liu , Cun-Jing Zheng , Yuan-ming Geng , Siyue Li , Qiankun Zuo , Shuihua Wang , Yudong Zhang , Jin Hong

This technical report presents a comparative analysis of existing deep learning (DL) based approaches for brain tumor segmentation with missing MRI modalities. Approaches evaluated include the Adversarial Co-training Network (ACN) and a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Benteng Ma , Yushi Wang , Shen Wang

The use of diverse modalities, such as omics, medical images, and clinical data can not only improve the performance of prognostic models but also deepen an understanding of disease mechanisms and facilitate the development of novel…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Maria Boyko , Aleksandra Beliaeva , Dmitriy Kornilov , Alexander Bernstein , Maxim Sharaev