English
Related papers

Related papers: M3AE: Multimodal Representation Learning for Brain…

200 papers

Addressing missing modalities presents a critical challenge in multimodal learning. Current approaches focus on developing models that can handle modality-incomplete inputs during inference, assuming that the full set of modalities are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yunpeng Zhao , Cheng Chen , Qing You Pang , Quanzheng Li , Carol Tang , Beng-Ti Ang , Yueming Jin

Brain tumors, particularly glioblastoma, continue to challenge medical diagnostics and treatments globally. This paper explores the application of deep learning to multi-modality magnetic resonance imaging (MRI) data for enhanced brain…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Chiranjeewee Prasad Koirala , Sovesh Mohapatra , Advait Gosai , Gottfried Schlaug

We present InfoVAE-Med3D, a latent-representation learning approach for 3D brain MRI that targets interpretable biomarkers of cognitive decline. Standard statistical models and shallow machine learning often lack power, while most deep…

Existing brain tumor segmentation methods usually utilize multiple Magnetic Resonance Imaging (MRI) modalities in brain tumor images for segmentation, which can achieve better segmentation performance. However, in clinical applications,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Ming Kang , Fung Fung Ting , Shier Nee Saw , Raphaël C. -W. Phan , Zongyuan Ge , Chee-Ming Ting

Manual segmentation of medical images (e.g., segmenting tumors in CT scans) is a high-effort task that can be accelerated with machine learning techniques. However, selecting the right segmentation approach depends on the evaluation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Seyed M. R. Modaresi , Aomar Osmani , Mohammadreza Razzazi , Abdelghani Chibani

Combining images from multi-modalities is beneficial to explore various information in computer vision, especially in the medical domain. As an essential part of clinical diagnosis, multi-modal brain tumor segmentation aims to delineate the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhongzhen Huang , Linda Wei , Shaoting Zhang , Xiaofan Zhang

For multi-modal magnetic resonance (MR) brain tumor image segmentation, current methods usually directly extract the discriminative features from input images for tumor sub-region category determination and localization. However, the impact…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Yafei Zhang , Zhiyuan Li , Huafeng Li , Dapeng Tao

Accurate brain tumor segmentation from multi-modal magnetic resonance imaging (MRI) is a prerequisite for precise radiotherapy planning and surgical navigation. While recent Transformer-based models such as Swin UNETR have achieved…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yan Zhou , Zhen Huang , Yingqiu Li , Yue Ouyang , Suncheng Xiang , Zehua Wang

Multimodal 3D MRI brain tumor segmentation is a pivotal step in radiotherapy target delineation, surgical planning and post-treatment assessment. Existing methods often assume artifact-free MRI images. However, inevitable patient motion…

Image and Video Processing · Electrical Eng. & Systems 2026-05-18 Yuchun Wang , Xiaosong Li , Gefei Liang , Yang Liu

We present a cross-modality generation framework that learns to generate translated modalities from given modalities in MR images without real acquisition. Our proposed method performs NeuroImage-to-NeuroImage translation (abbreviated as…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Qianye Yang , Nannan Li , Zixu Zhao , Xingyu Fan , Eric I-Chao Chang , Yan Xu

Brain metastasis segmentation poses a significant challenge in medical imaging due to the complex presentation and variability in size and location of metastases. In this study, we first investigate the impact of different imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-07-22 Yousef Sadegheih , Dorit Merhof

Accurate segmentation of brain tumors plays a key role in the diagnosis and treatment of brain tumor diseases. It serves as a critical technology for quantifying tumors and extracting their features. With the increasing application of deep…

Image and Video Processing · Electrical Eng. & Systems 2024-11-05 Longfeng Shen , Yanqi Hou , Jiacong Chen , Liangjin Diao , Yaxi Duan

Multi-modal MR imaging is routinely used in clinical practice to diagnose and investigate brain tumors by providing rich complementary information. Previous multi-modal MRI segmentation methods usually perform modal fusion by concatenating…

Image and Video Processing · Electrical Eng. & Systems 2022-09-01 Zhaohu Xing , Lequan Yu , Liang Wan , Tong Han , Lei Zhu

Multimodal brain tumor segmentation challenge (BraTS) brings together researchers to improve automated methods for 3D MRI brain tumor segmentation. Tumor segmentation is one of the fundamental vision tasks necessary for diagnosis and…

Image and Video Processing · Electrical Eng. & Systems 2020-01-08 Andriy Myronenko , Ali Hatamizadeh

Liver cancer is one of the most common cancers worldwide. Due to inconspicuous texture changes of liver tumor, contrast-enhanced computed tomography (CT) imaging is effective for the diagnosis of liver cancer. In this paper, we focus on…

Image and Video Processing · Electrical Eng. & Systems 2021-07-22 Yao Zhang , Jiawei Yang , Jiang Tian , Zhongchao Shi , Cheng Zhong , Yang Zhang , Zhiqiang He

Background: Brain tumor segmentation has a significant impact on the diagnosis and treatment of brain tumors. Accurate brain tumor segmentation remains challenging due to their irregular shapes, vague boundaries, and high variability.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Zhanyuan Jia , Ni Yao , Danyang Sun , Chuang Han , Yanting Li , Jiaofen Nan , Fubao Zhu , Chen Zhao , Weihua Zhou

This paper presents the second-placed solution for task 8 and the participation solution for task 7 of BraTS 2024. The adoption of automated brain analysis algorithms to support clinical practice is increasing. However, many of these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 André Ferreira , Gijs Luijten , Behrus Puladi , Jens Kleesiek , Victor Alves , Jan Egger

Dealing with missing modalities in Magnetic Resonance Imaging (MRI) and overcoming their negative repercussions is considered a hurdle in biomedical imaging. The combination of a specified set of modalities, which is selected depending on…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Reza Azad , Nika Khosravi , Mohammad Dehghanmanshadi , Julien Cohen-Adad , Dorit Merhof

Brain tumor segmentation is a fundamental step in assessing a patient's cancer progression. However, manual segmentation demands significant expert time to identify tumors in 3D multimodal brain MRI scans accurately. This reliance on manual…

Image and Video Processing · Electrical Eng. & Systems 2024-05-07 Fadillah Maani , Anees Ur Rehman Hashmi , Numan Saeed , Mohammad Yaqub

Multi-modal MRIs are widely used in neuroimaging applications since different MR sequences provide complementary information about brain structures. Recent works have suggested that multi-modal deep learning analysis can benefit from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Jiahong Ouyang , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao , Greg Zaharchuk