English
Related papers

Related papers: NestedFormer: Nested Modality-Aware Transformer fo…

200 papers

Medical segmentation has grown exponentially through the advent of a fully convolutional network (FCN), and we have now reached a turning point through the success of Transformer. However, the different characteristics of the modality have…

Image and Video Processing · Electrical Eng. & Systems 2023-11-03 Jihoon Cho , Jinah Park

Multimodal MRI provides critical complementary information for accurate brain tumor segmentation. However, conventional methods struggle when certain modalities are missing due to issues such as image quality, protocol inconsistencies,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Runze Cheng , Xihang Qiu , Ming Li , Ye Zhang , Chun Li , Fei Yu

Leveraging information across diverse modalities is known to enhance performance on multimodal segmentation tasks. However, effectively fusing information from different modalities remains challenging due to the unique characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Md Kaykobad Reza , Ashley Prater-Bennette , M. Salman Asif

Existing brain tumor segmentation methods usually utilize multiple Magnetic Resonance Imaging (MRI) modalities in brain tumor images for segmentation, which can achieve better segmentation performance. However, in clinical applications,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Ming Kang , Fung Fung Ting , Shier Nee Saw , Raphaël C. -W. Phan , Zongyuan Ge , Chee-Ming Ting

Multimodal Magnetic Resonance (MR) Imaging plays a crucial role in disease diagnosis due to its ability to provide complementary information by analyzing a relationship between multimodal images on the same subject. Acquiring all MR…

Image and Video Processing · Electrical Eng. & Systems 2024-02-02 Jihoon Cho , Xiaofeng Liu , Fangxu Xing , Jinsong Ouyang , Georges El Fakhri , Jinah Park , Jonghye Woo

Leveraging multimodal information from Magnetic Resonance Imaging (MRI) plays a vital role in lesion segmentation, especially for brain tumors. However, in clinical practice, multimodal MRI data are often incomplete, making it challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yulong Zou , Bo Liu , Cun-Jing Zheng , Yuan-ming Geng , Siyue Li , Qiankun Zuo , Shuihua Wang , Yudong Zhang , Jin Hong

Multimodal MRI offers complementary information for brain tumor segmentation, but clinical scans often lack one or more modalities, which degrades segmentation performance. In this paper, we propose UniME (Uni-Encoder Meets Multi-Encoders),…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Peibo Song , Xiaotian Xue , Jinshuo Zhang , Zihao Wang , Jinhua Liu , Shujun Fu , Fangxun Bao , Si Yong Yeo

Multi-modality is widely used in medical imaging, because it can provide multiinformation about a target (tumor, organ or tissue). Segmentation using multimodality consists of fusing multi-information to improve the segmentation. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-17 Tongxue Zhou , Su Ruan , Stéphane Canu

Using multimodal Magnetic Resonance Imaging (MRI) is necessary for accurate brain tumor segmentation. The main problem is that not all types of MRIs are always available in clinical exams. Based on the fact that there is a strong…

Image and Video Processing · Electrical Eng. & Systems 2021-11-11 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Multimodal MR images can provide complementary information for accurate brain tumor segmentation. However, it's common to have missing imaging modalities in clinical practice. Since there exists a strong correlation between multi…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

When diagnosing the brain tumor, doctors usually make a diagnosis by observing multimodal brain images from the axial view, the coronal view and the sagittal view, respectively. And then they make a comprehensive decision to confirm the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-22 Yi Ding , Wei Zheng , Guozheng Wu , Ji Geng , Mingsheng Cao , Zhiguang Qin

Multi-modal 3D medical image segmentation aims to accurately identify tumor regions across different modalities, facing challenges from variations in image intensity and tumor morphology. Traditional convolutional neural network (CNN)-based…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Zexin Ji , Beiji Zou , Xiaoyan Kui , Hua Li , Pierre Vera , Su Ruan

Magnetic Resonance Imaging (MRI) is a widely used imaging technique to assess brain tumor. Accurately segmenting brain tumor from MR images is the key to clinical diagnostics and treatment planning. In addition, multi-modal MR images can…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Most existing federated learning (FL) methods for medical image analysis only considered intramodal heterogeneity, limiting their applicability to multimodal imaging applications. In practice, it is not uncommon that some FL participants…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Qian Dai , Dong Wei , Hong Liu , Jinghan Sun , Liansheng Wang , Yefeng Zheng

Semantic segmentation of brain tumours is a fundamental task in medical image analysis that can help clinicians in diagnosing the patient and tracking the progression of any malignant entities. Accurate segmentation of brain lesions is…

Image and Video Processing · Electrical Eng. & Systems 2023-08-29 Aditya Kasliwal , Sankarshanaa Sagaram , Laven Srivastava , Pratinav Seth , Adil Khan

Multimodal magnetic resonance imaging (MRI) is crucial for brain tumor segmentation, with many methods leveraging its four key modalities to capture complementary information for effective sub-region analysis. However, the absence of…

Artificial Intelligence · Computer Science 2026-05-19 Sha Tao , Jiao Pan , Yu Guo , Chao Yao

This paper proposes a 3D attention-based U-Net architecture for multi-region segmentation of brain tumors using a single stacked multi-modal volume created by combining three non-native MRI volumes. The attention mechanism added to the…

Image and Video Processing · Electrical Eng. & Systems 2023-05-11 Maryann M. Gitonga

Multi-modal brain tumor segmentation is critical for clinical diagnosis, and it requires accurate identification of distinct internal anatomical subregions. While the recent prompt-based segmentation paradigms enable interactive experiences…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yuxiang Luo , Qing Xu , Hai Huang , Yuqi Ouyang , Zhen Chen , Wenting Duan

Most existing federated learning (FL) methods for medical image analysis only considered intramodal heterogeneity, limiting their applicability to multimodal imaging applications. In practice, some FL participants may possess only a subset…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hong Liu , Dong Wei , Qian Dai , Xian Wu , Yefeng Zheng , Liansheng Wang

Accelerated multi-modal magnetic resonance (MR) imaging is a new and effective solution for fast MR imaging, providing superior performance in restoring the target modality from its undersampled counterpart with guidance from an auxiliary…

Image and Video Processing · Electrical Eng. & Systems 2022-05-12 Chun-Mei Feng , Yunlu Yan , Geng Chen , Yong Xu , Ling Shao , Huazhu Fu