English
Related papers

Related papers: MGML: A Plug-and-Play Meta-Guided Multi-Modal Lear…

200 papers

Most existing federated learning (FL) methods for medical image analysis only considered intramodal heterogeneity, limiting their applicability to multimodal imaging applications. In practice, it is not uncommon that some FL participants…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Qian Dai , Dong Wei , Hong Liu , Jinghan Sun , Liansheng Wang , Yefeng Zheng

Multi-modal brain tumor segmentation remains challenging for practical deployment due to the high computational costs of mainstream models. In this work, we propose GMLN-BTS, a Graph-based Multi-modal interaction Lightweight Network for…

Image and Video Processing · Electrical Eng. & Systems 2026-03-06 Guohao Huo , Ruiting Dai , Zitong Wang , Junxin Kong , Hao Tang

Accurate segmentation of brain tumors from multi-modal Magnetic Resonance (MR) images is essential in brain tumor diagnosis and treatment. However, due to the existence of domain shifts among different modalities, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Kelei He , Wen Ji , Tao Zhou , Zhuoyuan Li , Jing Huo , Xin Zhang , Yang Gao , Dinggang Shen , Bing Zhang , Junfeng Zhang

Delineating the brain tumor from magnetic resonance (MR) images is critical for the treatment of gliomas. However, automatic delineation is challenging due to the complex appearance and ambiguous outlines of tumors. Considering that…

Image and Video Processing · Electrical Eng. & Systems 2020-11-03 Chenyu Liu , Wangbin Ding , Lei Li , Zhen Zhang , Chenhao Pei , Liqin Huang , Xiahai Zhuang

Multimodal learning has developed very fast in recent years. However, during the multimodal training process, the model tends to rely on only one modality based on which it could learn faster, thus leading to inadequate use of other…

Machine Learning · Computer Science 2024-11-05 Zirun Guo , Tao Jin , Jingyuan Chen , Zhou Zhao

Accurate segmentation of brain tumors is vital for diagnosis, surgical planning, and treatment monitoring. Deep learning has advanced on benchmarks, but two issues limit clinical use: no uncertainty estimates for errors and no segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Andrew Zhou

Multimodal Fusion Learning (MFL), leveraging disparate data from various imaging modalities (e.g., MRI, CT, SPECT), has shown great potential for addressing medical problems such as skin cancer and brain tumor prediction. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Joy Dhar , Nayyar Zaidi , Maryam Haghighat

Background: Brain tumor segmentation requires precise delineation of hierarchical structures from multi-sequence MRI. However, existing deep learning methods primarily rely on visual features, showing insufficient discriminative power in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Mingda Zhang , Kaiwen Pan

Multimodal MR images can provide complementary information for accurate brain tumor segmentation. However, it's common to have missing imaging modalities in clinical practice. Since there exists a strong correlation between multi…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Multi-task learning (MTL) aims to improve the generalization of several related tasks by learning them jointly. As a comparison, in addition to the joint training scheme, modern meta-learning allows unseen tasks with limited labels during…

Machine Learning · Computer Science 2021-06-17 Haoxiang Wang , Han Zhao , Bo Li

Integrating cross-department multi-modal data (e.g., radiological, pathological, genomic, and clinical data) is ubiquitous in brain cancer diagnosis and survival prediction. To date, such an integration is typically conducted by human…

Machine Learning · Computer Science 2022-07-20 Can Cui , Han Liu , Quan Liu , Ruining Deng , Zuhayr Asad , Yaohong WangShilin Zhao , Haichun Yang , Bennett A. Landman , Yuankai Huo

Due to its complexity, graph learning-based multi-modal integration and classification is one of the most challenging obstacles for disease prediction. To effectively offset the negative impact between modalities in the process of…

Machine Learning · Computer Science 2025-02-14 Jin Liu , Junbin Mao , Hanhe Lin , Hulin Kuang , Shirui Pan , Xusheng Wu , Shan Xie , Fei Liu , Yi Pan

Graph deep learning (GDL) has demonstrated impressive performance in predicting population-based brain disorders (BDs) through the integration of both imaging and non-imaging data. However, the effectiveness of GDL based methods heavily…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Luhui Cai , Weiming Zeng , Hongyu Chen , Hua Zhang , Yueyang Li , Yu Feng , Hongjie Yan , Lingbin Bian , Wai Ting Siok , Nizhuan Wang

Gliomas are one of the most prevalent types of primary brain tumours, accounting for more than 30\% of all cases and they develop from the glial stem or progenitor cells. In theory, the majority of brain tumours could well be identified…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Reza Azad , Nika Khosravi , Dorit Merhof

Accurate brain tumor diagnosis relies on the assessment of multiple Magnetic Resonance Imaging (MRI) sequences. However, in clinical practice, the acquisition of certain sequences may be affected by factors like motion artifacts or contrast…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Moinak Bhattacharya , Saumya Gupta , Annie Singh , Chao Chen , Gagandeep Singh , Prateek Prasanna

Magnetic resonance imaging (MRI) is critically important for brain mapping in both scientific research and clinical studies. Precise segmentation of brain tumors facilitates clinical diagnosis, evaluations, and surgical planning. Deep…

Image and Video Processing · Electrical Eng. & Systems 2023-05-01 Rui Nian , Guoyao Zhang , Yao Sui , Yuqi Qian , Qiuying Li , Mingzhang Zhao , Jianhui Li , Ali Gholipour , Simon K. Warfield

Accurate segmentation of brain tumors from 3D multimodal MRI is vital for diagnosis and treatment planning across diverse brain tumors. This paper addresses the challenges posed by the BraTS 2023, presenting a unified transfer learning…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Ramy A. Zeineldin , Franziska Mathis-Ullrich

When diagnosing the brain tumor, doctors usually make a diagnosis by observing multimodal brain images from the axial view, the coronal view and the sagittal view, respectively. And then they make a comprehensive decision to confirm the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-22 Yi Ding , Wei Zheng , Guozheng Wu , Ji Geng , Mingsheng Cao , Zhiguang Qin

Automated medical image segmentation using deep neural networks typically requires substantial supervised training. However, these models fail to generalize well across different imaging modalities. This shortcoming, amplified by the…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Malo Alefsen de Boisredon d'Assier , Eugene Vorontsov , Samuel Kadoury

Brain tumor segmentation is an active research area due to the difficulty in delineating highly complex shaped and textured tumors as well as the failure of the commonly used U-Net architectures. The combination of different neural…

Image and Video Processing · Electrical Eng. & Systems 2023-08-02 Lanhong Yao , Zheyuan Zhang , Ulas Bagci