English
Related papers

Related papers: Modality-aware Mutual Learning for Multi-modal Med…

200 papers

This paper proposes a novel multimodal deep learning framework integrating bidirectional LSTM, multi-head attention mechanism, and variational mode decomposition (BiLSTM-AM-VMD) for early liver cancer diagnosis. Using heterogeneous data…

Machine Learning · Computer Science 2025-09-03 Cheng Cheng , Zeping Chen , Xavier Wang

Multi-modal learning is typically performed with network architectures containing modality-specific layers and shared layers, utilizing co-registered images of different modalities. We propose a novel learning scheme for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Qi Dou , Quande Liu , Pheng Ann Heng , Ben Glocker

Due to the difficulties of obtaining multimodal paired images in clinical practice, recent studies propose to train brain tumor segmentation models with unpaired images and capture complementary information through modality translation.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Zecheng Liu , Jia Wei , Rui Li

Multi-modal magnetic resonance (MR) imaging provides great potential for diagnosing and analyzing brain gliomas. In clinical scenarios, common MR sequences such as T1, T2 and FLAIR can be obtained simultaneously in a single scanning…

Image and Video Processing · Electrical Eng. & Systems 2022-03-10 Ziqi Huang , Li Lin , Pujin Cheng , Linkai Peng , Xiaoying Tang

Brain tumor segmentation is often based on multiple magnetic resonance imaging (MRI). However, in clinical practice, certain modalities of MRI may be missing, which presents an even more difficult scenario. To cope with this challenge,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-16 Tianyi Liu , Zhaorui Tan , Haochuan Jiang , Xi Yang , Kaizhu Huang

Multi-phase computed tomography (CT) images provide crucial complementary information for accurate liver tumor segmentation (LiTS). State-of-the-art multi-phase LiTS methods usually fused cross-phase features through phase-weighted…

Image and Video Processing · Electrical Eng. & Systems 2021-08-06 Yue Zhang , Chengtao Peng , Liying Peng , Huimin Huang , Ruofeng Tong , Lanfen Lin , Jingsong Li , Yen-Wei Chen , Qingqing Chen , Hongjie Hu , Zhiyi Peng

Accurate medical image segmentation commonly requires effective learning of the complementary information from multimodal data. However, in clinical practice, we often encounter the problem of missing imaging modalities. We tackle this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Cheng Chen , Qi Dou , Yueming Jin , Hao Chen , Jing Qin , Pheng-Ann Heng

Automatic segmentation of liver tumors in medical images is crucial for the computer-aided diagnosis and therapy. It is a challenging task, since the tumors are notoriously small against the background voxels. This paper proposes a new…

Image and Video Processing · Electrical Eng. & Systems 2019-10-18 Huiyu Li , Xiabi Liu , Said Boumaraf , Weihua Liu , Xiaopeng Gong , Xiaohong Ma

Multimodal magnetic resonance imaging (MRI) is crucial for brain tumor segmentation, with many methods leveraging its four key modalities to capture complementary information for effective sub-region analysis. However, the absence of…

Artificial Intelligence · Computer Science 2026-05-19 Sha Tao , Jiao Pan , Yu Guo , Chao Yao

A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing…

Machine Learning · Computer Science 2026-05-19 Sina Tabakhi , Chen , Chen , Haiping Lu

Liver cancer is a leading cause of mortality worldwide, and accurate Computed Tomography (CT)-based tumor segmentation is essential for diagnosis and treatment. Manual delineation is time-intensive, prone to variability, and highlights the…

Machine Learning · Computer Science 2025-05-01 Hairong Wang , Lingchao Mao , Zihan Zhang , Jing Li

Magnetic resonance imaging (MRI) image segmentation is crucial in diagnosing and treating many diseases, such as brain tumors. Existing MRI image segmentation methods mainly fall into a centralized multimodal paradigm, which is inapplicable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Guyue Hu , Siyuan Song , Jingpeng Sun , Zhe Jin , Chenglong Li , Jin Tang

In this work, we propose a multi-modal Convolutional Neural Network (CNN) approach for brain tumor segmentation. We investigate how to combine different modalities efficiently in the CNN framework.We adapt various fusion methods, which are…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mehmet Aygün , Yusuf Hüseyin Şahin , Gözde Ünal

The use of machine learning (ML) for cancer staging through medical image analysis has gained substantial interest across medical disciplines. When accompanied by the innovative federated learning (FL) framework, ML techniques can further…

Machine Learning · Computer Science 2024-10-10 Kasra Borazjani , Naji Khosravan , Leslie Ying , Seyyedali Hosseinalipour

Accurate segmentation of brain images typically requires the integration of complementary information from multiple image modalities. However, clinical data for all modalities may not be available for every patient, creating a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haitao Li , Ziyu Li , Yiheng Mao , Zhengyao Ding , Zhengxing Huang

The success of deep convolutional neural networks is partially attributed to the massive amount of annotated training data. However, in practice, medical data annotations are usually expensive and time-consuming to be obtained. Considering…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Kang Li , Lequan Yu , Shujun Wang , Pheng-Ann Heng

Multimodal MR images can provide complementary information for accurate brain tumor segmentation. However, it's common to have missing imaging modalities in clinical practice. Since there exists a strong correlation between multi…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Recent advances in machine learning and prevalence of digital medical images have opened up an opportunity to address the challenging brain tumor segmentation (BTS) task by using deep convolutional neural networks. However, different from…

Image and Video Processing · Electrical Eng. & Systems 2022-01-10 Dingwen Zhang , Guohai Huang , Qiang Zhang , Jungong Han , Junwei Han , Yizhou Yu

Semi-supervised learning has become increasingly popular in medical image segmentation due to its ability to leverage large amounts of unlabeled data to extract additional information. However, most existing semi-supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Shengbo Gao , Ziji Zhang , Jiechao Ma , Zihao Li , Shu Zhang

Simultaneous multi-index quantification, segmentation, and uncertainty estimation of liver tumors on multi-modality non-contrast magnetic resonance imaging (NCMRI) are crucial for accurate diagnosis. However, existing methods lack an…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Xiaojiao Xiao , Qinmin Hu , Guanghui Wang