English
Related papers

Related papers: Effective and Robust Multimodal Medical Image Anal…

200 papers

Multimodal deep learning (MDL) has emerged as a transformative approach in computational pathology. By integrating complementary information from multiple data sources, MDL models have demonstrated superior predictive performance across…

Quantitative Methods · Quantitative Biology 2025-11-17 Seth Alain Chang , Muhammad Mueez Amjad , Noorul Wahab , Ethar Alzaid , Nasir Rajpoot , Adam Shephard

The development of federated learning (FL) methods, which aim to learn from distributed databases (i.e., clients) without accessing data on clients, has recently attracted great attention. Most of these methods assume that the clients are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Barış Büyüktaş , Gencer Sumbul , Begüm Demir

Multimodal medical image fusion (MMIF) aims to integrate images from different modalities to produce a comprehensive image that enhances medical diagnosis by accurately depicting organ structures, tissue textures, and metabolic information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tao Luo , Weihua Xu

Liver cancer is one of the most common cancers worldwide. Due to inconspicuous texture changes of liver tumor, contrast-enhanced computed tomography (CT) imaging is effective for the diagnosis of liver cancer. In this paper, we focus on…

Image and Video Processing · Electrical Eng. & Systems 2021-07-22 Yao Zhang , Jiawei Yang , Jiang Tian , Zhongchao Shi , Cheng Zhong , Yang Zhang , Zhiqiang He

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

Multi-modal magnetic resonance imaging (MRI) is essential in clinics for comprehensive diagnosis and surgical planning. Nevertheless, the segmentation of multi-modal MR images tends to be time-consuming and challenging. Convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Cheng Li , Hui Sun , Zaiyi Liu , Meiyun Wang , Hairong Zheng , Shanshan Wang

Multi-modal medical image fusion (MMIF) is increasingly recognized as an essential technique for enhancing diagnostic precision and facilitating effective clinical decision-making within computer-aided diagnosis systems. MMIF combines data…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Muhammad Zubair , Muzammil Hussai , Mousa Ahmad Al-Bashrawi , Malika Bendechache , Muhammad Owais

In the realm of digital pathology, multi-magnification Multiple Instance Learning (multi-mag MIL) has proven effective in leveraging the hierarchical structure of Whole Slide Images (WSIs) to reduce information loss and redundant data.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yujian Liu , Ruoxuan Wu , Xinjie Shen , Zihuang Lu , Lingyu Liang , Haiyu Zhou , Shipu Xu , Shaoai Cai , Shidang Xu

Clinically, automated polyp segmentation techniques have the potential to significantly improve the efficiency and accuracy of medical diagnosis, thereby reducing the risk of colorectal cancer in patients. Unfortunately, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Junzhuo Liu , Qiaosong Chen , Ye Zhang , Zhixiang Wang , Deng Xin , Jin Wang

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

Multimodal medical analysis combining image and tabular data has gained increasing attention. However, effective fusion remains challenging due to cross-modal discrepancies in feature dimensions and modality contributions, as well as the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Congjing Yu , Jing Ye , Yang Liu , Xiaodong Zhang , Zhiyong Zhang

The fusion of complementary multimodal information is crucial in computational pathology for accurate diagnostics. However, existing multimodal learning approaches necessitate access to users' raw data, posing substantial privacy risks.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yuanzhe Peng , Jieming Bian , Jie Xu

Federated learning (FL) has gained significant attention for enabling decentralized training on edge networks without exposing raw data. However, FL models remain susceptible to adversarial attacks and performance degradation in non-IID…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yu Qiao , Apurba Adhikary , Huy Q. Le , Eui-Nam Huh , Zhu Han , Choong Seon Hong

Adapting large vision-language models (VLMs) such as CLIP to downstream tasks remains challenging, as full fine-tuning is computationally prohibitive and prone to overfitting in low-data regimes. Parameter-efficient fine-tuning (PEFT)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Kaixiang Chen , Pengfei Fang , Hui Xue

Purpose: Deep learning methods have shown promising results in the segmentation, and detection of diseases in medical images. However, most methods are trained and tested on data from a single source, modality, organ, or disease type,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Nchongmaje Ndipenocha , Alina Mirona , Kezhi Wanga , Yongmin Li

The diagnosis of medical diseases faces challenges such as the misdiagnosis of small lesions. Deep learning, particularly multimodal approaches, has shown great potential in the field of medical disease diagnosis. However, the differences…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jianxun Yu , Ruiquan Ge , Zhipeng Wang , Cheng Yang , Chenyu Lin , Xianjun Fu , Jikui Liu , Ahmed Elazab , Changmiao Wang

Multimodal learning mimics the reasoning process of the human multi-sensory system, which is used to perceive the surrounding world. While making a prediction, the human brain tends to relate crucial cues from multiple sources of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Lang Su , Chuqing Hu , Guofa Li , Dongpu Cao

The goal of multi-modal learning is to use complimentary information on the relevant task provided by the multiple modalities to achieve reliable and robust performance. Recently, deep learning has led significant improvement in multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2018-11-05 Jaekyum Kim , Junho Koh , Yecheol Kim , Jaehyung Choi , Youngbae Hwang , Jun Won Choi

Magnetic resonance imaging (MRI) is a widely used neuroimaging technique that can provide images of different contrasts (i.e., modalities). Fusing this multi-modal data has proven particularly effective for boosting model performance in…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Tao Zhou , Huazhu Fu , Geng Chen , Jianbing Shen , Ling Shao