English
Related papers

Related papers: Multi-modal Learning with Missing Modality in Pred…

200 papers

The accurate segmentation of brain tumors from multi-modal MRI is critical for clinical diagnosis and treatment planning. While integrating complementary information from various MRI sequences is a common practice, the frequent absence of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Dongqing Xie , Yonghuang Wu , Zisheng Ai , Jun Min , Zhencun Jiang , Shaojin Geng , Lei Wang

Whole Slide Images (WSIs) present a challenging computer vision task due to their gigapixel size and presence of numerous artefacts. Yet they are a valuable resource for patient diagnosis and stratification, often representing the gold…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Amaya Gallagher-Syed , Luca Rossi , Felice Rivellese , Costantino Pitzalis , Myles Lewis , Michael Barnes , Gregory Slabaugh

Multimodal learning often outperforms its unimodal counterparts by exploiting unimodal contributions and cross-modal interactions. However, focusing only on integrating multimodal features into a unified comprehensive representation…

Machine Learning · Computer Science 2025-05-15 Sehwan Moon , Hyunju Lee

Generating multi-contrasts/modal MRI of the same anatomy enriches diagnostic information but is limited in practice due to excessive data acquisition time. In this paper, we propose a novel deep-learning model for joint reconstruction and…

Image and Video Processing · Electrical Eng. & Systems 2022-06-30 Wanyu Bian , Qingchao Zhang , Xiaojing Ye , Yunmei Chen

Deep learning based Computer Aided Diagnosis (CAD) systems have been developed to treat breast ultrasound. Most of them focus on a single ultrasound imaging modality, either using representative static images or the dynamic video of a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yunwen Huang , Hongyu Hu , Ying Zhu , Yi Xu

Data from multi-modality provide complementary information in clinical prediction, but missing data in clinical cohorts limits the number of subjects in multi-modal learning context. Multi-modal missing imputation is challenging with…

Image and Video Processing · Electrical Eng. & Systems 2021-07-27 Riqiang Gao , Yucheng Tang , Kaiwen Xu , Ho Hin Lee , Steve Deppen , Kim Sandler , Pierre Massion , Thomas A. Lasko , Yuankai Huo , Bennett A. Landman

While Large Language Models (LLMs) are emerging as a promising direction in computational pathology, the substantial computational cost of giga-pixel Whole Slide Images (WSIs) necessitates the use of Multi-Instance Learning (MIL) to enable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhenfeng Zhuang , Fangyu Zhou , Liansheng Wang

Multimodal learning has been demonstrated to enhance performance across various clinical tasks, owing to the diverse perspectives offered by different modalities of data. However, existing multimodal segmentation methods rely on…

Image and Video Processing · Electrical Eng. & Systems 2026-02-04 Shiyun Chen , Li Lin , Pujin Cheng , ZhiCheng Jin , JianJian Chen , HaiDong Zhu , Kenneth K. Y. Wong , Xiaoying Tang

The current cancer treatment practice collects multimodal data, such as radiology images, histopathology slides, genomics and clinical data. The importance of these data sources taken individually has fostered the recent raise of radiomics…

Machine Learning · Computer Science 2023-06-16 Matteo Tortora , Ermanno Cordelli , Rosa Sicilia , Lorenzo Nibid , Edy Ippolito , Giuseppe Perrone , Sara Ramella , Paolo Soda

Due to the lack of fine-grained annotation guidance, current Multiple Instance Learning (MIL) struggles to establish a robust causal relationship between Whole Slide Image (WSI) diagnosis and evidence sub-images, just like fully supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Tianhang Nan , Yong Ding , Hao Quan , Deliang Li , Lisha Li , Guanghong Zhao , Xiaoyu Cui

Multi-modal medical images provide complementary soft-tissue characteristics that aid in the screening and diagnosis of diseases. However, limited scanning time, image corruption and various imaging protocols often result in incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Zhang , Chengtao Peng , Qiuli Wang , Dan Song , Kaiyan Li , S. Kevin Zhou

Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. Previous studies employ multiple instance learning (MIL) to represent WSIs as bags of sampled patches because, for most…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Chunyuan Li , Xinliang Zhu , Jiawen Yao , Junzhou Huang

Multiple Instance Learning (MIL) has been widely applied in histopathology to classify Whole Slide Images (WSIs) with slide-level diagnoses. While the ground truth is established by expert pathologists, the slides can be difficult to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Marie Arrivat , Rémy Peyret , Elsa Angelini , Pietro Gori

The visual examination of tissue biopsy sections is fundamental for cancer diagnosis, with pathologists analyzing sections at multiple magnifications to discern tumor cells and their subtypes. However, existing attention-based multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Olga Fourkioti , Matt De Vries , Chen Jin , Daniel C. Alexander , Chris Bakal

Deep learning has been shown to be useful to detect breast cancer metastases by analyzing whole slide images of sentinel lymph nodes. However, it requires extensive scanning and analysis of all the lymph nodes slides for each case. Our deep…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Kareem Allam , Xiaohong Iris Wang , Songlin Zhang , Jianmin Ding , Kevin Chiu , Karan Saluja , Amer Wahed , Hongxia Sun , Andy N. D. Nguyen

Multi-modality medical imaging is crucial in clinical treatment as it can provide complementary information for medical image segmentation. However, collecting multi-modal data in clinical is difficult due to the limitation of the scan time…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Shuai Wang , Zipei Yan , Daoan Zhang , Haining Wei , Zhongsen Li , Rui Li

Classification of gigapixel Whole Slide Images (WSIs) is an important prediction task in the emerging area of computational pathology. There has been a surge of research in deep learning models for WSI classification with clinical…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Sajid Javed , Arif Mahmood , Talha Qaiser , Naoufel Werghi , Nasir Rajpoot

Purpose: Deep learning methods have shown promising results in the segmentation, and detection of diseases in medical images. However, most methods are trained and tested on data from a single source, modality, organ, or disease type,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Nchongmaje Ndipenocha , Alina Mirona , Kezhi Wanga , Yongmin Li

Lung cancer is the leading cause of cancer death worldwide. The critical reason for the deaths is delayed diagnosis and poor prognosis. With the accelerated development of deep learning techniques, it has been successfully applied…

Image and Video Processing · Electrical Eng. & Systems 2021-06-15 Yujiao Wu , Jie Ma , Xiaoshui Huang , Sai Ho Ling , Steven Weidong Su

Multimodal (MM) learning is emerging as a promising paradigm in biomedical artificial intelligence (AI) applications, integrating complementary modality, which highlight different aspects of patient health. The scarcity of large…

Artificial Intelligence · Computer Science 2025-12-01 Niccolo Marini , Zhaohui Liang , Sivaramakrishnan Rajaraman , Zhiyun Xue , Sameer Antani