中文
相关论文

相关论文: Multi-modal Learning with Missing Modality in Pred…

200 篇论文

The accurate segmentation of brain tumors from multi-modal MRI is critical for clinical diagnosis and treatment planning. While integrating complementary information from various MRI sequences is a common practice, the frequent absence of…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Dongqing Xie , Yonghuang Wu , Zisheng Ai , Jun Min , Zhencun Jiang , Shaojin Geng , Lei Wang

Whole Slide Images (WSIs) present a challenging computer vision task due to their gigapixel size and presence of numerous artefacts. Yet they are a valuable resource for patient diagnosis and stratification, often representing the gold…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Amaya Gallagher-Syed , Luca Rossi , Felice Rivellese , Costantino Pitzalis , Myles Lewis , Michael Barnes , Gregory Slabaugh

Multimodal learning often outperforms its unimodal counterparts by exploiting unimodal contributions and cross-modal interactions. However, focusing only on integrating multimodal features into a unified comprehensive representation…

机器学习 · 计算机科学 2025-05-15 Sehwan Moon , Hyunju Lee

Generating multi-contrasts/modal MRI of the same anatomy enriches diagnostic information but is limited in practice due to excessive data acquisition time. In this paper, we propose a novel deep-learning model for joint reconstruction and…

图像与视频处理 · 电气工程与系统科学 2022-06-30 Wanyu Bian , Qingchao Zhang , Xiaojing Ye , Yunmei Chen

Deep learning based Computer Aided Diagnosis (CAD) systems have been developed to treat breast ultrasound. Most of them focus on a single ultrasound imaging modality, either using representative static images or the dynamic video of a…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Yunwen Huang , Hongyu Hu , Ying Zhu , Yi Xu

Data from multi-modality provide complementary information in clinical prediction, but missing data in clinical cohorts limits the number of subjects in multi-modal learning context. Multi-modal missing imputation is challenging with…

图像与视频处理 · 电气工程与系统科学 2021-07-27 Riqiang Gao , Yucheng Tang , Kaiwen Xu , Ho Hin Lee , Steve Deppen , Kim Sandler , Pierre Massion , Thomas A. Lasko , Yuankai Huo , Bennett A. Landman

While Large Language Models (LLMs) are emerging as a promising direction in computational pathology, the substantial computational cost of giga-pixel Whole Slide Images (WSIs) necessitates the use of Multi-Instance Learning (MIL) to enable…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Zhenfeng Zhuang , Fangyu Zhou , Liansheng Wang

Multimodal learning has been demonstrated to enhance performance across various clinical tasks, owing to the diverse perspectives offered by different modalities of data. However, existing multimodal segmentation methods rely on…

图像与视频处理 · 电气工程与系统科学 2026-02-04 Shiyun Chen , Li Lin , Pujin Cheng , ZhiCheng Jin , JianJian Chen , HaiDong Zhu , Kenneth K. Y. Wong , Xiaoying Tang

The current cancer treatment practice collects multimodal data, such as radiology images, histopathology slides, genomics and clinical data. The importance of these data sources taken individually has fostered the recent raise of radiomics…

Due to the lack of fine-grained annotation guidance, current Multiple Instance Learning (MIL) struggles to establish a robust causal relationship between Whole Slide Image (WSI) diagnosis and evidence sub-images, just like fully supervised…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Tianhang Nan , Yong Ding , Hao Quan , Deliang Li , Lisha Li , Guanghong Zhao , Xiaoyu Cui

Multi-modal medical images provide complementary soft-tissue characteristics that aid in the screening and diagnosis of diseases. However, limited scanning time, image corruption and various imaging protocols often result in incomplete…

计算机视觉与模式识别 · 计算机科学 2024-07-10 Yue Zhang , Chengtao Peng , Qiuli Wang , Dan Song , Kaiyan Li , S. Kevin Zhou

Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. Previous studies employ multiple instance learning (MIL) to represent WSIs as bags of sampled patches because, for most…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Chunyuan Li , Xinliang Zhu , Jiawen Yao , Junzhou Huang

Multiple Instance Learning (MIL) has been widely applied in histopathology to classify Whole Slide Images (WSIs) with slide-level diagnoses. While the ground truth is established by expert pathologists, the slides can be difficult to…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Marie Arrivat , Rémy Peyret , Elsa Angelini , Pietro Gori

The visual examination of tissue biopsy sections is fundamental for cancer diagnosis, with pathologists analyzing sections at multiple magnifications to discern tumor cells and their subtypes. However, existing attention-based multiple…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Olga Fourkioti , Matt De Vries , Chen Jin , Daniel C. Alexander , Chris Bakal

Deep learning has been shown to be useful to detect breast cancer metastases by analyzing whole slide images of sentinel lymph nodes. However, it requires extensive scanning and analysis of all the lymph nodes slides for each case. Our deep…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Kareem Allam , Xiaohong Iris Wang , Songlin Zhang , Jianmin Ding , Kevin Chiu , Karan Saluja , Amer Wahed , Hongxia Sun , Andy N. D. Nguyen

Multi-modality medical imaging is crucial in clinical treatment as it can provide complementary information for medical image segmentation. However, collecting multi-modal data in clinical is difficult due to the limitation of the scan time…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Shuai Wang , Zipei Yan , Daoan Zhang , Haining Wei , Zhongsen Li , Rui Li

Classification of gigapixel Whole Slide Images (WSIs) is an important prediction task in the emerging area of computational pathology. There has been a surge of research in deep learning models for WSI classification with clinical…

计算机视觉与模式识别 · 计算机科学 2023-05-04 Sajid Javed , Arif Mahmood , Talha Qaiser , Naoufel Werghi , Nasir Rajpoot

Purpose: Deep learning methods have shown promising results in the segmentation, and detection of diseases in medical images. However, most methods are trained and tested on data from a single source, modality, organ, or disease type,…

图像与视频处理 · 电气工程与系统科学 2025-08-20 Nchongmaje Ndipenocha , Alina Mirona , Kezhi Wanga , Yongmin Li

Lung cancer is the leading cause of cancer death worldwide. The critical reason for the deaths is delayed diagnosis and poor prognosis. With the accelerated development of deep learning techniques, it has been successfully applied…

图像与视频处理 · 电气工程与系统科学 2021-06-15 Yujiao Wu , Jie Ma , Xiaoshui Huang , Sai Ho Ling , Steven Weidong Su

Multimodal (MM) learning is emerging as a promising paradigm in biomedical artificial intelligence (AI) applications, integrating complementary modality, which highlight different aspects of patient health. The scarcity of large…

人工智能 · 计算机科学 2025-12-01 Niccolo Marini , Zhaohui Liang , Sivaramakrishnan Rajaraman , Zhiyun Xue , Sameer Antani