English
Related papers

Related papers: M2EF-NNs: Multimodal Multi-instance Evidence Fusio…

200 papers

Multimodal survival prediction, a crucial yet challenging task, demands the integration of multimodal medical data (\eg Whole Slide Images (WSIs) and Genomic Profiles) to achieve accurate prognostic modeling. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Huayi Wang , Haochao Ying , Yuyang Xu , Qiyao Zheng , jun wang , Cheng Zhang , Ying Sun , Jian Wu

Breast cancer screening, primarily conducted through mammography, is often supplemented with ultrasound for women with dense breast tissue. However, existing deep learning models analyze each modality independently, missing opportunities to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-16 Yiqiu Shen , Jungkyu Park , Frank Yeung , Eliana Goldberg , Laura Heacock , Farah Shamout , Krzysztof J. Geras

Survival analysis, as a challenging task, requires integrating Whole Slide Images (WSIs) and genomic data for comprehensive decision-making. There are two main challenges in this task: significant heterogeneity and complex inter- and…

Image and Video Processing · Electrical Eng. & Systems 2024-06-17 Conghao Xiong , Hao Chen , Hao Zheng , Dong Wei , Yefeng Zheng , Joseph J. Y. Sung , Irwin King

Accurate brain tumor segmentation from multi-modal magnetic resonance imaging (MRI) is a prerequisite for precise radiotherapy planning and surgical navigation. While recent Transformer-based models such as Swin UNETR have achieved…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yan Zhou , Zhen Huang , Yingqiu Li , Yue Ouyang , Suncheng Xiang , Zehua Wang

A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing…

Machine Learning · Computer Science 2026-05-19 Sina Tabakhi , Chen , Chen , Haiping Lu

Survival prediction is a crucial task in the medical field and is essential for optimizing treatment options and resource allocation. However, current methods often rely on limited data modalities, resulting in suboptimal performance. In…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Binyu Zhang , Zhu Meng , Junhao Dong , Fei Su , Zhicheng Zhao

The rapidly emerging field of deep learning-based computational pathology has shown promising results in utilizing whole slide images (WSIs) to objectively prognosticate cancer patients. However, most prognostic methods are currently…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Mingxin Liu , Yunzan Liu , Hui Cui , Chunquan Li , Jiquan Ma

This study focuses on the classification of cancerous and healthy slices from multimodal lung images. The data used in the research comprises Computed Tomography (CT) and Positron Emission Tomography (PET) images. The proposed strategy…

Image and Video Processing · Electrical Eng. & Systems 2025-02-04 Surochita Pal , Sushmita Mitra

Overall survival (OS) time is one of the most important evaluation indices for gliomas situations. Multimodal Magnetic Resonance Imaging (MRI) scans play an important role in the study of glioma prognosis OS time. Several deep…

Image and Video Processing · Electrical Eng. & Systems 2024-04-19 Wen Tang , Haoyue Zhang , Pengxin Yu , Han Kang , Rongguo Zhang

Survival outcome assessment is challenging and inherently associated with multiple clinical factors (e.g., imaging and genomics biomarkers) in cancer. Enabling multimodal analytics promises to reveal novel predictive patterns of patient…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Kexin Ding , Mu Zhou , Dimitris N. Metaxas , Shaoting Zhang

While multimodal survival prediction models are increasingly more accurate, their complexity often reduces interpretability, limiting insight into how different data sources influence predictions. To address this, we introduce DIMAFx, an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Angelos Chatzimparmpas , Sanne Abeln , Wilson Silva

Cancer is one of the leading causes of death worldwide, making the development of rapid, minimally invasive, label-free and scalable diagnostic strategies a major challenge in modern oncology. In this context, spectroscopic liquid biopsy…

There exists unexplained diverse variation within the predefined colon cancer stages using only features either from genomics or histopathological whole slide images as prognostic factors. Unraveling this variation will bring about improved…

Quantitative Methods · Quantitative Biology 2022-12-15 Olalekan Ogundipe , Zeyneb Kurt , Wai Lok Woo

Survival analysis plays a vital role in making clinical decisions. However, the models currently in use are often difficult to interpret, which reduces their usefulness in clinical settings. Prototype learning presents a potential solution,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Shuo Jiang , Zhuwen Chen , Liaoman Xu , Yanming Zhu , Changmiao Wang , Jiong Zhang , Feiwei Qin , Yifei Chen , Zhu Zhu

Pathology whole-slide images (WSIs) are widely used for cancer survival analysis because of their comprehensive histopathological information at both cellular and tissue levels, enabling quantitative, large-scale, and prognostically rich…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 Yucheng Xing , Ling Huang , Jingying Ma , Ruping Hong , Jiangdong Qiu , Pei Liu , Kai He , Huazhu Fu , Mengling Feng

Computer-aided cancer survival risk prediction plays an important role in the timely treatment of patients. This is a challenging weakly supervised ordinal regression task associated with multiple clinical factors involved such as…

Machine Learning · Computer Science 2024-09-05 Zekang Yang , Hong Liu , Xiangdong Wang

Addressing uncertainty in Deep Learning (DL) is essential, as it enables the development of models that can make reliable predictions and informed decisions in complex, real-world environments where data may be incomplete or ambiguous. This…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Ayyub Alzahem , Wadii Boulila , Maha Driss , Anis Koubaa

Capturing global contextual information plays a critical role in breast ultrasound (BUS) image classification. Although convolutional neural networks (CNNs) have demonstrated reliable performance in tumor classification, they have inherent…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Bryar Shareef , Min Xian , Aleksandar Vakanski , Haotian Wang

Survival analysis stands as a pivotal process in cancer treatment research, crucial for predicting patient survival rates accurately. Recent advancements in data collection techniques have paved the way for enhancing survival predictions by…

Machine Learning · Computer Science 2024-07-26 Linhao Qu , Dan Huang , Shaoting Zhang , Xiaosong Wang

This paper introduces an innovative multi-modal fusion deep learning approach to overcome the drawbacks of traditional single-modal recognition techniques. These drawbacks include incomplete information and limited diagnostic accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xiaoyi Liu , Hongjie Qiu , Muqing Li , Zhou Yu , Yutian Yang , Yafeng Yan