English
Related papers

Related papers: A robust and lightweight deep attention multiple i…

200 papers

Leveraging multimodal data, particularly the integration of whole-slide histology images (WSIs) and transcriptomic profiles, holds great promise for improving cancer survival prediction. However, excessive redundancy in multimodal data can…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Hong Liu , Haosen Yang , Federica Eduati , Josien P. W. Pluim , Mitko Veta

When applying multi-instance learning (MIL) to make predictions for bags of instances, the prediction accuracy of an instance often depends on not only the instance itself but also its context in the corresponding bag. From the viewpoint of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Tiancheng Lin , Hongteng Xu , Canqian Yang , Yi Xu

The survival analysis on histological whole-slide images (WSIs) is one of the most important means to estimate patient prognosis. Although many weakly-supervised deep learning models have been developed for gigapixel WSIs, their potential…

Image and Video Processing · Electrical Eng. & Systems 2023-11-06 Pei Liu , Luping Ji , Feng Ye , Bo Fu

The visual examination of tissue biopsy sections is fundamental for cancer diagnosis, with pathologists analyzing sections at multiple magnifications to discern tumor cells and their subtypes. However, existing attention-based multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Olga Fourkioti , Matt De Vries , Chen Jin , Daniel C. Alexander , Chris Bakal

Supervised learning tasks such as cancer survival prediction from gigapixel whole slide images (WSIs) are a critical challenge in computational pathology that requires modeling complex features of the tumor microenvironment. These learning…

Image and Video Processing · Electrical Eng. & Systems 2022-11-22 Iain Carmichael , Andrew H. Song , Richard J. Chen , Drew F. K. Williamson , Tiffany Y. Chen , Faisal Mahmood

Advances in medical imaging and deep learning have propelled progress in whole slide image (WSI) analysis, with multiple instance learning (MIL) showing promise for efficient and accurate diagnostics. However, conventional MIL models often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Xianrui Li , Yufei Cui , Jun Li , Antoni B. Chan

Histology analysis of the tumor micro-environment integrated with genomic assays is the gold standard for most cancers in modern medicine. This paper proposes a Gene-induced Multimodal Pre-training (GiMP) framework, which jointly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Ting Jin , Xingran Xie , Renjie Wan , Qingli Li , Yan Wang

Whole Slide Images (WSI), obtained by high-resolution digital scanning of microscope slides at multiple scales, are the cornerstone of modern Digital Pathology. However, they represent a particular challenge to AI-based/AI-mediated analysis…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Martim Afonso , Praphulla M. S. Bhawsar , Monjoy Saha , Jonas S. Almeida , Arlindo L. Oliveira

Multi-Instance Learning (MIL) has shown impressive performance for histopathology whole slide image (WSI) analysis using bags or pseudo-bags. It involves instance sampling, feature representation, and decision-making. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Tingting Zheng , Kui Jiang , Hongxun Yao

Accurate cancer survival prediction requires integration of diverse data modalities that reflect the complex interplay between imaging, clinical parameters, and textual reports. However, existing multimodal approaches suffer from simplistic…

Machine Learning · Computer Science 2025-07-01 Aakash Tripathi , Asim Waqas , Matthew B. Schabath , Yasin Yilmaz , Ghulam Rasool

The whole slide histopathology images (WSIs) play a critical role in gastric cancer diagnosis. However, due to the large scale of WSIs and various sizes of the abnormal area, how to select informative regions and analyze them are quite…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Shujun Wang , Yaxi Zhu , Lequan Yu , Hao Chen , Huangjing Lin , Xiangbo Wan , Xinjuan Fan , Pheng-Ann Hen

Multiple Instance Learning (MIL) has been widely applied to medical imaging diagnosis, where bag labels are known and instance labels inside bags are unknown. Traditional MIL assumes that instances in each bag are independent samples from a…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Yunan Wu , Francisco M. Castro-Macías , Pablo Morales-Álvarez , Rafael Molina , Aggelos K. Katsaggelos

Multiple instance learning (MIL) is the standard approach for whole-slide image (WSI) classification and survival prediction, where attention-based models ag gregate patch features into slide-level predictions. These models treat attention…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiangyu Li , Ran Su

Alzheimer's Disease (AD) is the most common neurodegenerative disorder with one of the most complex pathogeneses, making effective and clinically actionable decision support difficult. The objective of this study was to develop a novel…

Machine Learning · Computer Science 2022-09-27 Michal Golovanevsky , Carsten Eickhoff , Ritambhara Singh

Predicting breast cancer recurrence risk is a critical clinical challenge. This study investigates the potential of computational pathology to stratify patients using deep learning on routine Hematoxylin and Eosin (H&E) stained whole-slide…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Jinqiu Chen , Huyan Xu

Recent advances in multi-instance learning (MIL) have witnessed impressive performance in whole slide image (WSI) analysis. However, the inherent sparsity of tumors and their morphological diversity lead to obvious heterogeneity across…

Image and Video Processing · Electrical Eng. & Systems 2026-02-25 Tingting Zheng , Hongxun Yao , Kui Jiang , Sicheng Zhao , Yi Xiao

In line with recent advances in neural drug design and sensitivity prediction, we propose a novel architecture for interpretable prediction of anticancer compound sensitivity using a multimodal attention-based convolutional encoder. Our…

Treatment approaches for colorectal cancer (CRC) are highly dependent on the molecular subtype, as immunotherapy has shown efficacy in cases with microsatellite instability (MSI) but is ineffective for the microsatellite stable (MSS)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Hadar Hezi , Matan Gelber , Alexander Balabanov , Yosef E. Maruvka , Moti Freiman

Multiple instance learning (MIL) has been successfully applied for whole slide images (WSIs) analysis in computational pathology, enabling a wide range of prediction tasks from tumor subtyping to inferring genetic mutations and multi-omics…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Junyu Li , Ye Zhang , Wen Shu , Xiaobing Feng , Yingchun Wang , Pengju Yan , Xiaolin Li , Chulin Sha , Min He

We explore how Deep Learning (DL) can be utilized to predict prognosis of acute myeloid leukemia (AML). Out of TCGA (The Cancer Genome Atlas) database, 94 AML cases are used in this study. Input data include age, 10 common cytogenetic and…

Machine Learning · Computer Science 2018-11-01 Mei Lin , Vanya Jaitly , Iris Wang , Zhihong Hu , Lei Chen , Md. Amer Wahed , Zeyad Kanaan , Adan Rios , Andy N. D. Nguyen