English
Related papers

Related papers: Multimodal Feature Prototype Learning for Interpre…

200 papers

The rapidly emerging field of deep learning-based computational pathology has demonstrated promise in developing objective prognostic models from histology whole slide images. However, most prognostic models are either based on histology or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Richard J. Chen , Ming Y. Lu , Drew F. K. Williamson , Tiffany Y. Chen , Jana Lipkova , Muhammad Shaban , Maha Shady , Mane Williams , Bumjin Joo , Zahra Noor , Faisal Mahmood

Cancer survival prediction using multi-modal medical imaging presents a critical challenge in oncology, mainly due to the vulnerability of deep learning models to noise and protocol variations across imaging centers. Current approaches…

Image and Video Processing · Electrical Eng. & Systems 2025-05-06 Aiman Farooq , Azad Singh , Deepak Mishra , Santanu Chaudhury

For predicting cancer survival outcomes, standard approaches in clinical research are often based on two main modalities: pathology images for observing cell morphology features, and genomic (e.g., bulk RNA-seq) for quantifying gene…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hongxiao Wang , Yang Yang , Zhuo Zhao , Pengfei Gu , Nishchal Sapkota , Danny Z. Chen

Time-to-event prediction, e.g. cancer survival analysis or hospital length of stay, is a highly prominent machine learning task in medical and healthcare applications. However, only a few interpretable machine learning methods comply with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Hubert Baniecki , Bartlomiej Sobieski , Patryk Szatkowski , Przemyslaw Bombinski , Przemyslaw Biecek

Computer-aided cancer survival risk prediction plays an important role in the timely treatment of patients. This is a challenging weakly supervised ordinal regression task associated with multiple clinical factors involved such as…

Machine Learning · Computer Science 2024-09-05 Zekang Yang , Hong Liu , Xiangdong Wang

Accurate cancer survival prediction is crucial for assisting clinical doctors in formulating treatment plans. Multimodal data, including histopathological images and genomic data, offer complementary and comprehensive information that can…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hui Luo , Jiashuang Huang , Hengrong Ju , Tianyi Zhou , Weiping Ding

Multimodal machine learning integrating histopathology and molecular data shows promise for cancer prognostication. We systematically reviewed studies combining whole slide images (WSIs) and high-throughput omics to predict overall…

Quantitative Methods · Quantitative Biology 2025-07-30 Charlotte Jennings , Andrew Broad , Lucy Godson , Emily Clarke , David Westhead , Darren Treanor

Histomorphology is crucial in cancer diagnosis. However, existing whole slide image (WSI) classification methods struggle to effectively incorporate histomorphology information, limiting their ability to capture key pathological features.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Baizhi Wang , Rui Yan , Wenxin Ma , Xu Zhang , Yuhao Wang , Xiaolong Li , Yunjie Gu , Zihang Jiang , S. Kevin Zhou

Morphological attributes from histopathological images and molecular profiles from genomic data are important information to drive diagnosis, prognosis, and therapy of cancers. By integrating these heterogeneous but complementary data, many…

Machine Learning · Computer Science 2022-02-28 Kaiwen Tan , Weixian Huang , Xiaofeng Liu , Jinlong Hu , Shoubin Dong

Glioblastoma is profoundly heterogeneous in regional microstructure and vasculature. Characterizing the spatial heterogeneity of glioblastoma could lead to more precise treatment. With unsupervised learning techniques, glioblastoma…

Machine Learning · Computer Science 2021-08-24 Yifan Li , Chao Li , Yiran Wei , Stephen Price , Carola-Bibiane Schönlieb , Xi Chen

Prostate cancer being one of the frequently diagnosed malignancy in men, the rising demand for biopsies places a severe workload on pathologists. The grading procedure is tedious and subjective, motivating the development of automated…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Riddhasree Bhattacharyya , Pallabi Dutta , Sushmita Mitra

Multi-modal learning plays a crucial role in cancer diagnosis and prognosis. Current deep learning based multi-modal approaches are often limited by their abilities to model the complex correlations between genomics and histology data,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Yupei Zhang , Xiaofei Wang , Fangliangzi Meng , Jin Tang , Chao Li

Recent applications of deep convolutional neural networks in medical imaging raise concerns about their interpretability. While most explainable deep learning applications use post hoc methods (such as GradCAM) to generate feature…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Yuanyuan Wei , Roger Tam , Xiaoying Tang

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

The integration of histology images and gene profiles has shown great promise for improving survival prediction in cancer. However, current approaches often struggle to model intra- and inter-modal interactions efficiently and effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Yilan Zhang , Li Nanbo , Changchun Yang , Jürgen Schmidhuber , Xin Gao

Cancer survival prediction requires integrating pathological Whole Slide Images (WSIs) and genomic profiles, a challenging task due to the inherent heterogeneity and the complexity of modeling both inter- and intra-modality interactions.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Mingxin Liu , Chengfei Cai , Jun Li , Pengbo Xu , Jinze Li , Jiquan Ma , Jun Xu

Early prostate cancer detection and staging from MRI are extremely challenging tasks for both radiologists and deep learning algorithms, but the potential to learn from large and diverse datasets remains a promising avenue to increase their…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Abhejit Rajagopal , Ekaterina Redekop , Anil Kemisetti , Rushi Kulkarni , Steven Raman , Kirti Magudia , Corey W. Arnold , Peder E. Z. Larson

Clinical decision-making in oncology involves multimodal data such as radiology scans, molecular profiling, histopathology slides, and clinical factors. Despite the importance of these modalities individually, no deep learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Nathaniel Braman , Jacob W. H. Gordon , Emery T. Goossens , Caleb Willis , Martin C. Stumpe , Jagadish Venkataraman

In meta-learning approaches, it is difficult for a practitioner to make sense of what kind of representations the model employs. Without this ability, it can be difficult to both understand what the model knows as well as to make meaningful…

Machine Learning · Computer Science 2022-04-05 Pedro Sandoval-Segura , Wallace Lawson

Histopathology remains the gold standard for cancer diagnosis because it provides detailed cellular-level assessment of tissue morphology. However, manual histopathological examination is time-consuming, labour-intensive, and subject to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Ravi Mosalpuri , Mohammed Abdelsamea , Ahmed Karam Eldaly