English
Related papers

Related papers: Historical Report Guided Bi-modal Concurrent Learn…

200 papers

Emerging research has highlighted that artificial intelligence-based multimodal fusion of digital pathology and transcriptomic features can improve cancer diagnosis (grading/subtyping) and prognosis (survival risk) prediction. However, such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Samiran Dey , Christopher R. S. Banerji , Partha Basuchowdhuri , Sanjoy K. Saha , Deepak Parashar , Tapabrata Chakraborti

Recent advances in computational pathology have led to the emergence of numerous foundation models. These models typically rely on general-purpose encoders with multi-instance learning for whole slide image (WSI) classification or apply…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Yuxuan Sun , Yixuan Si , Chenglu Zhu , Kai Zhang , Zhongyi Shui , Bowen Ding , Tao Lin , Lin Yang

Whole-slide image visual question answering (WSI-VQA) frames pathology as an extreme-context search problem: to answer a free-form clinical query, a system must first navigate a gigapixel slide under a strict inspection budget to locate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Chunze Yang , Qidong Liu , Wenjie Zhao , Yue Tang , Jiusong Ge , Di Zhang , Jiashuai Liu , Lei Wu , Junbo Lu , Ni Zhang , Xian Wu , Zeyu Gao , Chen Li

In recent years, the use of deep learning (DL) methods, including convolutional neural networks (CNNs) and vision transformers (ViTs), has significantly advanced computational pathology, enhancing both diagnostic accuracy and efficiency.…

Learning multimodal representations from medical images and other data sources can provide richer information for decision-making. While various multimodal models have been developed for this, they overlook learning features that are both…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Boyu Chen , Weiye Bao , Junjie Liu , Michael Shen , Bo Peng , Paul Taylor , Zhu Li , Mengyue Yang

Deep learning methods such as convolutional neural networks (CNNs) are difficult to directly utilize to analyze whole slide images (WSIs) due to the large image dimensions. We overcome this limitation by proposing a novel two-stage…

Image and Video Processing · Electrical Eng. & Systems 2021-06-15 Shivam Kalra , Mohammed Adnan , Sobhan Hemati , Taher Dehkharghanian , Shahryar Rahnamayan , Hamid Tizhoosh

Survival analysis using whole-slide images (WSIs) is crucial in cancer research. Despite significant successes, pathology images typically only provide slide-level labels, which hinders the learning of discriminative representations from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Chengsheng Zhang , Linhao Qu , Xiaoyu Liu , Zhijian Song

Beyond generating long and topic-coherent paragraphs in traditional captioning tasks, the medical image report composition task poses more task-oriented challenges by requiring both the highly-accurate medical term diagnosis and multiple…

Computation and Language · Computer Science 2021-01-12 Fuyu Wang , Xiaodan Liang , Lin Xu , Liang Lin

This paper introduces the novel concept of few-shot weakly supervised learning for pathology Whole Slide Image (WSI) classification, denoted as FSWC. A solution is proposed based on prompt learning and the utilization of a large language…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Linhao Qu , Xiaoyuan Luo , Kexue Fu , Manning Wang , Zhijian Song

While Multiple Instance Learning (MIL) has shown promising results in digital Pathology Whole Slide Image (WSI) classification, such a paradigm still faces performance and generalization problems due to challenges in high computational…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Honglin Li , Chenglu Zhu , Yunlong Zhang , Yuxuan Sun , Zhongyi Shui , Wenwei Kuang , Sunyi Zheng , Lin Yang

Learning suitable Whole slide images (WSIs) representations for efficient retrieval systems is a non-trivial task. The WSI embeddings obtained from current methods are in Euclidean space not ideal for efficient WSI retrieval. Furthermore,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Sobhan Hemati , Shivam Kalra , Morteza Babaie , H. R. Tizhoosh

The Segment Anything Model (SAM) marks a significant advancement in segmentation models, offering robust zero-shot abilities and dynamic prompting. However, existing medical SAMs are not suitable for the multi-scale nature of whole-slide…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hong Liu , Haosen Yang , Paul J. van Diest , Josien P. W. Pluim , Mitko Veta

Advancement in digital pathology and artificial intelligence has enabled deep learning-based computer vision techniques for automated disease diagnosis and prognosis. However, WSIs present unique computational and algorithmic challenges.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Yash Sharma , Lubaina Ehsan , Sana Syed , Donald E. Brown

Generative models have revolutionized Artificial Intelligence (AI), particularly in multimodal applications. However, adapting these models to the medical domain poses unique challenges due to the complexity of medical data and the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Daniele Molino , Francesco di Feola , Linlin Shen , Paolo Soda , Valerio Guarrasi

The automatic generation of radiology reports has the potential to assist radiologists in the time-consuming task of report writing. Existing methods generate the full report from image-level features, failing to explicitly focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Tim Tanida , Philip Müller , Georgios Kaissis , Daniel Rueckert

Multimodal learning significantly benefits cancer survival prediction, especially the integration of pathological images and genomic data. Despite advantages of multimodal learning for cancer survival prediction, massive redundancy in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yilan Zhang , Yingxue Xu , Jianqi Chen , Fengying Xie , Hao Chen

Digital pathology offers a groundbreaking opportunity to transform clinical practice in histopathological image analysis, yet faces a significant hurdle: the substantial file sizes of pathological Whole Slide Images (WSI). While current…

In the field of computational pathology, deep learning algorithms have made significant progress in tasks such as nuclei segmentation and classification. However, the potential of these advanced methods is limited by the lack of available…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Hyun-Jic Oh , Won-Ki Jeong

Deep neural networks are increasingly applied in automated histopathology. Yet, whole-slide images (WSIs) are often acquired at gigapixel sizes, rendering them computationally infeasible to analyze entirely at high resolution. Diagnostic…

Image and Video Processing · Electrical Eng. & Systems 2026-02-10 Tarun G , Naman Malpani , Gugan Thoppe , Sridharan Devarajan

The global burden of acute and chronic wounds presents a compelling case for enhancing wound classification methods, a vital step in diagnosing and determining optimal treatments. Recognizing this need, we introduce an innovative…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yash Patel , Tirth Shah , Mrinal Kanti Dhar , Taiyu Zhang , Jeffrey Niezgoda , Sandeep Gopalakrishnan , Zeyun Yu