English
Related papers

Related papers: Aligning Knowledge Concepts to Whole Slide Images …

200 papers

Histology analysis of the tumor micro-environment integrated with genomic assays is the gold standard for most cancers in modern medicine. This paper proposes a Gene-induced Multimodal Pre-training (GiMP) framework, which jointly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Ting Jin , Xingran Xie , Renjie Wan , Qingli Li , Yan Wang

Multiple instance learning (MIL) has enabled substantial progress in computational histopathology, where a large amount of patches from gigapixel whole slide images are aggregated into slide-level predictions. Heatmaps are widely used to…

Whole Slide Image (WSI) classification is often formulated as a Multiple Instance Learning (MIL) problem. Recently, Vision-Language Models (VLMs) have demonstrated remarkable performance in WSI classification. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Hao Li , Ying Chen , Yifei Chen , Wenxian Yang , Bowen Ding , Yuchen Han , Liansheng Wang , Rongshan Yu

Representation learning of pathology whole-slide images (WSIs) has been has primarily relied on weak supervision with Multiple Instance Learning (MIL). However, the slide representations resulting from this approach are highly tailored to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Andrew H. Song , Richard J. Chen , Tong Ding , Drew F. K. Williamson , Guillaume Jaume , Faisal Mahmood

The Segment Anything Model (SAM) marks a significant advancement in segmentation models, offering robust zero-shot abilities and dynamic prompting. However, existing medical SAMs are not suitable for the multi-scale nature of whole-slide…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hong Liu , Haosen Yang , Paul J. van Diest , Josien P. W. Pluim , Mitko Veta

Artificial intelligence-enabled histopathological data analysis has become a valuable assistant to the pathologist. However, existing models lack representation and inference abilities compared with those of pathologists, especially in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Bo Yu , Hechang Chen , Yunke Zhang , Lele Cong , Shuchao Pang , Hongren Zhou , Ziye Wang , Xianling Cong

Asthma is a chronic inflammatory disorder of the lower respiratory tract and naturally occurs in humans and animals including horses. The annotation of an asthma microscopy whole slide image (WSI) is an extremely labour-intensive task due…

Image and Video Processing · Electrical Eng. & Systems 2021-01-14 Christian Marzahl , Christof A. Bertram , Frauke Wilm , Jörn Voigt , Ann K. Barton , Robert Klopfleisch , Katharina Breininger , Andreas Maier , Marc Aubreville

Oncologists often rely on a multitude of data, including whole-slide images (WSIs), to guide therapeutic decisions, aiming for the best patient outcome. However, predicting the prognosis of cancer patients can be a challenging task due to…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 M Rita Verdelho , Alexandre Bernardino , Catarina Barata

Cancer diagnosis has greatly benefited from the integration of whole-slide images (WSIs) with multiple instance learning (MIL), enabling high-resolution analysis of tissue morphology. Graph-based MIL (GNN-MIL) approaches have emerged as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Jongwoo Kim , Bryan Wong , Huazhu Fu , Willmer Rafell Quiñones , Youngsin Ko , Mun Yong Yi

Convolutional neural networks can be trained to perform histology slide classification using weak annotations with multiple instance learning (MIL). However, given the paucity of labeled histology data, direct application of MIL can easily…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Ming Y. Lu , Richard J. Chen , Jingwen Wang , Debora Dillon , Faisal Mahmood

Multiple instance learning (MIL) is the preferred approach for whole slide image classification. However, most MIL approaches do not exploit the interdependencies of tiles extracted from a whole slide image, which could provide valuable…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Marvin Lerousseau , Maria Vakalopoulou , Eric Deutsch , Nikos Paragios

Histopathology whole slide images (WSIs) are being widely used to develop deep learning-based diagnostic solutions, especially for precision oncology. Most of these diagnostic softwares are vulnerable to biases and impurities in the…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Abhijeet Patil , Harsh Diwakar , Jay Sawant , Nikhil Cherian Kurian , Subhash Yadav , Swapnil Rane , Tripti Bameta , Amit Sethi

Weakly-supervised classification of histopathology slides is a computationally intensive task, with a typical whole slide image (WSI) containing billions of pixels to process. We propose Discriminative Region Active Sampling for Multiple…

Image and Video Processing · Electrical Eng. & Systems 2023-02-23 Jack Breen , Katie Allen , Kieran Zucker , Geoff Hall , Nicolas M. Orsi , Nishant Ravikumar

Generating diagnostic text from histopathology whole slide images (WSIs) is challenging due to the gigapixel scale of the input and the requirement for precise, domain specific language. We propose a hierarchical vision language framework…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Ahmet Halici , Ece Tugba Cebeci , Musa Balci , Mustafa Cini , Serkan Sokmen

Multiple Instance Learning (MIL) has become the predominant approach for classification tasks on gigapixel histopathology whole slide images (WSIs). Within the MIL framework, single WSIs (bags) are decomposed into patches (instances), with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Daniel Sens , Ario Sadafi , Francesco Paolo Casale , Nassir Navab , Carsten Marr

Tissue phenotyping is a fundamental computational pathology (CPath) task in learning objective characterizations of histopathologic biomarkers in anatomic pathology. However, whole-slide imaging (WSI) poses a complex computer vision problem…

Whole slide image (WSI) classification is a fundamental task for the diagnosis and treatment of diseases; but, curation of accurate labels is time-consuming and limits the application of fully-supervised methods. To address this, multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Philip Chikontwe , Soo Jeong Nam , Heounjeong Go , Meejeong Kim , Hyun Jung Sung , Sang Hyun Park

Traditional whole slide image (WSI) analysis methods typically rely on the multiple instance learning (MIL) paradigm, which extracts patch-level features at high magnification and aggregates them for slide-level prediction. However, such…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiusong Ge , Yingkang Zhan , Wenjie Zhao , Di Zhang , Ke Wang , Jiashuai Liu , Chunze Yang , Chengzu Li , Jian Zhang , Yuxin Dong , Ni Zhang , Qidong Liu , Mireia Crispin-Ortuzar , Huazhu Fu , Chen Li , Zeyu Gao

Breast cancer is the most prevalent cancer in women worldwide. Histopathology image analysis serves as the gold standard for cancer diagnosis. In this regard, whole-slide imaging (WSI), a revolutionary technology in digital pathology,…

Methodology · Statistics 2026-04-21 Baichen Yu , Xuetong Li , Jing Zhou , Hansheng Wang

Whole-Slide Images (WSIs) are widely used for estimating the prognosis of cancer patients. Current studies generally follow a cancer-specific learning paradigm. However, the available training samples for one cancer type are usually scarce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Pei Liu , Xiangxiang Zeng , Tengfei Ma , Yucheng Xing , Xuanbai Ren , Yiping Liu