English
Related papers

Related papers: Multimodal Whole Slide Foundation Model for Pathol…

200 papers

Current multimodal fusion approaches in computational oncology primarily focus on integrating multi-gigapixel histology whole slide images (WSIs) with genomic or transcriptomic data, demonstrating improved survival prediction. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Manahil Raza , Ayesha Azam , Talha Qaiser , Nasir Rajpoot

Histopathological whole slide image (WSI) analysis with deep learning has become a research focus in computational pathology. The current paradigm is mainly based on multiple instance learning (MIL), in which approaches with Transformer as…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hongbo Chu , Qiehe Sun , Jiawen Li , Yuxuan Chen , Lizhong Zhang , Tian Guan , Anjia Han , Yonghong He

Whole Slide Images (WSI), obtained by high-resolution digital scanning of microscope slides at multiple scales, are the cornerstone of modern Digital Pathology. However, they represent a particular challenge to AI-based/AI-mediated analysis…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Martim Afonso , Praphulla M. S. Bhawsar , Monjoy Saha , Jonas S. Almeida , Arlindo L. Oliveira

Recent breakthroughs in self-supervised learning have enabled the use of large unlabeled datasets to train visual foundation models that can generalize to a variety of downstream tasks. While this training paradigm is well suited for the…

Pathology is the study of microscopic inspection of tissue, and a pathology diagnosis is often the medical gold standard to diagnose disease. Pathology images provide a unique challenge for computer-vision-based analysis: a single pathology…

In digital pathology, the multiple instance learning (MIL) strategy is widely used in the weakly supervised histopathology whole slide image (WSI) classification task where giga-pixel WSIs are only labeled at the slide level. However,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-28 Zhan Shi , Jingwei Zhang , Jun Kong , Fusheng Wang

Deep Learning-based computational pathology algorithms have demonstrated profound ability to excel in a wide array of tasks that range from characterization of well known morphological phenotypes to predicting non-human-identifiable…

Image and Video Processing · Electrical Eng. & Systems 2020-09-24 Ming Y. Lu , Dehan Kong , Jana Lipkova , Richard J. Chen , Rajendra Singh , Drew F. K. Williamson , Tiffany Y. Chen , Faisal Mahmood

The emergence of large multimodal models (LMMs) has brought significant advancements to pathology. Previous research has primarily focused on separately training patch-level and whole-slide image (WSI)-level models, limiting the integration…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxuan Sun , Yixuan Si , Chenglu Zhu , Xuan Gong , Kai Zhang , Pingyi Chen , Ye Zhang , Zhongyi Shui , Tao Lin , Lin Yang

In digital pathology, whole-slide images (WSIs) are often difficult to handle due to their gigapixel scale, so most approaches train patch encoders via self-supervised learning (SSL) and then aggregate the patch-level embeddings via…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Myeongjang Pyeon , Janghyeon Lee , Minsoo Lee , Juseung Yun , Hwanil Choi , Jonghyun Kim , Jiwon Kim , Yi Hu , Jongseong Jang , Soonyoung Lee

From self-supervised, vision-only models to contrastive visual-language frameworks, computational pathology has rapidly evolved in recent years. Generative AI "co-pilots" now demonstrate the ability to mine subtle, sub-visual tissue cues…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Mohsin Bilal , Aadam , Manahil Raza , Youssef Altherwy , Anas Alsuhaibani , Abdulrahman Abduljabbar , Fahdah Almarshad , Paul Golding , Nasir Rajpoot

Pathological captioning of Whole Slide Images (WSIs), though is essential in computer-aided pathological diagnosis, has rarely been studied due to the limitations in datasets and model training efficacy. In this paper, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Wenkang Qin , Rui Xu , Peixiang Huang , Xiaomin Wu , Heyu Zhang , Lin Luo

Recent advances in whole-slide image (WSI) scanners and computational capabilities have significantly propelled the application of artificial intelligence in histopathology slide analysis. While these strides are promising, current…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Weiyi Wu , Chongyang Gao , Joseph DiPalma , Soroush Vosoughi , Saeed Hassanpour

Multiple instance learning (MIL) has been increasingly used in the classification of histopathology whole slide images (WSIs). However, MIL approaches for this specific classification problem still face unique challenges, particularly those…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Hongrun Zhang , Yanda Meng , Yitian Zhao , Yihong Qiao , Xiaoyun Yang , Sarah E. Coupland , Yalin Zheng

While Multiple Instance Learning (MIL) has shown promising results in digital Pathology Whole Slide Image (WSI) classification, such a paradigm still faces performance and generalization problems due to challenges in high computational…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Honglin Li , Chenglu Zhu , Yunlong Zhang , Yuxuan Sun , Zhongyi Shui , Wenwei Kuang , Sunyi Zheng , Lin Yang

Multimodal survival methods combining gigapixel histology whole-slide images (WSIs) and transcriptomic profiles are particularly promising for patient prognostication and stratification. Current approaches involve tokenizing the WSIs into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Andrew H. Song , Richard J. Chen , Guillaume Jaume , Anurag J. Vaidya , Alexander S. Baras , Faisal Mahmood

Multiple Instance Learning (MIL) methods allow for gigapixel Whole-Slide Image (WSI) analysis with only slide-level annotations. Interpretability is crucial for safely deploying such algorithms in high-stakes medical domains. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Susu Sun , Leslie Tessier , Frédérique Meeuwsen , Clément Grisi , Dominique van Midden , Geert Litjens , Christian F. Baumgartner

Foundation models for computational pathology are expected to facilitate the development of high-performing, generalisable deep learning systems. However, in addition to biologically relevant features, current foundation models also capture…

Digital pathology has advanced significantly over the last decade, with Whole Slide Images (WSIs) encompassing vast amounts of data essential for accurate disease diagnosis. High-resolution WSIs are essential for precise diagnosis but…

Image and Video Processing · Electrical Eng. & Systems 2024-08-28 Xuan Xu , Saarthak Kapse , Prateek Prasanna

Purpose: In this work, we present a collaboration to create a validation dataset of pathologist annotations for algorithms that process whole slide images (WSIs). We focus on data collection and evaluation of algorithm performance in the…

Pathology foundation models (PFMs) have emerged as powerful tools for analyzing whole slide images (WSIs). However, adapting these pretrained PFMs for specific clinical tasks presents considerable challenges, primarily due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Neeraj Kumar , Swaraj Nanda , Siddharth Singi , Jamal Benhamida , David Kim , Jie-Fu Chen , Amir Momeni-Boroujeni , Gregory M. Goldgof , Gabriele Campanella , Chad Vanderbilt