English
Related papers

Related papers: A Multimodal Knowledge-enhanced Whole-slide Pathol…

200 papers

Foundation models for computational pathology have shown great promise for specimen-level tasks and are increasingly accessible to researchers. However, specimen-level models built on these foundation models remain largely unavailable,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Jakub R. Kaczmarzyk , Rishul Sharma , Peter K. Koo , Joel H. Saltz

The use of self-supervised learning (SSL) to train pathology foundation models has increased substantially in the past few years. Notably, several models trained on large quantities of clinical data have been made publicly available in…

In digital pathology, whole slide images (WSIs) are widely used for applications such as cancer diagnosis and prognosis prediction. Visual transformer models have recently emerged as a promising method for encoding large regions of WSIs…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Shuai Jiang , Liesbeth Hondelink , Arief A. Suriawinata , Saeed Hassanpour

The Cancer Genome Atlas (TCGA) has enabled novel discoveries and served as a large-scale reference dataset in cancer through its harmonized genomics, clinical, and imaging data. Numerous prior studies have developed bespoke deep learning…

Machine Learning · Computer Science 2026-05-11 Steven Song , Morgan Borjigin-Wang , Irene Madejski , Robert L. Grossman

Accurate diagnosis and treatment of complex diseases require integrating histological, molecular, and clinical data, yet in practice these modalities are often incomplete owing to tissue scarcity, assay cost, and workflow constraints.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jinxi Xiang , Mingjie Li , Siyu Hou , Yijiang Chen , Xiangde Luo , Yuanfeng Ji , Xiang Zhou , Ehsan Adeli , Akshay Chaudhari , Curtis P. Langlotz , Kilian M. Pohl , Ruijiang Li

Predicting the response of a patient to a cancer treatment is of high interest. Nonetheless, this task is still challenging from a medical point of view due to the complexity of the interaction between the patient organism and the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Bilel Guetarni , Feryal Windal , Halim Benhabiles , Mahfoud Chaibi , Romain Dubois , Emmanuelle Leteurtre , Dominique Collard

Foundation models have substantially advanced computational pathology by learning transferable visual representations from large histological datasets, yet their performance varies widely across tasks due to differences in training data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Wenhui Lei , Yusheng Tan , Anqi Li , Hanyu Chen , Hengrui Tian , Ruiying Li , Zhengqun Jiang , Fang Yan , Xiaofan Zhang , Shaoting Zhang

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

Deep Learning-based computational pathology algorithms have demonstrated profound ability to excel in a wide array of tasks that range from characterization of well known morphological phenotypes to predicting non-human-identifiable…

Image and Video Processing · Electrical Eng. & Systems 2020-09-24 Ming Y. Lu , Dehan Kong , Jana Lipkova , Richard J. Chen , Rajendra Singh , Drew F. K. Williamson , Tiffany Y. Chen , Faisal Mahmood

In digital pathology, whole-slide images (WSIs) are often difficult to handle due to their gigapixel scale, so most approaches train patch encoders via self-supervised learning (SSL) and then aggregate the patch-level embeddings via…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Myeongjang Pyeon , Janghyeon Lee , Minsoo Lee , Juseung Yun , Hwanil Choi , Jonghyun Kim , Jiwon Kim , Yi Hu , Jongseong Jang , Soonyoung Lee

Computed tomography (CT) and clinical numeric data are essential modalities for cancer evaluation, but building large-scale multimodal training datasets for developing medical foundation models remains challenging due to the structural…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Daeun Jung , Jaehyeok Jang , Sooyoung Jang , Yu Rang Park

Foundation models (FMs) have shown great promise in medical imaging, but most FMs are trained on unimodal data within isolated domains, such as brain MRI alone. Human aging and disease arise through coordinated biological processes across…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Qiangqiang Wu , Grace McIlvain , Zhou Yu , Junhao Wen

Foundation models have recently emerged as powerful feature extractors in computational pathology, yet they typically omit mechanisms for leveraging the global spatial structure of tissues and the local contextual relationships among…

Multiple instance learning is an ideal mode of analysis for histopathology data, where vast whole slide images are typically annotated with a single global label. In such cases, a whole slide image is modelled as a collection of tissue…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Leo Fillioux , Joseph Boyd , Maria Vakalopoulou , Paul-Henry Cournède , Stergios Christodoulidis

Spatial transcriptomics (ST) provides high-resolution pathological images and whole-transcriptomic expression profiles at individual spots across whole-slide scales. This setting makes it an ideal data source to develop multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yuxiang Lin , Ling Luo , Ying Chen , Xushi Zhang , Zihui Wang , Wenxian Yang , Mengsha Tong , Rongshan Yu

Digital whole-slide images of pathological tissue samples have recently become feasible for use within routine diagnostic practice. These gigapixel sized images enable pathologists to perform reviews using computer workstations instead of…

Human-Computer Interaction · Computer Science 2016-10-14 Jesper Molin , Anna Bodén , Darren Treanor , Morten Fjeld , Claes Lundström

Representation learning from Gigapixel Whole Slide Images (WSI) poses a significant challenge in computational pathology due to the complicated nature of tissue structures and the scarcity of labeled data. Multi-instance learning methods…

Image and Video Processing · Electrical Eng. & Systems 2024-05-28 Ali Nasiri-Sarvi , Vincent Quoc-Huy Trinh , Hassan Rivaz , Mahdi S. Hosseini

Diagnosing diseases through histopathology whole slide images (WSIs) is fundamental in modern pathology but is challenged by the gigapixel scale and complexity of WSIs. Trained histopathologists overcome this challenge by navigating the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Fatemeh Ghezloo , Mehmet Saygin Seyfioglu , Rustin Soraki , Wisdom O. Ikezogwo , Beibin Li , Tejoram Vivekanandan , Joann G. Elmore , Ranjay Krishna , Linda Shapiro

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

The rapidly emerging field of computational pathology has the potential to enable objective diagnosis, therapeutic response prediction and identification of new morphological features of clinical relevance. However, deep learning-based…

Image and Video Processing · Electrical Eng. & Systems 2020-05-25 Ming Y. Lu , Drew F. K. Williamson , Tiffany Y. Chen , Richard J. Chen , Matteo Barbieri , Faisal Mahmood