English

Domain-Specific Pre-training Improves Confidence in Whole Slide Image Classification

Computer Vision and Pattern Recognition 2024-02-14 v2 Artificial Intelligence Machine Learning

Abstract

Whole Slide Images (WSIs) or histopathology images are used in digital pathology. WSIs pose great challenges to deep learning models for clinical diagnosis, owing to their size and lack of pixel-level annotations. With the recent advancements in computational pathology, newer multiple-instance learning-based models have been proposed. Multiple-instance learning for WSIs necessitates creating patches and uses the encoding of these patches for diagnosis. These models use generic pre-trained models (ResNet-50 pre-trained on ImageNet) for patch encoding. The recently proposed KimiaNet, a DenseNet121 model pre-trained on TCGA slides, is a domain-specific pre-trained model. This paper shows the effect of domain-specific pre-training on WSI classification. To investigate the effect of domain-specific pre-training, we considered the current state-of-the-art multiple-instance learning models, 1) CLAM, an attention-based model, and 2) TransMIL, a self-attention-based model, and evaluated the models' confidence and predictive performance in detecting primary brain tumors - gliomas. Domain-specific pre-training improves the confidence of the models and also achieves a new state-of-the-art performance of WSI-based glioma subtype classification, showing a high clinical applicability in assisting glioma diagnosis. We will publicly share our code and experimental results at https://github.com/soham-chitnis10/WSI-domain-specific.

Keywords

Cite

@article{arxiv.2302.09833,
  title  = {Domain-Specific Pre-training Improves Confidence in Whole Slide Image Classification},
  author = {Soham Rohit Chitnis and Sidong Liu and Tirtharaj Dash and Tanmay Tulsidas Verlekar and Antonio Di Ieva and Shlomo Berkovsky and Lovekesh Vig and Ashwin Srinivasan},
  journal= {arXiv preprint arXiv:2302.09833},
  year   = {2024}
}

Comments

Accepted in EMBC 2023

R2 v1 2026-06-28T08:44:15.651Z