English

Whole Slide Images are 2D Point Clouds: Context-Aware Survival Prediction using Patch-based Graph Convolutional Networks

Image and Video Processing 2021-07-29 v1 Computer Vision and Pattern Recognition Tissues and Organs

Abstract

Cancer prognostication is a challenging task in computational pathology that requires context-aware representations of histology features to adequately infer patient survival. Despite the advancements made in weakly-supervised deep learning, many approaches are not context-aware and are unable to model important morphological feature interactions between cell identities and tissue types that are prognostic for patient survival. In this work, we present Patch-GCN, a context-aware, spatially-resolved patch-based graph convolutional network that hierarchically aggregates instance-level histology features to model local- and global-level topological structures in the tumor microenvironment. We validate Patch-GCN with 4,370 gigapixel WSIs across five different cancer types from the Cancer Genome Atlas (TCGA), and demonstrate that Patch-GCN outperforms all prior weakly-supervised approaches by 3.58-9.46%. Our code and corresponding models are publicly available at https://github.com/mahmoodlab/Patch-GCN.

Keywords

Cite

@article{arxiv.2107.13048,
  title  = {Whole Slide Images are 2D Point Clouds: Context-Aware Survival Prediction using Patch-based Graph Convolutional Networks},
  author = {Richard J. Chen and Ming Y. Lu and Muhammad Shaban and Chengkuan Chen and Tiffany Y. Chen and Drew F. K. Williamson and Faisal Mahmood},
  journal= {arXiv preprint arXiv:2107.13048},
  year   = {2021}
}

Comments

MICCAI 2021

R2 v1 2026-06-24T04:34:38.375Z