English

Generalization of Self-Supervised Vision Transformers for Protein Localization Across Microscopy Domains

Computer Vision and Pattern Recognition 2026-02-09 v2

Abstract

Task-specific microscopy datasets are often too small to train deep learning models that learn robust feature representations. Self-supervised learning (SSL) can mitigate this by pretraining on large unlabeled datasets, but it remains unclear how well such representations transfer across microscopy domains with different staining protocols and channel configurations. We investigate the cross-domain transferability of DINO-pretrained Vision Transformers for protein localization on the OpenCell dataset. We generate image embeddings using three DINO backbones pretrained on ImageNet-1k, the Human Protein Atlas (HPA), and OpenCell, and evaluate them by training a supervised classification head on OpenCell labels. All pretrained models transfer well, with the microscopy-specific HPA-pretrained model achieving the best performance (mean macro F1F_1-score = 0.8221 ±\pm 0.0062), slightly outperforming a DINO model trained directly on OpenCell (0.8057 ±\pm 0.0090). These results highlight the value of large-scale pretraining and indicate that domain-relevant SSL representations can generalize effectively to related but distinct microscopy datasets, enabling strong downstream performance even when task-specific labeled data are limited.

Keywords

Cite

@article{arxiv.2602.05527,
  title  = {Generalization of Self-Supervised Vision Transformers for Protein Localization Across Microscopy Domains},
  author = {Ben Isselmann and Dilara Göksu and Andreas Weinmann},
  journal= {arXiv preprint arXiv:2602.05527},
  year   = {2026}
}

Comments

Preprint; not yet peer reviewed. AMEE Conference Proceeding 2025, 11 pages, 2 figures

R2 v1 2026-07-01T09:37:39.080Z