English

Plug-and-Play Logit Fusion for Heterogeneous Pathology Foundation Models

Computer Vision and Pattern Recognition 2026-04-13 v2

Abstract

Pathology foundation models (FMs) have become central to computational histopathology, offering strong transfer performance across a wide range of diagnostic and prognostic tasks. The rapid proliferation of pathology foundation models creates a model-selection bottleneck: no single model is uniformly best, yet exhaustively adapting and validating many candidates for each downstream endpoint is prohibitively expensive. We address this challenge with a lightweight and novel model fusion strategy, LogitProd, which treats independently trained FM-based predictors as fixed experts and learns sample-adaptive fusion weights over their slide-level outputs. The fusion operates purely on logits, requiring no encoder retraining and no feature-space alignment across heterogeneous backbones. We further provide a theoretical analysis showing that the optimal weighted product fusion is guaranteed to perform at least as well as the best individual expert under the training objective. We systematically evaluate LogitProd on \textbf{22} benchmarks spanning WSI-level classification, tile-level classification, gene mutation prediction, and discrete-time survival modeling. LogitProd ranks first on 20/22 tasks and improves the average performance across all tasks by ~3% over the strongest single expert. LogitProd enables practitioners to upgrade heterogeneous FM-based pipelines in a plug-and-play manner, achieving multi-expert gains with \sim12×\times lower training cost than feature-fusion alternatives.

Keywords

Cite

@article{arxiv.2604.07779,
  title  = {Plug-and-Play Logit Fusion for Heterogeneous Pathology Foundation Models},
  author = {Gexin Huang and Anqi Li and Yusheng Tan and Beidi Zhao and Gang Wang and Zu-Hua Gao and Xiaoxiao Li},
  journal= {arXiv preprint arXiv:2604.07779},
  year   = {2026}
}

Comments

10 pages, 2 figures

R2 v1 2026-07-01T12:00:30.258Z