English

Revisiting Pre-Propagation GNNs: Robust Diffusion Operators and Hidden-State Re-Propagation

Machine Learning 2026-05-26 v1

Abstract

Pre-propagation graph neural networks (PPGNNs) decouple node feature propagation from transformation: graph diffusion is performed once as preprocessing, and training reduces to dense per-node transformations. This design enables mini-batch training without inter-node dependencies, avoids repeated sparse matrix--matrix multiplications, and better matches modern accelerators optimized for dense compute. However, their expressivity remains unclear, and empirical results show a gap between PPGNNs and their message-passing counterparts on commonly used graph benchmarks, especially heterophilic ones. In this paper, we propose a suite of robust graph diffusion operators for preprocessing and a few-shot hidden-state re-propagation scheme during training. Our methods improve the validation and test accuracy of PPGNNs, enabling them to match the accuracy of message-passing GNNs while maintaining training efficiency.

Keywords

Cite

@article{arxiv.2605.25111,
  title  = {Revisiting Pre-Propagation GNNs: Robust Diffusion Operators and Hidden-State Re-Propagation},
  author = {Zichao Yue and Zhiru Zhang},
  journal= {arXiv preprint arXiv:2605.25111},
  year   = {2026}
}
R2 v1 2026-07-22T07:31:06.080Z