English

Knowledge-Driven Federated Graph Learning on Model Heterogeneity

Machine Learning 2026-01-01 v4 Distributed, Parallel, and Cluster Computing

Abstract

Federated graph learning (FGL) has emerged as a promising paradigm for collaborative graph representation learning, enabling multiple parties to jointly train models while preserving data privacy. However, most existing approaches assume homogeneous client models and largely overlook the challenge of model-centric heterogeneous FGL (MHtFGL), which frequently arises in practice when organizations employ graph neural networks (GNNs) of different scales and architectures.Such architectural diversity not only undermines smooth server-side aggregation, which presupposes a unified representation space shared across clients' updates, but also further complicates the transfer and integration of structural knowledge across clients. To address this issue, we propose the Federated Graph Knowledge Collaboration (FedGKC) framework. FedGKC introduces a lightweight Copilot Model on each client to facilitate knowledge exchange while local architectures are heterogeneous across clients, and employs two complementary mechanisms: Client-side Self-Mutual Knowledge Distillation, which transfers effective knowledge between local and copilot models through bidirectional distillation with multi-view perturbation; and Server-side Knowledge-Aware Model Aggregation, which dynamically assigns aggregation weights based on knowledge provided by clients. Extensive experiments on eight benchmark datasets demonstrate that FedGKC achieves an average accuracy gain of 3.88% over baselines in MHtFGL scenarios, while maintaining excellent performance in homogeneous settings.

Keywords

Cite

@article{arxiv.2501.12624,
  title  = {Knowledge-Driven Federated Graph Learning on Model Heterogeneity},
  author = {Zhengyu Wu and Guang Zeng and Huilin Lai and Daohan Su and Jishuo Jia and Yinlin Zhu and Xunkai Li and Rong-Hua Li and Guoren Wang and Chenghu Zhou},
  journal= {arXiv preprint arXiv:2501.12624},
  year   = {2026}
}
R2 v1 2026-06-28T21:13:09.552Z