English

Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglement

Machine Learning 2025-11-17 v2 Artificial Intelligence Databases Social and Information Networks

Abstract

Recent advances in graph machine learning have shifted to data-centric paradigms, driven by two emerging fields: (1) Federated graph learning (FGL) enables multi-client collaboration but faces challenges from data and task heterogeneity, limiting its practicality; (2) Graph foundation models (GFM) offer strong domain generalization but are usually trained on single machines, missing out on cross-silo data and resources. These paradigms are complementary, and their integration brings notable benefits. Motivated by this, we propose FedGFM, a novel decentralized GFM training paradigm. However, a key challenge is knowledge entanglement, where multi-domain knowledge merges into indistinguishable representations, hindering downstream adaptation. To address this, we present FedGFM+, an enhanced framework with two core modules to reduce knowledge entanglement: (1) AncDAI: A global anchor-based domain-aware initialization strategy. Before pre-training, each client encodes its local graph into domain-specific prototypes that serve as semantic anchors. Synthetic embeddings around these anchors initialize the global model. We theoretically prove these prototypes are distinguishable across domains, providing a strong inductive bias to disentangle domain-specific knowledge. (2) AdaDPP: A local adaptive domain-sensitive prompt pool. Each client learns a lightweight graph prompt capturing domain semantics during pre-training. During fine-tuning, prompts from all clients form a pool from which the GFM selects relevant prompts to augment target graph attributes, improving downstream adaptation. FedGFM+ is evaluated on 8 diverse benchmarks across multiple domains and tasks, outperforming 20 baselines from supervised learning, FGL, and federated GFM variants.

Keywords

Cite

@article{arxiv.2505.12684,
  title  = {Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglement},
  author = {Yinlin Zhu and Xunkai Li and Jishuo Jia and Miao Hu and Di Wu and Meikang Qiu},
  journal= {arXiv preprint arXiv:2505.12684},
  year   = {2025}
}

Comments

Accepted by NeurIPS 2025

R2 v1 2026-07-01T02:20:45.204Z