English

Empowering LLMs with Structural Role Inference for Zero-Shot Graph Learning

Graphics 2025-12-23 v2

Abstract

Large Language Models have emerged as a promising approach for graph learning due to their powerful reasoning capabilities. However, existing methods exhibit systematic performance degradation on structurally important nodes such as bridges and hubs. We identify the root cause of these limitations. Current approaches encode graph topology into static features but lack reasoning scaffolds to transform topological patterns into role-based interpretations. This limitation becomes critical in zero-shot scenarios where no training data establishes structure-semantics mappings. To address this gap, we propose DuoGLM, a training-free dual-perspective framework for structure-aware graph reasoning. The local perspective constructs relation-aware templates capturing semantic interactions between nodes and neighbors. The global perspective performs topology-to-role inference to generate functional descriptions of structural positions. These complementary perspectives provide explicit reasoning mechanisms enabling LLMs to distinguish topologically similar but semantically different nodes. Extensive experiments across eight benchmark datasets demonstrate substantial improvements. DuoGLM achieves 14.3\% accuracy gain in zero-shot node classification and 7.6\% AUC improvement in cross-domain transfer compared to existing methods. The results validate the effectiveness of explicit role reasoning for graph understanding with LLMs.

Keywords

Cite

@article{arxiv.2511.00898,
  title  = {Empowering LLMs with Structural Role Inference for Zero-Shot Graph Learning},
  author = {Heng Zhang and Jing Liu and Jiajun Wu and Haochen You and Lubin Gan and Yuling Shi and Xiaodong Gu and Zijian Zhang and Shuai Chen and Wenjun Huang and Jin Huang},
  journal= {arXiv preprint arXiv:2511.00898},
  year   = {2025}
}

Comments

This submission has been withdrawn by the authors due to a fundamental error in the methodology that affects the validity of the main results

R2 v1 2026-07-01T07:18:00.874Z