English

OpenGraph: Towards Open Graph Foundation Models

Machine Learning 2024-10-10 v4 Artificial Intelligence Social and Information Networks

Abstract

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving performance in tasks like link prediction and node classification. However, a key challenge remains: the difficulty of generalizing to unseen graph data with different properties. In this work, we propose a novel graph foundation model, called OpenGraph, to address this challenge. Our approach tackles several technical obstacles. Firstly, we enhance data augmentation using a large language model (LLM) to overcome data scarcity in real-world scenarios. Secondly, we introduce a unified graph tokenizer that enables the model to generalize effectively to diverse graph data, even when encountering unseen properties during training. Thirdly, our developed scalable graph transformer captures node-wise dependencies within the global topological context. Extensive experiments validate the effectiveness of our framework. By adapting OpenGraph to new graph characteristics and comprehending diverse graphs, our approach achieves remarkable zero-shot graph learning performance across various settings. We release the model implementation at https://github.com/HKUDS/OpenGraph.

Keywords

Cite

@article{arxiv.2403.01121,
  title  = {OpenGraph: Towards Open Graph Foundation Models},
  author = {Lianghao Xia and Ben Kao and Chao Huang},
  journal= {arXiv preprint arXiv:2403.01121},
  year   = {2024}
}

Comments

Accepted by EMNLP'2024

R2 v1 2026-06-28T15:06:57.134Z