English

Can LLMs Convert Graphs to Text-Attributed Graphs?

Computation and Language 2025-02-10 v2 Artificial Intelligence Machine Learning

Abstract

Graphs are ubiquitous structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. To model graph-structured data, graph neural networks (GNNs) have become a popular tool. However, existing GNN architectures encounter challenges in cross-graph learning where multiple graphs have different feature spaces. To address this, recent approaches introduce text-attributed graphs (TAGs), where each node is associated with a textual description, which can be projected into a unified feature space using textual encoders. While promising, this method relies heavily on the availability of text-attributed graph data, which is difficult to obtain in practice. To bridge this gap, we propose a novel method named Topology-Aware Node description Synthesis (TANS), leveraging large language models (LLMs) to convert existing graphs into text-attributed graphs. The key idea is to integrate topological information into LLMs to explain how graph topology influences node semantics. We evaluate our TANS on text-rich, text-limited, and text-free graphs, demonstrating its applicability. Notably, on text-free graphs, our method significantly outperforms existing approaches that manually design node features, showcasing the potential of LLMs for preprocessing graph-structured data in the absence of textual information. The code and data are available at https://github.com/Zehong-Wang/TANS.

Keywords

Cite

@article{arxiv.2412.10136,
  title  = {Can LLMs Convert Graphs to Text-Attributed Graphs?},
  author = {Zehong Wang and Sidney Liu and Zheyuan Zhang and Tianyi Ma and Chuxu Zhang and Yanfang Ye},
  journal= {arXiv preprint arXiv:2412.10136},
  year   = {2025}
}

Comments

Accepted by NAACL 25 Main Conference

R2 v1 2026-06-28T20:34:07.918Z