English

Graph Meets LLMs: Towards Large Graph Models

Machine Learning 2023-11-14 v2 Artificial Intelligence Social and Information Networks

Abstract

Large models have emerged as the most recent groundbreaking achievements in artificial intelligence, and particularly machine learning. However, when it comes to graphs, large models have not achieved the same level of success as in other fields, such as natural language processing and computer vision. In order to promote applying large models for graphs forward, we present a perspective paper to discuss the challenges and opportunities associated with developing large graph models. First, we discuss the desired characteristics of large graph models. Then, we present detailed discussions from three key perspectives: representation basis, graph data, and graph models. In each category, we provide a brief overview of recent advances and highlight the remaining challenges together with our visions. Finally, we discuss valuable applications of large graph models. We believe this perspective can encourage further investigations into large graph models, ultimately pushing us one step closer towards artificial general intelligence (AGI). We are the first to comprehensively study large graph models, to the best of our knowledge.

Keywords

Cite

@article{arxiv.2308.14522,
  title  = {Graph Meets LLMs: Towards Large Graph Models},
  author = {Ziwei Zhang and Haoyang Li and Zeyang Zhang and Yijian Qin and Xin Wang and Wenwu Zhu},
  journal= {arXiv preprint arXiv:2308.14522},
  year   = {2023}
}

Comments

Accepted by NeurIPS 2023 New Frontiers in Graph Learning Workshop. Comments are welcome

R2 v1 2026-06-28T12:06:00.257Z