English
Related papers

Related papers: Graph Foundation Models: Bridging Language Model P…

200 papers

Graph learning has attracted significant attention due to its widespread real-world applications. Current mainstream approaches rely on text node features and obtain initial node embeddings through shallow embedding learning using GNNs,…

Artificial Intelligence · Computer Science 2025-02-13 Chuanqi Shi , Yiyi Tao , Hang Zhang , Lun Wang , Shaoshuai Du , Yixian Shen , Yanxin Shen

In recent years, large language models (LLMs) have emerged as promising candidates for graph tasks. Many studies leverage natural language to describe graphs and apply LLMs for reasoning, yet most focus narrowly on performance benchmarks…

Machine Learning · Computer Science 2026-01-28 Yuxiang Wang , Xinnan Dai , Wenqi Fan , Yao Ma

Large Language Models (LLMs) have achieved great success in various reasoning tasks. In this work, we focus on the graph reasoning ability of LLMs. Although theoretical studies proved that LLMs are capable of handling graph reasoning tasks,…

Computation and Language · Computer Science 2025-01-09 Xinnan Dai , Qihao Wen , Yifei Shen , Hongzhi Wen , Dongsheng Li , Jiliang Tang , Caihua Shan

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang

Graph neural networks (GNNs) have emerged as state-of-the-art methods to learn from graph-structured data for recommendation. However, most existing GNN-based recommendation methods focus on the optimization of model structures and learning…

Information Retrieval · Computer Science 2025-07-02 Rong Shan , Jianghao Lin , Chenxu Zhu , Bo Chen , Menghui Zhu , Kangning Zhang , Jieming Zhu , Ruiming Tang , Yong Yu , Weinan Zhang

Graph-structured data is ubiquitous in the world which models complex relationships between objects, enabling various Web applications. Daily influxes of unlabeled graph data on the Web offer immense potential for these applications. Graph…

Machine Learning · Computer Science 2024-03-12 Yun Zhu , Yaoke Wang , Haizhou Shi , Zhenshuo Zhang , Dian Jiao , Siliang Tang

Recent advances in Vision-Language Models (VLMs) have shown promising capabilities in interpreting visualized graph data, offering a new perspective for graph-structured reasoning beyond traditional Graph Neural Networks (GNNs). However,…

Artificial Intelligence · Computer Science 2026-04-27 Qihang Ai , Ruizhou Li , Menghui Wang , Haiyun Jiang

Large Language Models (LLMs) have shown strong capabilities in solving problems across domains, including graph-related tasks traditionally addressed by symbolic or algorithmic methods. In this work, we present a framework for structured…

Artificial Intelligence · Computer Science 2025-09-03 Govind Waghmare , Sumedh BG , Sonia Gupta , Srikanta Bedathur

Large Language Models are increasingly used by students to explore advanced material in computer science, including graph theory. As these tools become integrated into undergraduate and graduate coursework, it is important to understand how…

Artificial Intelligence · Computer Science 2026-02-06 Adithya Kulkarni , Mohna Chakraborty , Jay Bagga

Do current large language models (LLMs) better solve graph reasoning and generation tasks with parameter updates? In this paper, we propose InstructGraph, a framework that empowers LLMs with the abilities of graph reasoning and generation…

Computation and Language · Computer Science 2024-02-15 Jianing Wang , Junda Wu , Yupeng Hou , Yao Liu , Ming Gao , Julian McAuley

Graph neural networks (GNNs) are widely applied in graph data modeling. However, existing GNNs are often trained in a task-driven manner that fails to fully capture the intrinsic nature of the graph structure, resulting in sub-optimal node…

Machine Learning · Computer Science 2024-07-17 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra

Graph problems are fundamentally challenging for large language models (LLMs). While LLMs excel at processing unstructured text, graph tasks require reasoning over explicit structure, permutation invariance, and computationally complex…

Machine Learning · Computer Science 2026-04-23 Angelo Zangari , Peyman Baghershahi , Sourav Medya

Foundation Models (FMs) such as GPT-4 encoded with vast knowledge and powerful emergent abilities have achieved remarkable success in various natural language processing and computer vision tasks. Grounding FMs by adapting them to…

Machine Learning · Computer Science 2024-04-01 Yan Kang , Tao Fan , Hanlin Gu , Xiaojin Zhang , Lixin Fan , Qiang Yang

Multi-turn instruction following is essential for building intelligent conversational systems that can consistently adhere to instructions across dialogue turns. However, existing approaches to enhancing multi-turn instruction following…

Computation and Language · Computer Science 2026-03-26 Zhenhe Li , Can Lin , Ling Zheng , Wen-Da Wei , Junli Liang , Qi Song

Vision foundation models (FMs) have become the predominant architecture in computer vision, providing highly transferable representations learned from large-scale, multimodal corpora. Nonetheless, they exhibit persistent limitations on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Fatemeh Ziaeetabar

Large language models (LLMs) have shown promise in simulating human-like social behaviors. Social graphs provide high-quality supervision signals that encode both local interactions and global network structure, yet they remain…

Social and Information Networks · Computer Science 2026-04-14 Jiarui Ji , Zehua Zhang , Zhewei Wei , Bin Tong , Guan Wang , Bo Zheng

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, including multi-step reasoning such as mathematical proving. However, existing approaches often lack an explicit and…

Computation and Language · Computer Science 2026-05-19 Yutong Li , Yitian Zhou , Xudong Wang , GuoChen , Caiyan Qin

Large language models (LLMs) increasingly rely on external knowledge to improve factuality, yet many real-world knowledge sources are organized as heterogeneous graphs rather than plain text. Reasoning over such graphs requires models to…

Machine Learning · Computer Science 2026-05-27 Yuyang Bai , Zhuofeng Li , Ping Nie , Jianwen Xie , Yu Zhang

Graphs are mathematical tools that can be used to represent complex real-world interconnected systems, such as financial markets and social networks. Hence, machine learning (ML) over graphs has attracted significant attention recently.…

Machine Learning · Computer Science 2023-10-24 O. Deniz Kose , Yanning Shen , Gonzalo Mateos

Graphs provide a unified representation of semantic content and relational structure, making them a natural fit for domains such as molecular modeling, citation networks, and social graphs. Meanwhile, large language models (LLMs) have…

Machine Learning · Computer Science 2026-05-04 Haotian Xu , Yuning You , Tengfei Ma