English
Related papers

Related papers: Graph Foundation Models: Bridging Language Model P…

200 papers

Graph-based retrieval-augmented generation (GraphRAG) exploits structured knowledge to support knowledge-intensive reasoning. However, most existing methods treat graphs as intermediate artifacts, and the few subgraph-based retrieval…

Information Retrieval · Computer Science 2026-03-10 Haonan Yuan , Qingyun Sun , Junhua Shi , Mingjun Liu , Jiaqi Yuan , Ziwei Zhang , Xingcheng Fu , Jianxin Li

In-context learning is the ability of a pretrained model to adapt to novel and diverse downstream tasks by conditioning on prompt examples, without optimizing any parameters. While large language models have demonstrated this ability, how…

Machine Learning · Computer Science 2023-05-23 Qian Huang , Hongyu Ren , Peng Chen , Gregor Kržmanc , Daniel Zeng , Percy Liang , Jure Leskovec

Large Language Models (LLMs) have revolutionized the fields of computer vision (CV) and natural language processing (NLP). One of the most notable advancements of LLMs is that a single model is trained on vast and diverse datasets spanning…

Machine Learning · Computer Science 2024-06-25 Haihong Zhao , Aochuan Chen , Xiangguo Sun , Hong Cheng , Jia Li

Representing networks as a graph and training a link prediction model using benign connections is an effective method of anomaly-based intrusion detection. Existing works using this technique have shown great success using temporal graph…

Cryptography and Security · Computer Science 2026-01-12 Isaiah J. King , Bernardo Trindade , Benjamin Bowman , H. Howie Huang

Although Large Language Models (LLMs) have demonstrated potential in processing graphs, they struggle with comprehending graphical structure information through prompts of graph description sequences, especially as the graph size increases.…

Computation and Language · Computer Science 2024-12-17 Yukun Cao , Shuo Han , Zengyi Gao , Zezhong Ding , Xike Xie , S. Kevin Zhou

Large language models (LLMs) such as GPT-4 have emerged as frontrunners, showcasing unparalleled prowess in diverse applications, including answering queries, code generation, and more. Parallelly, graph-structured data, an intrinsic data…

Artificial Intelligence · Computer Science 2023-11-14 Shirui Pan , Yizhen Zheng , Yixin Liu

The adoption of Large Language Models (LLMs) is rapidly expanding across various tasks that involve inherent graphical structures. Graphs are integral to a wide range of applications, including motion planning for autonomous vehicles,…

Artificial Intelligence · Computer Science 2025-03-17 Piyush Gupta , Sangjae Bae , David Isele

Graph-language models (GLMs) have demonstrated great potential in graph-based semi-supervised learning. A typical GLM consists of two key stages: graph generation and text embedding, which are usually implemented by inferring a latent graph…

Computation and Language · Computer Science 2025-02-24 Jianglin Lu , Yixuan Liu , Yitian Zhang , Yun Fu

Leveraging Graph Neural Networks (GNNs) as graph encoders and aligning the resulting representations with Large Language Models (LLMs) through alignment instruction tuning has become a mainstream paradigm for constructing Graph Language…

Machine Learning · Computer Science 2026-05-13 Haibo Chen , Xin Wang , Jiaheng Chao , Ling Feng , Wenwu Zhu

Aligning Large Language Models (LLMs) with human values often involves balancing multiple, conflicting objectives such as helpfulness and harmlessness. Training these models is computationally intensive, and centralizing the process raises…

Machine Learning · Computer Science 2026-03-27 Fatemeh Nourzad , Amirhossein Roknilamouki , Eylem Ekici , Jia Liu , Ness Shroff

Large Language Models (LLMs) present massive inherent knowledge and superior semantic comprehension capability, which have revolutionized various tasks in natural language processing. Despite their success, a critical gap remains in…

Computation and Language · Computer Science 2025-02-11 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng

Graph foundation models have demonstrated remarkable adaptability across diverse downstream tasks through large-scale pretraining on graphs. However, existing implementations of the backbone model, graph transformers, are typically limited…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-21 Jun-Liang Lin , Kamesh Madduri , Mahmut Taylan Kandemir

Explainable recommendation has demonstrated significant advantages in informing users about the logic behind recommendations, thereby increasing system transparency, effectiveness, and trustworthiness. To provide personalized and…

Information Retrieval · Computer Science 2025-02-19 Yuhan Li , Xinni Zhang , Linhao Luo , Heng Chang , Yuxiang Ren , Irwin King , Jia Li

Exploring the application of large language models (LLMs) to graph learning is a emerging endeavor. However, the vast amount of information inherent in large graphs poses significant challenges to this process. This work focuses on the link…

Computation and Language · Computer Science 2024-02-21 Baolong Bi , Shenghua Liu , Yiwei Wang , Lingrui Mei , Xueqi Cheng

Graph neural networks (GNNs) have been predominantly driven by message-passing, where node representations are iteratively updated via local neighborhood aggregation. Despite their success, message-passing suffers from fundamental…

Machine Learning · Computer Science 2025-12-16 Zehong Wang , Zheyuan Zhang , Tianyi Ma , Chuxu Zhang , Yanfang Ye

Recently, graph neural networks (GNNs) have been successfully applied to recommender systems. In recommender systems, the user's feedback behavior on an item is usually the result of multiple factors acting at the same time. However, a…

Information Retrieval · Computer Science 2020-07-14 Dongbo Xi , Fuzhen Zhuang , Yongchun Zhu , Pengpeng Zhao , Xiangliang Zhang , Qing He

While self-supervised graph pretraining techniques have shown promising results in various domains, their application still experiences challenges of limited topology learning, human knowledge dependency, and incompetent multi-level…

Machine Learning · Computer Science 2023-12-20 Pengwei Yan , Kaisong Song , Zhuoren Jiang , Yangyang Kang , Tianqianjin Lin , Changlong Sun , Xiaozhong Liu

Graph-structured data are the commonly used and have wide application scenarios in the real world. For these diverse applications, the vast variety of learning tasks, graph domains, and complex graph learning procedures present challenges…

Machine Learning · Computer Science 2024-02-26 Lanning Wei , Jun Gao , Huan Zhao , Quanming Yao

Large language models (LLMs), such as GPT4 and LLaMA, are creating significant advancements in natural language processing, due to their strong text encoding/decoding ability and newly found emergent capability (e.g., reasoning). While LLMs…

Computation and Language · Computer Science 2024-11-22 Bowen Jin , Gang Liu , Chi Han , Meng Jiang , Heng Ji , Jiawei Han

We present a framework of Training Free Graph Matching (TFGM) to boost the performance of Graph Neural Networks (GNNs) based graph matching, providing a fast promising solution without training (training-free). TFGM provides four widely…

Machine Learning · Computer Science 2022-02-15 Zhiyuan Liu , Yixin Cao , Fuli Feng , Xiang Wang , Jie Tang , Kenji Kawaguchi , Tat-Seng Chua