English
Related papers

Related papers: LLM as Graph Kernel: Rethinking Message Passing on…

200 papers

Session search involves a series of interactive queries and actions to fulfill user's complex information need. Current strategies typically prioritize sequential modeling for deep semantic understanding, overlooking the graph structure in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Songhao Wu , Quan Tu , Hong Liu , Jia Xu , Zhongyi Liu , Guannan Zhang , Ran Wang , Xiuying Chen , Rui Yan

Graphs are a powerful tool for representing and analyzing complex relationships in real-world applications such as social networks, recommender systems, and computational finance. Reasoning on graphs is essential for drawing inferences…

Machine Learning · Computer Science 2023-10-10 Bahare Fatemi , Jonathan Halcrow , Bryan Perozzi

Graph plays an important role in representing complex relationships in real-world applications such as social networks, biological data and citation networks. In recent years, Large Language Models (LLMs) have achieved tremendous success in…

Machine Learning · Computer Science 2024-03-19 Zheyuan Liu , Xiaoxin He , Yijun Tian , Nitesh V. Chawla

A graph is a fundamental data model to represent various entities and their complex relationships in society and nature, such as social networks, transportation networks, and financial networks. Recently, large language models (LLMs) have…

Computation and Language · Computer Science 2025-07-08 Wenbo Shang , Xin Huang

Representation learning on text-attributed graphs (TAGs) has become a critical research problem in recent years. A typical example of a TAG is a paper citation graph, where the text of each paper serves as node attributes. Initial graph…

Machine Learning · Computer Science 2024-03-08 Xiaoxin He , Xavier Bresson , Thomas Laurent , Adam Perold , Yann LeCun , Bryan Hooi

Graph problems are fundamentally challenging for large language models (LLMs). While LLMs excel at processing unstructured text, graph tasks require reasoning over explicit structure, permutation invariance, and computationally complex…

Machine Learning · Computer Science 2026-04-23 Angelo Zangari , Peyman Baghershahi , Sourav Medya

Large Language Models (LLMs) have demonstrated remarkable performance across various natural language processing tasks. Recently, several LLMs-based pipelines have been developed to enhance learning on graphs with text attributes,…

Machine Learning · Computer Science 2024-07-30 Kai Guo , Zewen Liu , Zhikai Chen , Hongzhi Wen , Wei Jin , Jiliang Tang , Yi Chang

The rapid proliferation of rumors on social networks poses a significant threat to information integrity. While rumor dissemination forms complex structural patterns, existing detection methods often fail to capture the intricate interplay…

Social and Information Networks · Computer Science 2026-03-24 Jiran Tao , Cheng Wang , Binyan Jiang

Enabling large language models (LLMs) to effectively process and reason with graph-structured data remains a significant challenge despite their remarkable success in natural language tasks. Current approaches either convert graph…

Artificial Intelligence · Computer Science 2025-09-03 Yanbiao Ji , Chang Liu , Xin Chen , Dan Luo , Mei Li , Yue Ding , Wenqing Lin , Hongtao Lu

Large language models have evolved to process multiple modalities beyond text, such as images and audio, which motivates us to explore how to effectively leverage them for graph reasoning tasks. The key question, therefore, is how to…

Large language models (LLMs) have recently been introduced to graph learning, aiming to extend their zero-shot generalization success to tasks where labeled graph data is scarce. Among these applications, inference over text-attributed…

Machine Learning · Computer Science 2025-06-10 Haoyu Wang , Shikun Liu , Rongzhe Wei , Pan Li

ChatGPT said: Text-attributed graphs, where nodes and edges contain rich textual information, are widely used across diverse domains. A central challenge in this setting is question answering, which requires jointly leveraging unstructured…

Computation and Language · Computer Science 2025-12-23 Lihui Liu

Large Language Models (LLMs) are increasingly applied to tasks involving structured inputs such as graphs. Abstract Meaning Representations (AMRs), which encode rich semantics as directed graphs, offer a rigorous testbed for evaluating LLMs…

Computation and Language · Computer Science 2025-12-11 Rafiq Kamel , Filippo Guerranti , Simon Geisler , Stephan Günnemann

Message passing is the core of most graph models such as Graph Convolutional Network (GCN) and Label Propagation (LP), which usually require a large number of clean labeled data to smooth out the neighborhood over the graph. However, the…

Machine Learning · Computer Science 2021-10-29 Wentao Zhang , Yexin Wang , Zhenbang You , Meng Cao , Ping Huang , Jiulong Shan , Zhi Yang , Bin Cui

Generating text from graph-based data, such as Abstract Meaning Representation (AMR), is a challenging task due to the inherent difficulty in how to properly encode the structure of a graph with labeled edges. To address this difficulty, we…

Computation and Language · Computer Science 2019-09-04 Leonardo F. R. Ribeiro , Claire Gardent , Iryna Gurevych

Large language models (LLMs) often struggle with knowledge-intensive tasks due to a lack of background knowledge and a tendency to hallucinate. To address these limitations, integrating knowledge graphs (KGs) with LLMs has been intensively…

Computation and Language · Computer Science 2025-06-13 Yilin Xiao , Chuang Zhou , Qinggang Zhang , Bo Li , Qing Li , Xiao Huang

Retrieval-Augmented Generation (RAG) integrates non-parametric knowledge into Large Language Models (LLMs), typically from unstructured texts and structured graphs. While recent progress has advanced text-based RAG to multi-turn reasoning…

Computation and Language · Computer Science 2025-12-11 Yucan Guo , Miao Su , Saiping Guan , Zihao Sun , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Text-attributed graphs (TAGs) present unique challenges in representation learning by requiring models to capture both the semantic richness of node-associated texts and the structural dependencies of the graph. While graph neural networks…

Computation and Language · Computer Science 2026-05-26 Azadeh Beiranvand , Seyed Mehdi Vahidipour

Graphs are an essential data structure utilized to represent relationships in real-world scenarios. Prior research has established that Graph Neural Networks (GNNs) deliver impressive outcomes in graph-centric tasks, such as link prediction…

Machine Learning · Computer Science 2024-09-12 Xubin Ren , Jiabin Tang , Dawei Yin , Nitesh Chawla , Chao Huang

The message-passing mechanism helps Graph Neural Networks (GNNs) achieve remarkable results on various node classification tasks. Nevertheless, the recursive nodes fetching and aggregation in message-passing cause inference latency when…

Machine Learning · Computer Science 2022-10-19 Jie Chen , Shouzhen Chen , Mingyuan Bai , Junbin Gao , Junping Zhang , Jian Pu