English
Related papers

Related papers: <SOG_k>: One LLM Token for Explicit Graph Structur…

200 papers

Graphs are ubiquitous structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. To model graph-structured data, graph neural networks (GNNs) have become a popular tool.…

Computation and Language · Computer Science 2025-02-10 Zehong Wang , Sidney Liu , Zheyuan Zhang , Tianyi Ma , Chuxu Zhang , Yanfang Ye

Large Language Models (LLMs) have demonstrated strong capabilities in various natural language processing tasks; however, their application to graph-related problems remains limited, primarily due to scalability constraints and the absence…

Machine Learning · Computer Science 2025-05-08 Hyun Lee , Chris Yi , Maminur Islam , B. D. S. Aritra

Graphs are essential for modeling complex interactions across domains such as social networks, biology, and recommendation systems. Traditional Graph Neural Networks, particularly Message Passing Neural Networks (MPNNs), rely heavily on…

Machine Learning · Computer Science 2025-06-13 Wei Li , Mengcheng Lan , Jiaxing Xu , Yiping Ke

The growing importance of textual and relational systems has driven interest in enhancing large language models (LLMs) for graph-structured data, particularly Text-Attributed Graphs (TAGs), where samples are represented by textual…

Machine Learning · Computer Science 2025-01-28 Yuanfu Sun , Zhengnan Ma , Yi Fang , Jing Ma , Qiaoyu Tan

Although large language models (LLMs) have achieved significant success in various tasks, they often struggle with hallucination problems, especially in scenarios requiring deep and responsible reasoning. These issues could be partially…

Computation and Language · Computer Science 2024-03-26 Jiashuo Sun , Chengjin Xu , Lumingyuan Tang , Saizhuo Wang , Chen Lin , Yeyun Gong , Lionel M. Ni , Heung-Yeung Shum , Jian Guo

Knowledge graph completion (KGC) aims to infer new knowledge and make predictions from knowledge graphs. Recently, large language models (LLMs) have exhibited remarkable reasoning capabilities. LLM-enhanced KGC methods primarily focus on…

Computation and Language · Computer Science 2025-09-03 Yu Liu , Yanan Cao , Xixun Lin , Yanmin Shang , Shi Wang , Shirui Pan

Heterogeneous graph neural networks (HGNNs) excel at capturing structural and semantic information in heterogeneous graphs (HGs), while struggling to generalize across domains and tasks. With the rapid advancement of large language models…

Social and Information Networks · Computer Science 2025-07-31 Jinyu Yang , Cheng Yang , Shanyuan Cui , Zeyuan Guo , Liangwei Yang , Muhan Zhang , Zhiqiang Zhang , Chuan Shi

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving…

Machine Learning · Computer Science 2024-10-10 Lianghao Xia , Ben Kao , Chao Huang

Currently, the main approach for Large Language Models (LLMs) to tackle the hallucination issue is incorporating Knowledge Graphs(KGs).However, LLMs typically treat KGs as plain text, extracting only semantic information and limiting their…

Computation and Language · Computer Science 2025-09-29 Yifang Zhang , Pengfei Duan , Yiwen Yang , Shengwu Xiong

Textual Attributed Graphs (TAGs) are crucial for modeling complex real-world systems, yet leveraging large language models (LLMs) for TAGs presents unique challenges due to the gap between sequential text processing and graph-structured…

Machine Learning · Computer Science 2025-05-09 Zhengyu Hu , Yichuan Li , Zhengyu Chen , Jingang Wang , Han Liu , Kyumin Lee , Kaize Ding

Graph representation learning, involving both node features and graph structures, is crucial for real-world applications but often encounters pervasive noise. State-of-the-art methods typically address noise by focusing separately on node…

Machine Learning · Computer Science 2024-10-17 Guangxin Su , Yifan Zhu , Wenjie Zhang , Hanchen Wang , Ying Zhang

Obtaining a single-vector representation from a Large Language Model's (LLM) token-level outputs is a critical step for nearly all sentence-level tasks. However, standard pooling methods like mean or max aggregation treat tokens as an…

Machine Learning · Computer Science 2026-03-05 Krishna Sri Ipsit Mantri , Carola-Bibiane Schönlieb , Zorah Lähner , Moshe Eliasof

Large Language Models (LLMs) have shown remarkable capabilities in processing various data structures, including graphs. While previous research has focused on developing textual encoding methods for graph representation, the emergence of…

Machine Learning · Computer Science 2024-09-16 Zhiqiang Zhong , Davide Mottin

Large language models (LLMs) have achieved impressive performance on many natural language processing tasks. However, their capabilities on graph-structured data remain relatively unexplored. In this paper, we conduct a series of…

Machine Learning · Computer Science 2023-10-10 Yuntong Hu , Zheng Zhang , Liang Zhao

Large language models (LLMs) have demonstrated impressive reasoning abilities yet remain unreliable on knowledge-intensive, multi-hop questions -- they miss long-tail facts, hallucinate when uncertain, and their internal knowledge lags…

Computation and Language · Computer Science 2025-10-13 Jia Ao Sun , Hao Yu , Fabrizio Gotti , Fengran Mo , Yihong Wu , Yuchen Hui , Jian-Yun Nie

Text-attributed graphs (TAGs) have emerged as a powerful representation for modeling complex relationships across diverse domains. With the rise of large language models (LLMs), there is growing interest in leveraging their capabilities for…

Machine Learning · Computer Science 2025-07-29 Jianyuan Bo , Hao Wu , Yuan Fang

Large Language Models (LLMs) show strong reasoning ability in open-domain question answering, yet their reasoning processes are typically linear and often logically inconsistent. In contrast, real-world reasoning requires integrating…

Computation and Language · Computer Science 2026-01-21 Yingjian Chen , Haoran Liu , Yinhong Liu , Sherry T. Tong , Aosong Feng , Jinghui Lu , Juntao Zhang , Yusuke Iwasawa , Yutaka Matsuo , Irene Li

Developments in Graph-Language Models (GLMs) aim to integrate the structural reasoning capabilities of Graph Neural Networks (GNNs) with the semantic understanding of Large Language Models (LLMs). However, we demonstrate that current…

Computation and Language · Computer Science 2025-08-29 Soham Petkar , Hari Aakash K , Anirudh Vempati , Akshit Sinha , Ponnurangam Kumarauguru , Chirag Agarwal

Graphs are a powerful tool for representing and analyzing complex relationships in real-world applications such as social networks, recommender systems, and computational finance. Reasoning on graphs is essential for drawing inferences…

Machine Learning · Computer Science 2023-10-10 Bahare Fatemi , Jonathan Halcrow , Bryan Perozzi

Combining multiple knowledge graphs (KGs) across linguistic boundaries is a persistent challenge due to semantic heterogeneity and the complexity of graph environments. We propose a framework for cross-lingual graph fusion, leveraging the…

Computation and Language · Computer Science 2026-03-24 Kaung Myat Kyaw , Khush Agarwal , Jonathan Chan