English
Related papers

Related papers: Evaluating LLMs on Large-Scale Graph Property Esti…

200 papers

The adoption of Large Language Models (LLMs) is rapidly expanding across various tasks that involve inherent graphical structures. Graphs are integral to a wide range of applications, including motion planning for autonomous vehicles,…

Artificial Intelligence · Computer Science 2025-03-17 Piyush Gupta , Sangjae Bae , David Isele

Existing benchmarks like NLGraph and GraphQA evaluate LLMs on graphs by focusing mainly on pairwise relationships, overlooking the high-order correlations found in real-world data. Hypergraphs, which can model complex beyond-pairwise…

Artificial Intelligence · Computer Science 2024-10-17 Yifan Feng , Chengwu Yang , Xingliang Hou , Shaoyi Du , Shihui Ying , Zongze Wu , Yue Gao

In an era marked by the increasing adoption of Large Language Models (LLMs) for various tasks, there is a growing focus on exploring LLMs' capabilities in handling web data, particularly graph data. Dynamic graphs, which capture temporal…

Machine Learning · Computer Science 2024-07-09 Zeyang Zhang , Xin Wang , Ziwei Zhang , Haoyang Li , Yijian Qin , Wenwu Zhu

Large Language Models (LLMs) have demonstrated remarkable performance across various natural language processing tasks. Recently, several LLMs-based pipelines have been developed to enhance learning on graphs with text attributes,…

Machine Learning · Computer Science 2024-07-30 Kai Guo , Zewen Liu , Zhikai Chen , Hongzhi Wen , Wei Jin , Jiliang Tang , Yi Chang

In this paper, we aim to develop a large language model (LLM) with the reasoning ability on complex graph data. Currently, LLMs have achieved very impressive performance on various natural language learning tasks, extensions of which have…

Artificial Intelligence · Computer Science 2023-05-12 Jiawei Zhang

Large Language Models (LLMs) have showcased impressive reasoning capabilities, particularly when guided by specifically designed prompts in complex reasoning tasks such as math word problems. These models typically solve tasks using a…

Artificial Intelligence · Computer Science 2024-04-23 Lang Cao

Graphs, as a relational data structure, have been widely used for various application scenarios, like molecule design and recommender systems. Recently, large language models (LLMs) are reorganizing in the AI community for their expected…

Artificial Intelligence · Computer Science 2025-02-19 Dongqi Fu , Liri Fang , Zihao Li , Hanghang Tong , Vetle I. Torvik , Jingrui He

Graph plays a significant role in representing and analyzing complex relationships in real-world applications such as citation networks, social networks, and biological data. Recently, Large Language Models (LLMs), which have achieved…

Machine Learning · Computer Science 2024-04-25 Yuhan Li , Zhixun Li , Peisong Wang , Jia Li , Xiangguo Sun , Hong Cheng , Jeffrey Xu Yu

Large language models (LLMs) have achieved significant success in reasoning tasks, including mathematical reasoning and logical deduction. Among these reasoning tasks, graph problems stand out due to their complexity and unique structural…

Artificial Intelligence · Computer Science 2025-10-15 Yuyao Ge , Shenghua Liu , Baolong Bi , Yiwei Wang , Lingrui Mei , Wenjie Feng , Lizhe Chen , Xueqi Cheng

Property graphs are widely used in domains such as healthcare, finance, and social networks, but they often contain errors due to inconsistencies, missing data, or schema violations. Traditional rule-based and heuristic-driven graph repair…

Computation and Language · Computer Science 2025-07-08 Hrishikesh Terdalkar , Angela Bonifati , Andrea Mauri

Large language models (LLMs) have recently taken the world by storm. They can generate coherent text, hold meaningful conversations, and be taught concepts and basic sets of instructions - such as the steps of an algorithm. In this context,…

Human-Computer Interaction · Computer Science 2023-03-17 Sara Di Bartolomeo , Giorgio Severi , Victor Schetinger , Cody Dunne

Recommendation systems aim to provide users with relevant suggestions, but often lack interpretability and fail to capture higher-level semantic relationships between user behaviors and profiles. In this paper, we propose a novel approach…

Information Retrieval · Computer Science 2024-01-26 Yan Wang , Zhixuan Chu , Xin Ouyang , Simeng Wang , Hongyan Hao , Yue Shen , Jinjie Gu , Siqiao Xue , James Y Zhang , Qing Cui , Longfei Li , Jun Zhou , Sheng Li

Graph problems are fundamentally challenging for large language models (LLMs). While LLMs excel at processing unstructured text, graph tasks require reasoning over explicit structure, permutation invariance, and computationally complex…

Machine Learning · Computer Science 2026-04-23 Angelo Zangari , Peyman Baghershahi , Sourav Medya

Large Language Models (LLMs) have demonstrated strong capabilities in various natural language processing tasks; however, their application to graph-related problems remains limited, primarily due to scalability constraints and the absence…

Machine Learning · Computer Science 2025-05-08 Hyun Lee , Chris Yi , Maminur Islam , B. D. S. Aritra

Recent advances in test-time scaling have enabled Large Language Models (LLMs) to display sophisticated reasoning abilities via extended Chain-of-Thought (CoT) generation. Despite their potential, these Reasoning LLMs (RLMs) often…

Computation and Language · Computer Science 2025-05-21 Zhen Xiong , Yujun Cai , Zhecheng Li , Yiwei Wang

Causal reasoning capabilities are essential for large language models (LLMs) in a wide range of applications, such as education and healthcare. But there is still a lack of benchmarks for a better understanding of such capabilities. Current…

Computation and Language · Computer Science 2024-12-25 Ruibo Tu , Hedvig Kjellström , Gustav Eje Henter , Cheng Zhang

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance across diverse tasks. Despite great success, recent studies show that LVLMs encounter substantial limitations when engaging with visual graphs. To study the…

Computation and Language · Computer Science 2025-06-09 Yingjie Zhu , Xuefeng Bai , Kehai Chen , Yang Xiang , Jun Yu , Min Zhang

Large language models~(LLM) like ChatGPT have become indispensable to artificial general intelligence~(AGI), demonstrating excellent performance in various natural language processing tasks. In the real world, graph data is ubiquitous and…

Artificial Intelligence · Computer Science 2023-07-12 Jiayan Guo , Lun Du , Hengyu Liu , Mengyu Zhou , Xinyi He , Shi Han

For large language models (LLMs), reasoning over graphs could help solve many problems. Prior work has tried to improve LLM graph reasoning by examining how best to serialize graphs as text and by combining GNNs and LLMs. However, the…

Machine Learning · Computer Science 2025-08-15 Sola Shirai , Kavitha Srinivas , Julian Dolby , Michael Katz , Horst Samulowitz , Shirin Sohrabi

Large Reasoning Models (LRMs) have advanced rapidly; however, existing benchmarks in mathematics, code, and common-sense reasoning remain limited. They lack long-context evaluation, offer insufficient challenge, and provide answers that are…

Artificial Intelligence · Computer Science 2026-02-09 Qifan Zhang , Jianhao Ruan , Aochuan Chen , Kang Zeng , Nuo Chen , Jing Tang , Jia Li