English
Related papers

Related papers: Evaluating Large Language Models on Graphs: Perfor…

200 papers

Large language models (LLMs) are being increasingly explored for graph tasks. Despite their remarkable success in text-based tasks, LLMs' capabilities in understanding explicit graph structures remain limited, particularly with large…

Machine Learning · Computer Science 2024-10-31 Sambhav Khurana , Xiner Li , Shurui Gui , Shuiwang Ji

Pretrained Large Language Models (LLMs) have demonstrated various reasoning capabilities through language-based prompts alone, particularly in unstructured task settings (tasks purely based on language semantics). However, LLMs often…

Computation and Language · Computer Science 2024-08-30 Palaash Agrawal , Shavak Vasania , Cheston Tan

The remarkable success of large language models (LLMs) has motivated researchers to adapt them as universal predictors for various graph tasks. As a widely recognized paradigm, Graph-Tokenizing LLMs (GTokenLLMs) compress complex graph data…

Computation and Language · Computer Science 2026-05-06 Zhongjian Zhang , Yue Yu , Mengmei Zhang , Junping Du , Xiao Wang , Chuan Shi

Recent work has shown the capability of Large Language Models (LLMs) to solve tasks related to Knowledge Graphs, such as Knowledge Graph Completion, even in Zero- or Few-Shot paradigms. However, they are known to hallucinate answers, or…

Computation and Language · Computer Science 2024-07-19 Vasile Ionut Remus Iga , Gheorghe Cosmin Silaghi

Natural language is a powerful complementary modality of communication for data visualizations, such as bar and line charts. To facilitate chart-based reasoning using natural language, various downstream tasks have been introduced recently…

Computation and Language · Computer Science 2024-10-07 Mohammed Saidul Islam , Raian Rahman , Ahmed Masry , Md Tahmid Rahman Laskar , Mir Tafseer Nayeem , Enamul Hoque

Existing benchmarks like NLGraph and GraphQA evaluate LLMs on graphs by focusing mainly on pairwise relationships, overlooking the high-order correlations found in real-world data. Hypergraphs, which can model complex beyond-pairwise…

Artificial Intelligence · Computer Science 2024-10-17 Yifan Feng , Chengwu Yang , Xingliang Hou , Shaoyi Du , Shihui Ying , Zongze Wu , Yue Gao

Large Language Models (LLMs) have demonstrated remarkable performance on a wide range of Natural Language Processing (NLP) tasks, often matching or even beating state-of-the-art task-specific models. This study aims at assessing the…

Computation and Language · Computer Science 2023-10-16 Ethan Callanan , Amarachi Mbakwe , Antony Papadimitriou , Yulong Pei , Mathieu Sibue , Xiaodan Zhu , Zhiqiang Ma , Xiaomo Liu , Sameena Shah

Large Language Models (LLMs) have made remarkable strides in reasoning tasks, yet their performance often falters on novel and complex problems. Domain-specific continued pretraining (CPT) methods, such as those tailored for mathematical…

Artificial Intelligence · Computer Science 2025-07-24 Qifan Zhang , Nuo Chen , Zehua Li , Miao Peng , Jing Tang , Jia Li

Large Language Models (LLMs) face significant limitations when applied to large-scale graphs, struggling with context constraints and inflexible reasoning. We present GraphChain, a framework that enables LLMs to analyze complex graphs…

Artificial Intelligence · Computer Science 2025-11-11 Chunyu Wei , Wenji Hu , Xingjia Hao , Xin Wang , Yifan Yang , Yueguo Chen , Yang Tian , Yunhai Wang

Graph Neural Networks (GNNs) have empowered the advance in graph-structured data analysis. Recently, the rise of Large Language Models (LLMs) like GPT-4 has heralded a new era in deep learning. However, their application to graph data poses…

Machine Learning · Computer Science 2024-04-12 Runjin Chen , Tong Zhao , Ajay Jaiswal , Neil Shah , Zhangyang Wang

Graphs are a powerful tool for representing and analyzing complex relationships in real-world applications such as social networks, recommender systems, and computational finance. Reasoning on graphs is essential for drawing inferences…

Machine Learning · Computer Science 2023-10-10 Bahare Fatemi , Jonathan Halcrow , Bryan Perozzi

Inspired by the recent advancements of Large Language Models (LLMs) in NLP tasks, there's growing interest in applying LLMs to graph-related tasks. This study delves into the capabilities of instruction-following LLMs for engaging with…

Computation and Language · Computer Science 2024-08-13 Kerui Zhu , Bo-Wei Huang , Bowen Jin , Yizhu Jiao , Ming Zhong , Kevin Chang , Shou-De Lin , Jiawei Han

The role of large language models (LLMs) in enterprise modeling has recently started to shift from academic research to that of industrial applications. Thereby, LLMs represent a further building block for the machine-supported generation…

Multiagent Systems · Computer Science 2025-01-08 Benedikt Reitemeyer , Hans-Georg Fill

Graph-structured data is prevalent in the real world. Recently, due to the powerful emergent capabilities, Large Language Models (LLMs) have shown promising performance in modeling graphs. The key to effectively applying LLMs on graphs is…

Computation and Language · Computer Science 2024-10-16 Haitong Luo , Xuying Meng , Suhang Wang , Tianxiang Zhao , Fali Wang , Hanyun Cao , Yujun Zhang

With the rapidly improving reasoning abilities of Large Language Models (LLMs), there is also a rising demand to use them in a wide variety of domains. This brings about the need to carefully evaluate the limits of the capabilities of these…

Machine Learning · Computer Science 2026-05-05 Sunil Kumar Maurya , Xin Liu

Cryptocurrencies are widely used, yet current methods for analyzing transactions often rely on opaque, black-box models. While these models may achieve high performance, their outputs are usually difficult to interpret and adapt, making it…

Cryptography and Security · Computer Science 2025-09-05 Yuchen Lei , Yuexin Xiang , Qin Wang , Rafael Dowsley , Tsz Hon Yuen , Kim-Kwang Raymond Choo , Jiangshan Yu

Large language models (LLMs) have demonstrated their strong capabilities in various domains, and have been recently integrated for graph analysis as graph language models (GLMs). With LLMs as the predictor, some GLMs can interpret unseen…

Computation and Language · Computer Science 2025-06-30 Junze Chen , Cheng Yang , Shujie Li , Zhiqiang Zhang , Yawen Li , Junping Du , Chuan Shi

Large Language Models (LLMs) have gained the ability to assimilate human knowledge and facilitate natural language interactions with both humans and other LLMs. However, despite their impressive achievements, LLMs have not made significant…

Computation and Language · Computer Science 2023-10-03 Jianan Zhao , Le Zhuo , Yikang Shen , Meng Qu , Kai Liu , Michael Bronstein , Zhaocheng Zhu , Jian Tang

Large Language Models (LLMs) have made significant progress in reasoning, demonstrating their capability to generate human-like responses. This study analyzes the problem-solving capabilities of LLMs in the domain of thermodynamics. A…

Computational Engineering, Finance, and Science · Computer Science 2025-12-18 Rebecca Loubet , Pascal Zittlau , Luisa Vollmer , Marco Hoffmann , Sophie Fellenz , Fabian Jirasek , Heike Leitte , Hans Hasse

Graph problems are fundamentally challenging for large language models (LLMs). While LLMs excel at processing unstructured text, graph tasks require reasoning over explicit structure, permutation invariance, and computationally complex…

Machine Learning · Computer Science 2026-04-23 Angelo Zangari , Peyman Baghershahi , Sourav Medya