English
Related papers

Related papers: Graph2text or Graph2token: A Perspective of Large …

200 papers

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

The emergence of large-scale pre-trained language models has revolutionized various AI research domains. Transformers-based Large Language Models (LLMs) have gradually replaced CNNs and RNNs to unify fields of computer vision and natural…

Computation and Language · Computer Science 2024-02-07 Ruosong Ye , Caiqi Zhang , Runhui Wang , Shuyuan Xu , Yongfeng Zhang

Graph-structured information offers rich contextual information that can enhance language models by providing structured relationships and hierarchies, leading to more expressive embeddings for various applications such as retrieval,…

Large Language Models (LLMs) for Graph Reasoning have been extensively studied over the past two years, involving enabling LLMs to understand graph structures and reason on graphs to solve various graph problems, with graph algorithm…

Artificial Intelligence · Computer Science 2025-10-03 Yuwei Hu , Xinyi Huang , Zhewei Wei , Yongchao Liu , Chuntao Hong

Large language models (LLMs) are increasingly used to complete complex tasks by selecting and coordinating external tools across multiple steps. This requires aligning tool choices with subtask intent while satisfying directional execution…

Machine Learning · Computer Science 2026-05-13 Xinyi Gao , Xinyu Ren , Junliang Yu , Tong Chen , Quoc Viet Hung Nguyen , Hongzhi Yin

Large Language Models (LLMs) have demonstrated remarkable capabilities in modeling sequential textual data and generalizing across diverse tasks. However, adapting LLMs to effectively handle structural data, such as knowledge graphs or web…

Computation and Language · Computer Science 2025-11-12 Jiarui Feng , Donghong Cai , Yixin Chen , Muhan Zhang

Large language models (LLMs) are being increasingly explored for graph tasks. Despite their remarkable success in text-based tasks, LLMs' capabilities in understanding explicit graph structures remain limited, particularly with large…

Machine Learning · Computer Science 2024-10-31 Sambhav Khurana , Xiner Li , Shurui Gui , Shuiwang Ji

The advent of Large Language Models (LLMs) has fundamentally reshaped the way we interact with graphs, giving rise to a new paradigm called GraphLLM. As revealed in recent studies, graph learning can benefit from LLMs. However, we observe…

Machine Learning · Computer Science 2026-04-21 Hongyu Zhan , Qixin Wang , Yusen Tan , Haitao Yu , Jingbo Zhou , Shuai Chen , Jia Li , Xiao Tan , Jun Xia

Large Language Models are increasingly used by students to explore advanced material in computer science, including graph theory. As these tools become integrated into undergraduate and graduate coursework, it is important to understand how…

Artificial Intelligence · Computer Science 2026-02-06 Adithya Kulkarni , Mohna Chakraborty , Jay Bagga

With the rapidly improving reasoning abilities of Large Language Models (LLMs), there is also a rising demand to use them in a wide variety of domains. This brings about the need to carefully evaluate the limits of the capabilities of these…

Machine Learning · Computer Science 2026-05-05 Sunil Kumar Maurya , Xin Liu

Graphs are a powerful tool for representing and analyzing complex relationships in real-world applications such as social networks, recommender systems, and computational finance. Reasoning on graphs is essential for drawing inferences…

Machine Learning · Computer Science 2023-10-10 Bahare Fatemi , Jonathan Halcrow , Bryan Perozzi

Large Language Models (LLMs) have achieved great success in various reasoning tasks. In this work, we focus on the graph reasoning ability of LLMs. Although theoretical studies proved that LLMs are capable of handling graph reasoning tasks,…

Computation and Language · Computer Science 2025-01-09 Xinnan Dai , Qihao Wen , Yifei Shen , Hongzhi Wen , Dongsheng Li , Jiliang Tang , Caihua Shan

In recent years, large language models (LLMs) have emerged as promising candidates for graph tasks. Many studies leverage natural language to describe graphs and apply LLMs for reasoning, yet most focus narrowly on performance benchmarks…

Machine Learning · Computer Science 2026-01-28 Yuxiang Wang , Xinnan Dai , Wenqi Fan , Yao Ma

Graph Neural Networks (GNNs) have empowered the advance in graph-structured data analysis. Recently, the rise of Large Language Models (LLMs) like GPT-4 has heralded a new era in deep learning. However, their application to graph data poses…

Machine Learning · Computer Science 2024-04-12 Runjin Chen , Tong Zhao , Ajay Jaiswal , Neil Shah , Zhangyang Wang

Heterogeneous graph neural networks (HGNNs) excel at capturing structural and semantic information in heterogeneous graphs (HGs), while struggling to generalize across domains and tasks. With the rapid advancement of large language models…

Social and Information Networks · Computer Science 2025-07-31 Jinyu Yang , Cheng Yang , Shanyuan Cui , Zeyuan Guo , Liangwei Yang , Muhan Zhang , Zhiqiang Zhang , Chuan Shi

Benchmarking the capabilities and limitations of large language models (LLMs) in graph-related tasks is becoming an increasingly popular and crucial area of research. Recent studies have shown that LLMs exhibit a preliminary ability to…

Machine Learning · Computer Science 2025-04-22 Xinnan Dai , Haohao Qu , Yifen Shen , Bohang Zhang , Qihao Wen , Wenqi Fan , Dongsheng Li , Jiliang Tang , Caihua Shan

Large language models (LLMs) have presented significant opportunities to enhance various machine learning applications, including graph neural networks (GNNs). By leveraging the vast open-world knowledge within LLMs, we can more effectively…

Machine Learning · Computer Science 2025-02-18 Yuxia Wu , Shujie Li , Yuan Fang , Chuan Shi

Graphs provide a unified representation of semantic content and relational structure, making them a natural fit for domains such as molecular modeling, citation networks, and social graphs. Meanwhile, large language models (LLMs) have…

Machine Learning · Computer Science 2026-05-04 Haotian Xu , Yuning You , Tengfei Ma

The integration of Large Language Models (LLMs) with Graph Representation Learning (GRL) marks a significant evolution in analyzing complex data structures. This collaboration harnesses the sophisticated linguistic capabilities of LLMs to…

Machine Learning · Computer Science 2024-02-12 Qiheng Mao , Zemin Liu , Chenghao Liu , Zhuo Li , Jianling Sun

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in representing and understanding diverse modalities. However, they typically focus on modality alignment in a pairwise manner while overlooking structural…

Machine Learning · Computer Science 2025-06-13 Jiajin Liu , Dongzhe Fan , Jiacheng Shen , Chuanhao Ji , Daochen Zha , Qiaoyu Tan