English
Related papers

Related papers: GraphTranslator: Aligning Graph Model to Large Lan…

200 papers

Large Language Models (LLMs) have achieved impressive performance in text understanding and have become an essential tool for building smart assistants. Originally focusing on text, they have been enhanced with multimodal capabilities in…

Software Engineering · Computer Science 2024-10-24 Aaron Haag , Vlad Argatu , Oliver Lohse

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang

Large Language Models (LLMs) have achieved great success in various reasoning tasks. In this work, we focus on the graph reasoning ability of LLMs. Although theoretical studies proved that LLMs are capable of handling graph reasoning tasks,…

Computation and Language · Computer Science 2025-01-09 Xinnan Dai , Qihao Wen , Yifei Shen , Hongzhi Wen , Dongsheng Li , Jiliang Tang , Caihua Shan

Graph mining is an important area in data mining and machine learning that involves extracting valuable information from graph-structured data. In recent years, significant progress has been made in this field through the development of…

Machine Learning · Computer Science 2024-12-30 Yuxin You , Zhen Liu , Xiangchao Wen , Yongtao Zhang , Wei Ai

Recent research on integrating Large Language Models (LLMs) with Graph Neural Networks (GNNs) typically follows two approaches: LLM-centered models, which convert graph data into tokens for LLM processing, and GNN-centered models, which use…

Machine Learning · Computer Science 2024-12-11 Haotong Yang , Xiyuan Wang , Qian Tao , Shuxian Hu , Zhouchen Lin , Muhan Zhang

Large Language Models (LLMs) have demonstrated remarkable generalization and instruction-following capabilities with instruction tuning. The advancements in LLMs and instruction tuning have led to the development of Large Vision-Language…

Machine Learning · Computer Science 2024-11-05 Jinyoung Park , Minseong Bae , Dohwan Ko , Hyunwoo J. Kim

Large Language Models (LLMs) have recently driven significant advancements in Natural Language Processing and various other applications. While a broad range of literature has explored the graph-reasoning capabilities of LLMs, including…

Computation and Language · Computer Science 2025-06-09 Shenyang Huang , Ali Parviz , Emma Kondrup , Zachary Yang , Zifeng Ding , Michael Bronstein , Reihaneh Rabbany , Guillaume Rabusseau

Graph Databases (Graph DB) find extensive application across diverse domains such as finance, social networks, and medicine. Yet, the translation of Natural Language (NL) into the Graph Query Language (GQL), referred to as NL2GQL, poses…

Computation and Language · Computer Science 2024-09-06 Yuanyuan Liang , Keren Tan , Tingyu Xie , Wenbiao Tao , Siyuan Wang , Yunshi Lan , Weining Qian

Benchmarking the capabilities and limitations of large language models (LLMs) in graph-related tasks is becoming an increasingly popular and crucial area of research. Recent studies have shown that LLMs exhibit a preliminary ability to…

Machine Learning · Computer Science 2025-04-22 Xinnan Dai , Haohao Qu , Yifen Shen , Bohang Zhang , Qihao Wen , Wenqi Fan , Dongsheng Li , Jiliang Tang , Caihua Shan

Large Language Models (LLMs) have achieved remarkable success across various domains. However, they still face significant challenges, including high computational costs for training and limitations in solving complex reasoning problems.…

Machine Learning · Computer Science 2025-05-20 Hang Gao , Chenhao Zhang , Tie Wang , Junsuo Zhao , Fengge Wu , Changwen Zheng , Huaping Liu

Recent work has shown the capability of Large Language Models (LLMs) to solve tasks related to Knowledge Graphs, such as Knowledge Graph Completion, even in Zero- or Few-Shot paradigms. However, they are known to hallucinate answers, or…

Computation and Language · Computer Science 2024-07-19 Vasile Ionut Remus Iga , Gheorghe Cosmin Silaghi

The emergence of large-scale pre-trained language models has revolutionized various AI research domains. Transformers-based Large Language Models (LLMs) have gradually replaced CNNs and RNNs to unify fields of computer vision and natural…

Computation and Language · Computer Science 2024-02-07 Ruosong Ye , Caiqi Zhang , Runhui Wang , Shuyuan Xu , Yongfeng Zhang

The advancement of Large Language Models (LLMs) has remarkably pushed the boundaries towards artificial general intelligence (AGI), with their exceptional ability on understanding diverse types of information, including but not limited to…

Computation and Language · Computer Science 2023-10-10 Ziwei Chai , Tianjie Zhang , Liang Wu , Kaiqiao Han , Xiaohai Hu , Xuanwen Huang , Yang Yang

Recent research has explored the use of Large Language Models (LLMs) for tackling complex graph reasoning tasks. However, due to the intricacies of graph structures and the inherent limitations of LLMs in handling long text, current…

Artificial Intelligence · Computer Science 2025-11-26 Yuwei Hu , Runlin Lei , Xinyi Huang , Zhewei Wei , Yongchao Liu

Graph-structured data are the commonly used and have wide application scenarios in the real world. For these diverse applications, the vast variety of learning tasks, graph domains, and complex graph learning procedures present challenges…

Machine Learning · Computer Science 2024-02-26 Lanning Wei , Jun Gao , Huan Zhao , Quanming Yao

The need to analyze graphs is ubiquitous across various fields, from social networks to biological research and recommendation systems. Therefore, enabling the ability of large language models (LLMs) to process graphs is an important step…

Computation and Language · Computer Science 2025-11-04 Xin Li , Weize Chen , Qizhi Chu , Haopeng Li , Zhaojun Sun , Ran Li , Chen Qian , Yiwei Wei , Zhiyuan Liu , Chuan Shi , Maosong Sun , Cheng Yang

With the rise of large language models (LLMs), there has been growing interest in Graph Foundation Models (GFMs) for graph-based tasks. By leveraging LLMs as predictors, GFMs have demonstrated impressive generalizability across various…

Machine Learning · Computer Science 2025-03-06 Runlin Lei , Jiarui Ji , Haipeng Ding , Lu Yi , Zhewei Wei , Yongchao Liu , Chuntao Hong

With the increasing prevalence of cross-domain Text-Attributed Graph (TAG) Data (e.g., citation networks, recommendation systems, social networks, and ai4science), the integration of Graph Neural Networks (GNNs) and Large Language Models…

Machine Learning · Computer Science 2024-12-18 Xunkai Li , Zhengyu Wu , Jiayi Wu , Hanwen Cui , Jishuo Jia , Rong-Hua Li , Guoren Wang

Large language models (LLMs) are increasingly adopted for a variety of tasks with implicit graphical structures, such as planning in robotics, multi-hop question answering or knowledge probing, structured commonsense reasoning, and more.…

Computation and Language · Computer Science 2024-01-09 Heng Wang , Shangbin Feng , Tianxing He , Zhaoxuan Tan , Xiaochuang Han , Yulia Tsvetkov

Large language models (LLMs) are increasingly used to complete complex tasks by selecting and coordinating external tools across multiple steps. This requires aligning tool choices with subtask intent while satisfying directional execution…

Machine Learning · Computer Science 2026-05-13 Xinyi Gao , Xinyu Ren , Junliang Yu , Tong Chen , Quoc Viet Hung Nguyen , Hongzhi Yin