English
Related papers

Related papers: Query-Aware Learnable Graph Pooling Tokens as Prom…

200 papers

Large Language Models (LLMs) have achieved impressive results in processing text data, which has sparked interest in applying these models beyond textual data, such as graphs. In the field of graph learning, there is a growing interest in…

Artificial Intelligence · Computer Science 2024-10-10 Sheng Ouyang , Yulan Hu , Ge Chen , Yong Liu

Large Language Models (LLMs) have demonstrated remarkable capabilities in many real-world applications. Nonetheless, LLMs are often criticized for their tendency to produce hallucinations, wherein the models fabricate incorrect statements…

Computation and Language · Computer Science 2024-06-05 Qinggang Zhang , Junnan Dong , Hao Chen , Daochen Zha , Zailiang Yu , Xiao Huang

Recently, the emergence of large language models (LLMs) has motivated integrating language descriptions into graphs, forming text-attributed graphs (TAGs) that enhance model encoding capabilities from a data-centric perspective. A review of…

Machine Learning · Computer Science 2026-02-03 Zhihan Zhang , Xunkai Li , Lei Zhu , Guang Zeng , Bowen Fan , Yanzhe Wen , Hongchao Qin , Rong-Hua Li , Guoren Wang

While large language models (LLMs) show great potential in temporal reasoning, most existing work focuses heavily on enhancing performance, often neglecting the explainable reasoning processes underlying the results. To address this gap, we…

Computation and Language · Computer Science 2025-05-22 Zihao Jiang , Ben Liu , Miao Peng , Wenjie Xu , Yao Xiao , Zhenyan Shan , Min Peng

Graph plays an important role in representing complex relationships in real-world applications such as social networks, biological data and citation networks. In recent years, Large Language Models (LLMs) have achieved tremendous success in…

Machine Learning · Computer Science 2024-03-19 Zheyuan Liu , Xiaoxin He , Yijun Tian , Nitesh V. Chawla

Large language models (LLMs) are increasingly used to complete complex tasks by selecting and coordinating external tools across multiple steps. This requires aligning tool choices with subtask intent while satisfying directional execution…

Machine Learning · Computer Science 2026-05-13 Xinyi Gao , Xinyu Ren , Junliang Yu , Tong Chen , Quoc Viet Hung Nguyen , Hongzhi Yin

Recent efforts leverage Large Language Models (LLMs) for modeling text-attributed graph structures in node classification tasks. These approaches describe graph structures for LLMs to understand or aggregate LLM-generated textual attribute…

Computation and Language · Computer Science 2025-05-27 Huachi Zhou , Jiahe Du , Chuang Zhou , Chang Yang , Yilin Xiao , Yuxuan Xie , Xiao Huang

Do current large language models (LLMs) better solve graph reasoning and generation tasks with parameter updates? In this paper, we propose InstructGraph, a framework that empowers LLMs with the abilities of graph reasoning and generation…

Computation and Language · Computer Science 2024-02-15 Jianing Wang , Junda Wu , Yupeng Hou , Yao Liu , Ming Gao , Julian McAuley

Large Language Models (LLMs) have made remarkable strides in reasoning tasks, yet their performance often falters on novel and complex problems. Domain-specific continued pretraining (CPT) methods, such as those tailored for mathematical…

Artificial Intelligence · Computer Science 2025-07-24 Qifan Zhang , Nuo Chen , Zehua Li , Miao Peng , Jing Tang , Jia Li

Transformer neural networks show promising capabilities, in particular for uses in materials analysis, design and manufacturing, including their capacity to work effectively with both human language, symbols, code, and numerical data. Here…

Computation and Language · Computer Science 2023-11-01 Markus J. Buehler

In this paper, we aim to develop a large language model (LLM) with the reasoning ability on complex graph data. Currently, LLMs have achieved very impressive performance on various natural language learning tasks, extensions of which have…

Artificial Intelligence · Computer Science 2023-05-12 Jiawei Zhang

Graph plays a significant role in representing and analyzing complex relationships in real-world applications such as citation networks, social networks, and biological data. Recently, Large Language Models (LLMs), which have achieved…

Machine Learning · Computer Science 2024-04-25 Yuhan Li , Zhixun Li , Peisong Wang , Jia Li , Xiangguo Sun , Hong Cheng , Jeffrey Xu Yu

Large-scale "pre-train and prompt learning" paradigms have demonstrated remarkable adaptability, enabling broad applications across diverse domains such as question answering, image recognition, and multimodal retrieval. This approach fully…

Large Language Models (LLMs) have demonstrated remarkable capabilities in modeling sequential textual data and generalizing across diverse tasks. However, adapting LLMs to effectively handle structural data, such as knowledge graphs or web…

Computation and Language · Computer Science 2025-11-12 Jiarui Feng , Donghong Cai , Yixin Chen , Muhan Zhang

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang

Graphs serve as fundamental descriptors for systems composed of interacting elements, capturing a wide array of data types, from molecular interactions to social networks and knowledge graphs. In this paper, we present an exhaustive review…

Machine Learning · Computer Science 2024-11-13 Chenqing Hua

The integration of Large Language Models (LLMs) with Graph Representation Learning (GRL) marks a significant evolution in analyzing complex data structures. This collaboration harnesses the sophisticated linguistic capabilities of LLMs to…

Machine Learning · Computer Science 2024-02-12 Qiheng Mao , Zemin Liu , Chenghao Liu , Zhuo Li , Jianling Sun

Graph Neural Networks (GNNs) have shown significant success for graph-based tasks. Motivated by the prevalence of large datasets in real-world applications, pooling layers are crucial components of GNNs. By reducing the size of input…

Machine Learning · Computer Science 2026-01-13 Katharina Limbeck , Lydia Mezrag , Guy Wolf , Bastian Rieck

Large Language Models (LLMs) have shown remarkable capabilities in processing various data structures, including graphs. While previous research has focused on developing textual encoding methods for graph representation, the emergence of…

Machine Learning · Computer Science 2024-09-16 Zhiqiang Zhong , Davide Mottin

Recent prevailing works on graph machine learning typically follow a similar methodology that involves designing advanced variants of graph neural networks (GNNs) to maintain the superior performance of GNNs on different graphs. In this…

Machine Learning · Computer Science 2024-06-07 Yiran Qiao , Xiang Ao , Yang Liu , Jiarong Xu , Xiaoqian Sun , Qing He