English
Related papers

Related papers: LLM as GNN: Graph Vocabulary Learning for Text-Att…

200 papers

Graph foundation models (GFM) aim to acquire transferable knowledge by pre-training on diverse graphs, which can be adapted to various downstream tasks. However, domain shift in graphs is inherently two-dimensional: graphs differ not only…

Computation and Language · Computer Science 2026-03-12 Xingtong Yu , Shenghua Ye , Ruijuan Liang , Chang Zhou , Hong Cheng , Xinming Zhang , Yuan Fang

Dynamic graphs are ubiquitous in real-world systems, and building generalizable dynamic Graph Foundation Models has become a frontier in graph learning. However, dynamic graphs from different domains pose fundamental challenges to unified…

Machine Learning · Computer Science 2026-05-14 Haonan Yuan , Qingyun Sun , Junhua Shi , Xingcheng Fu , Jianxin Li , Philip S. Yu

Graph Neural Networks (GNNs) have revolutionized the field of graph learning by learning expressive graph representations from massive graph data. As a common pattern to train powerful GNNs, the "pre-training, adaptation" scheme first…

Machine Learning · Computer Science 2025-10-28 Xingbo Fu , Zhenyu Lei , Zihan Chen , Binchi Zhang , Chuxu Zhang , Jundong Li

With the rapid development of Large Language Models (LLMs), various explorations have arisen to utilize LLMs capability of context understanding on recommender systems. While pioneering strategies have primarily transformed traditional…

Information Retrieval · Computer Science 2024-02-27 Naicheng Guo , Hongwei Cheng , Qianqiao Liang , Linxun Chen , Bing Han

The advancement of Large Language Models (LLMs) has remarkably pushed the boundaries towards artificial general intelligence (AGI), with their exceptional ability on understanding diverse types of information, including but not limited to…

Computation and Language · Computer Science 2023-10-10 Ziwei Chai , Tianjie Zhang , Liang Wu , Kaiqiao Han , Xiaohai Hu , Xuanwen Huang , Yang Yang

The era of foundation models has revolutionized AI research, yet Graph Foundation Models (GFMs) remain constrained by the scarcity of large-scale graph corpora. Traditional graph data synthesis techniques primarily focus on simplistic…

Machine Learning · Computer Science 2025-05-06 Enjun Du , Xunkai Li , Tian Jin , Zhihan Zhang , Rong-Hua Li , Guoren Wang

Graph Continual Learning (GCL) aims to solve the challenges of streaming graph data. However, current methods often depend on replay-based strategies, which raise concerns like memory limits and privacy issues, while also struggling to…

Machine Learning · Computer Science 2026-02-10 Jingtao Liu , Xinming Zhang

Urban transportation systems encounter diverse challenges across multiple tasks, such as traffic forecasting, electric vehicle (EV) charging demand prediction, and taxi dispatch. Existing approaches suffer from two key limitations:…

Computation and Language · Computer Science 2025-08-21 Jiaming Leng , Yunying Bi , Chuan Qin , Bing Yin , Yanyong Zhang , Chao Wang

The foundation model has heralded a new era in artificial intelligence, pretraining a single model to offer cross-domain transferability on different datasets. Graph neural networks excel at learning graph data, the omnipresent…

Machine Learning · Computer Science 2025-04-09 Li Sun , Zhenhao Huang , Suyang Zhou , Qiqi Wan , Hao Peng , Philip Yu

Recently, ''pre-training and fine-tuning'' has been adopted as a standard workflow for many graph tasks since it can take general graph knowledge to relieve the lack of graph annotations from each application. However, graph tasks with node…

Social and Information Networks · Computer Science 2023-12-19 Xiangguo Sun , Hong Cheng , Jia Li , Bo Liu , Jihong Guan

Textual Attribute Graphs (TAGs) are critical for modeling complex networks like citation networks, but effective node classification remains challenging due to difficulties in integrating rich semantics from text with structural graph…

Machine Learning · Computer Science 2025-08-11 Rituparna Datta , Nibir Chandra Mandal

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving…

Machine Learning · Computer Science 2024-10-10 Lianghao Xia , Ben Kao , Chao Huang

Large Language Models (LLMs) exhibit strong In-Context Learning (ICL) capabilities when prompts with demonstrations are used. However, fine-tuning still remains crucial to further enhance their adaptability. Prompt-based fine-tuning proves…

Computation and Language · Computer Science 2024-06-10 Shuzhou Yuan , Ercong Nie , Michael Färber , Helmut Schmid , Hinrich Schütze

Graph Neural Networks (GNNs) have become a pivotal framework for modeling graph-structured data, enabling a wide range of applications from social network analysis to molecular chemistry. By integrating large language models (LLMs),…

Machine Learning · Computer Science 2025-10-15 Bowen Fan , Zhilin Guo , Xunkai Li , Yihan Zhou , Bing Zhou , Zhenjun Li , Rong-Hua Li , Guoren Wang

Exploring the application of large language models (LLMs) to graph learning is a emerging endeavor. However, the vast amount of information inherent in large graphs poses significant challenges to this process. This work focuses on the link…

Computation and Language · Computer Science 2024-02-21 Baolong Bi , Shenghua Liu , Yiwei Wang , Lingrui Mei , Xueqi Cheng

Graph Neural Networks (GNNs) have emerged as powerful models for learning from graph-structured data. However, GNNs lack the inherent semantic understanding capability of rich textual node attributes, limiting their effectiveness in…

Artificial Intelligence · Computer Science 2025-09-04 Hanqi Duan , Yao Cheng , Jianxiang Yu , Yao Liu , Xiang Li

Large language models (LLMs) facilitate the development of autonomous agents. As a core component of such agents, task planning aims to decompose complex natural language requests into concrete, solvable sub-tasks. Since LLM-generated plans…

Machine Learning · Computer Science 2026-03-18 Yu Hao , Qiuyu Wang , Cheng Yang , Yawen Li , Zhiqiang Zhang , Chuan Shi

The integration of Large Language Models (LLMs) with Graph Representation Learning (GRL) marks a significant evolution in analyzing complex data structures. This collaboration harnesses the sophisticated linguistic capabilities of LLMs to…

Machine Learning · Computer Science 2024-02-12 Qiheng Mao , Zemin Liu , Chenghao Liu , Zhuo Li , Jianling Sun

Graphs are data structures used to represent irregular networks and are prevalent in numerous real-world applications. Previous methods directly model graph structures and achieve significant success. However, these methods encounter…

Machine Learning · Computer Science 2025-01-03 Shuo Yu , Yingbo Wang , Ruolin Li , Guchun Liu , Yanming Shen , Shaoxiong Ji , Bowen Li , Fengling Han , Xiuzhen Zhang , Feng Xia

In the realm of Text-attributed Graphs (TAGs), traditional graph neural networks (GNNs) often fall short due to the complex textual information associated with each node. Recent methods have improved node representations by leveraging large…

Machine Learning · Computer Science 2025-06-10 Huanyi Xie , Lijie Hu , Lu Yu , Tianhao Huang , Longfei Li , Meng Li , Jun Zhou , Huan Wang , Di Wang