English
Related papers

Related papers: Inductive Graph Alignment Prompt: Bridging the Gap…

200 papers

Graph neural networks (GNNs) and heterogeneous graph neural networks (HGNNs) are prominent techniques for homogeneous and heterogeneous graph representation learning, yet their performance in an end-to-end supervised framework greatly…

Machine Learning · Computer Science 2024-08-27 Xingtong Yu , Yuan Fang , Zemin Liu , Xinming Zhang

Graphs can inherently model interconnected objects on the Web, thereby facilitating a series of Web applications, such as web analyzing and content recommendation. Recently, Graph Neural Networks (GNNs) have emerged as a mainstream…

Computation and Language · Computer Science 2024-08-27 Xingtong Yu , Chang Zhou , Yuan Fang , Xinming Zhang

In recent years, graph prompting has emerged as a promising research direction, enabling the learning of additional tokens or subgraphs appended to the original graphs without requiring retraining of pre-trained graph models across various…

Machine Learning · Computer Science 2025-05-28 Qunzhong Wang , Xiangguo Sun , Hong Cheng

Graph neural networks stand as the predominant technique for graph representation learning owing to their strong expressive power, yet the performance highly depends on the availability of high-quality labels in an end-to-end manner. Thus…

Machine Learning · Computer Science 2024-11-27 Jiazheng Li , Jundong Li , Chuxu Zhang

Graph In-Context Learning, with the ability to adapt pre-trained graph models to novel and diverse downstream graphs without updating any parameters, has gained much attention in the community. The key to graph in-context learning is to…

Machine Learning · Computer Science 2025-05-06 Rui Lv , Zaixi Zhang , Kai Zhang , Qi Liu , Weibo Gao , Jiawei Liu , Jiaxia Yan , Linan Yue , Fangzhou Yao

Graph neural networks (GNNs) are widely applied in graph data modeling. However, existing GNNs are often trained in a task-driven manner that fails to fully capture the intrinsic nature of the graph structure, resulting in sub-optimal node…

Machine Learning · Computer Science 2024-07-17 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra

The pre-training and fine-tuning methods have gained widespread attention in the field of heterogeneous graph neural networks due to their ability to leverage large amounts of unlabeled data during the pre-training phase, allowing the model…

Machine Learning · Computer Science 2025-07-11 Pengfei Jiao , Jialong Ni , Di Jin , Xuan Guo , Huan Liu , Hongjiang Chen , Yanxian Bi

Dynamic graphs capture evolving interactions between entities, such as in social networks, online learning platforms, and crowdsourcing projects. For dynamic graph modeling, dynamic graph neural networks (DGNNs) have emerged as a mainstream…

Machine Learning · Computer Science 2025-03-04 Xingtong Yu , Zhenghao Liu , Xinming Zhang , Yuan Fang

Temporal Interaction Graphs (TIGs) are widely utilized to represent real-world systems. To facilitate representation learning on TIGs, researchers have proposed a series of TIG models. However, these models are still facing two tough gaps…

Artificial Intelligence · Computer Science 2024-03-07 Xi Chen , Siwei Zhang , Yun Xiong , Xixi Wu , Jiawei Zhang , Xiangguo Sun , Yao Zhang , Feng Zhao , Yulin Kang

The ``pre-train, prompt" paradigm, designed to bridge the gap between pre-training tasks and downstream objectives, has been extended from the NLP domain to the graph domain and has achieved remarkable progress. Current mainstream graph…

Computation and Language · Computer Science 2026-01-27 Ziyu Zheng , Yaming Yang , Ziyu Guan , Wei Zhao , Xinyan Huang , Weigang Lu

The advent of the "pre-train, prompt" paradigm has recently extended its generalization ability and data efficiency to graph representation learning, following its achievements in Natural Language Processing (NLP). Initial graph prompt…

Machine Learning · Computer Science 2025-01-20 Jiapeng Zhu , Zichen Ding , Jianxiang Yu , Jiaqi Tan , Xiang Li , Weining Qian

Graph Neural Networks (GNNs) have achieved remarkable success in various graph-based tasks (e.g., node classification or link prediction). Despite their triumphs, GNNs still face challenges such as long training and inference times,…

Machine Learning · Computer Science 2025-07-15 Chu-Yuan Wei , Shun-Yao Liu , Sheng-Da Zhuo , Chang-Dong Wang , Shu-Qiang Huang , Mohsen Guizani

Prompt tuning methods for Graph Neural Networks (GNNs) have become popular to address the semantic gap between pre-training and fine-tuning steps. However, existing GNN prompting methods rely on labeled data and involve lightweight…

Machine Learning · Computer Science 2025-05-23 Peyman Baghershahi , Sourav Medya

Pretraining has been widely explored to augment the adaptability of graph learning models to transfer knowledge from large datasets to a downstream task, such as link prediction or classification. However, the gap between training…

Information Retrieval · Computer Science 2024-03-29 Mingdai Yang , Zhiwei Liu , Liangwei Yang , Xiaolong Liu , Chen Wang , Hao Peng , Philip S. Yu

Incremental learning aims to overcome catastrophic forgetting when learning deep networks from sequential tasks. With impressive learning efficiency and performance, prompt-based methods adopt a fixed backbone to sequential tasks by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yu-Ming Tang , Yi-Xing Peng , Wei-Shi Zheng

In recent years, graph prompt learning/tuning has garnered increasing attention in adapting pre-trained models for graph representation learning. As a kind of universal graph prompt learning method, Graph Prompt Feature (GPF) has achieved…

Machine Learning · Computer Science 2024-06-18 Bo Jiang , Hao Wu , Ziyan Zhang , Beibei Wang , Jin Tang

Recently, graph neural networks (GNNs) have been shown powerful capacity at modeling structural data. However, when adapted to downstream tasks, it usually requires abundant task-specific labeled data, which can be extremely scarce in…

Machine Learning · Computer Science 2022-03-04 Yupeng Hou , Binbin Hu , Wayne Xin Zhao , Zhiqiang Zhang , Jun Zhou , Ji-Rong Wen

Pre-training on graph neural networks (GNNs) aims to learn transferable knowledge for downstream tasks with unlabeled data, and it has recently become an active research area. The success of graph pre-training models is often attributed to…

Machine Learning · Computer Science 2023-11-22 Jiarong Xu , Renhong Huang , Xin Jiang , Yuxuan Cao , Carl Yang , Chunping Wang , Yang Yang

In-context learning is the ability of a pretrained model to adapt to novel and diverse downstream tasks by conditioning on prompt examples, without optimizing any parameters. While large language models have demonstrated this ability, how…

Machine Learning · Computer Science 2023-05-23 Qian Huang , Hongyu Ren , Peng Chen , Gregor Kržmanc , Daniel Zeng , Percy Liang , Jure Leskovec

Graph Neural Networks (GNNs) are powerful in learning semantics of graph data. Recently, a new paradigm "pre-train and prompt" has shown promising results in adapting GNNs to various tasks with less supervised data. The success of such…

Machine Learning · Computer Science 2024-06-04 Qingqing Ge , Zeyuan Zhao , Yiding Liu , Anfeng Cheng , Xiang Li , Shuaiqiang Wang , Dawei Yin