English
Related papers

Related papers: GraphPrompter: Multi-stage Adaptive Prompt Optimiz…

200 papers

Dynamic graphs have attracted increasing attention due to their ability to model complex and evolving relationships in real-world scenarios. Traditional approaches typically pre-train models using dynamic link prediction and directly apply…

Machine Learning · Computer Science 2026-01-21 Yufei Peng , Cheng Yang , Zhengjie Fan , Chuan Shi

The pre-training and fine-tuning methods have gained widespread attention in the field of heterogeneous graph neural networks due to their ability to leverage large amounts of unlabeled data during the pre-training phase, allowing the model…

Machine Learning · Computer Science 2025-07-11 Pengfei Jiao , Jialong Ni , Di Jin , Xuan Guo , Huan Liu , Hongjiang Chen , Yanxian Bi

The rapidly growing number and variety of Large Language Models (LLMs) present significant challenges in efficiently selecting the appropriate LLM for a given query, especially considering the trade-offs between performance and…

Artificial Intelligence · Computer Science 2025-03-18 Tao Feng , Yanzhen Shen , Jiaxuan You

Recent studies have shown that graph neural networks (GNNs) exhibit strong biases towards the node degree: they usually perform satisfactorily on high-degree nodes with rich neighbor information but struggle with low-degree nodes. Existing…

Machine Learning · Computer Science 2023-10-03 Mingxuan Ju , Tong Zhao , Wenhao Yu , Neil Shah , Yanfang Ye

Graph neural networks (GNNs) are widely applied in graph data modeling. However, existing GNNs are often trained in a task-driven manner that fails to fully capture the intrinsic nature of the graph structure, resulting in sub-optimal node…

Machine Learning · Computer Science 2024-07-17 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra

In recent years, graph prompting has emerged as a promising research direction, enabling the learning of additional tokens or subgraphs appended to the original graphs without requiring retraining of pre-trained graph models across various…

Machine Learning · Computer Science 2025-05-28 Qunzhong Wang , Xiangguo Sun , Hong Cheng

Text-attributed Graphs (TAGs) are commonly found in the real world, such as social networks and citation networks, and consist of nodes represented by textual descriptions. Currently, mainstream machine learning methods on TAGs involve a…

Social and Information Networks · Computer Science 2023-09-07 Xuanwen Huang , Kaiqiao Han , Dezheng Bao , Quanjin Tao , Zhisheng Zhang , Yang Yang , Qi Zhu

Recently, much exertion has been paid to design graph self-supervised methods to obtain generalized pre-trained models, and adapt pre-trained models onto downstream tasks through fine-tuning. However, there exists an inherent gap between…

Machine Learning · Computer Science 2023-08-16 Yun Zhu , Jianhao Guo , Siliang Tang

Graph prompt tuning has shown great potential in graph learning by introducing trainable prompts to enhance the model performance in conventional single-domain scenarios. Recent research has extended graph prompts to improve Graph…

Machine Learning · Computer Science 2026-05-28 Yan Jiang , Ruihong Qiu , Zi Huang

Graphs have emerged as a natural choice to represent and analyze the intricate patterns and rich information of the Web, enabling applications such as online page classification and social recommendation. The prevailing "pre-train,…

Machine Learning · Computer Science 2025-02-06 Yihong Ma , Ning Yan , Jiayu Li , Masood Mortazavi , Nitesh V. Chawla

GNN-based recommenders have excelled in modeling intricate user-item interactions through multi-hop message passing. However, existing methods often overlook the dynamic nature of evolving user-item interactions, which impedes the adaption…

Information Retrieval · Computer Science 2024-02-20 Yuhao Yang , Lianghao Xia , Da Luo , Kangyi Lin , Chao Huang

Dynamic graphs capture evolving interactions between entities, such as in social networks, online learning platforms, and crowdsourcing projects. For dynamic graph modeling, dynamic graph neural networks (DGNNs) have emerged as a mainstream…

Machine Learning · Computer Science 2025-03-04 Xingtong Yu , Zhenghao Liu , Xinming Zhang , Yuan Fang

Recently, graph prompt learning has garnered increasing attention in adapting pre-trained GNN models for downstream graph learning tasks. However, existing works generally conduct prompting over all graph elements (e.g., nodes, edges, node…

Machine Learning · Computer Science 2024-10-30 Bo Jiang , Hao Wu , Beibei Wang , Jin Tang , Bin Luo

The ``pre-train, prompt" paradigm, designed to bridge the gap between pre-training tasks and downstream objectives, has been extended from the NLP domain to the graph domain and has achieved remarkable progress. Current mainstream graph…

Computation and Language · Computer Science 2026-01-27 Ziyu Zheng , Yaming Yang , Ziyu Guan , Wei Zhao , Xinyan Huang , Weigang Lu

Prompt learning has attracted increasing attention in the graph domain as a means to bridge the gap between pretext and downstream tasks. Existing studies on heterogeneous graph prompting typically use feature prompts to modify node…

Machine Learning · Computer Science 2025-02-14 Feiyang Wang , Zhongbao Zhang , Junda Ye , Li Sun , Jianzhong Qi

The recent "pre-train, prompt, predict training" paradigm has gained popularity as a way to learn generalizable models with limited labeled data. The approach involves using a pre-trained model and a prompting function that applies a…

Machine Learning · Computer Science 2023-06-01 Xuansheng Wu , Kaixiong Zhou , Mingchen Sun , Xin Wang , Ninghao Liu

Artificial general intelligence on graphs has shown significant advancements across various applications, yet the traditional 'Pre-train & Fine-tune' paradigm faces inefficiencies and negative transfer issues, particularly in complex and…

Machine Learning · Computer Science 2024-06-21 Chenyi Zi , Haihong Zhao , Xiangguo Sun , Yiqing Lin , Hong Cheng , Jia Li

Graph plays an important role in representing complex relationships in real-world applications such as social networks, biological data and citation networks. In recent years, Large Language Models (LLMs) have achieved tremendous success in…

Machine Learning · Computer Science 2024-03-19 Zheyuan Liu , Xiaoxin He , Yijun Tian , Nitesh V. Chawla

Temporal Interaction Graphs (TIGs) are widely utilized to represent real-world systems. To facilitate representation learning on TIGs, researchers have proposed a series of TIG models. However, these models are still facing two tough gaps…

Artificial Intelligence · Computer Science 2024-03-07 Xi Chen , Siwei Zhang , Yun Xiong , Xixi Wu , Jiawei Zhang , Xiangguo Sun , Yao Zhang , Feng Zhao , Yulin Kang

This paper presents a simple and effective visual prompting method for adapting pre-trained models to downstream recognition tasks. Our method includes two key designs. First, rather than directly adding together the prompt and the image,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Junyang Wu , Xianhang Li , Chen Wei , Huiyu Wang , Alan Yuille , Yuyin Zhou , Cihang Xie