English
Related papers

Related papers: Instance-Aware Graph Prompt Learning

200 papers

Artificial general intelligence on graphs has shown significant advancements across various applications, yet the traditional 'Pre-train & Fine-tune' paradigm faces inefficiencies and negative transfer issues, particularly in complex and…

Machine Learning · Computer Science 2024-06-21 Chenyi Zi , Haihong Zhao , Xiangguo Sun , Yiqing Lin , Hong Cheng , Jia Li

In AI-generated image detection, current cutting-edge methods typically adapt pre-trained foundation models through partial-parameter fine-tuning. However, these approaches often struggle to generalize to forgeries from unseen generators,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Yiheng Li , Zichang Tan , Guoqing Xu , Zhen Lei , Xu Zhou , Yang Yang

Recently, ''pre-training and fine-tuning'' has been adopted as a standard workflow for many graph tasks since it can take general graph knowledge to relieve the lack of graph annotations from each application. However, graph tasks with node…

Social and Information Networks · Computer Science 2023-12-19 Xiangguo Sun , Hong Cheng , Jia Li , Bo Liu , Jihong Guan

Recent pre-trained vision-language models (PT-VLMs) often face a Multi-Domain Task Incremental Learning (MTIL) scenario in practice, where several classes and domains of multi-modal tasks are incrementally arrived. Without access to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hao Fu , Hanbin Zhao , Jiahua Dong , Henghui Ding , Chao Zhang , Hui Qian

Graph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data. However, training GNNs usually requires abundant task-specific labeled data, which is often arduously expensive to obtain. One effective…

Machine Learning · Computer Science 2020-06-30 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Kai-Wei Chang , Yizhou Sun

Text-rich graphs, which exhibit rich textual information on nodes and edges, are prevalent across a wide range of real-world business applications. Large Language Models (LLMs) have demonstrated remarkable abilities in understanding text,…

Computation and Language · Computer Science 2024-04-30 Qi Zhu , Da Zheng , Xiang Song , Shichang Zhang , Bowen Jin , Yizhou Sun , George Karypis

In this paper, we propose PLACE (Prompt Learning for Attributed Community Search), an innovative graph prompt learning framework for ACS. Enlightened by prompt-tuning in Natural Language Processing (NLP), where learnable prompt tokens are…

Information Retrieval · Computer Science 2026-05-25 Shuheng Fang , Kangfei Zhao , Rener Zhang , Yu Rong , Jeffrey Xu Yu

The advent of the "pre-train, prompt" paradigm has recently extended its generalization ability and data efficiency to graph representation learning, following its achievements in Natural Language Processing (NLP). Initial graph prompt…

Machine Learning · Computer Science 2025-01-20 Jiapeng Zhu , Zichen Ding , Jianxiang Yu , Jiaqi Tan , Xiang Li , Weining Qian

Graph Neural Networks (GNNs) have revolutionized the field of graph learning by learning expressive graph representations from massive graph data. As a common pattern to train powerful GNNs, the "pre-training, adaptation" scheme first…

Machine Learning · Computer Science 2025-10-28 Xingbo Fu , Zhenyu Lei , Zihan Chen , Binchi Zhang , Chuxu Zhang , Jundong Li

Graph convolutional neural network (GCN) has effectively boosted the multi-label image recognition task by introducing label dependencies based on statistical label co-occurrence of data. However, in previous methods, label correlation is…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Yun Wang , Tong Zhang , Zhen Cui , Chunyan Xu , Jian Yang

The recent "pre-train, prompt, predict training" paradigm has gained popularity as a way to learn generalizable models with limited labeled data. The approach involves using a pre-trained model and a prompting function that applies a…

Machine Learning · Computer Science 2023-06-01 Xuansheng Wu , Kaixiong Zhou , Mingchen Sun , Xin Wang , Ninghao Liu

In recent years, graph prompt learning/tuning has garnered increasing attention in adapting pre-trained models for graph representation learning. As a kind of universal graph prompt learning method, Graph Prompt Feature (GPF) has achieved…

Machine Learning · Computer Science 2024-06-18 Bo Jiang , Hao Wu , Ziyan Zhang , Beibei Wang , Jin Tang

Graph transformers have gained popularity in various graph-based tasks by addressing challenges faced by traditional Graph Neural Networks. However, the quadratic complexity of self-attention operations and the extensive layering in graph…

Machine Learning · Computer Science 2023-09-20 Reza Shirkavand , Heng Huang

Pre-trained graph neural networks (GNNs) transfer well, but adapting them to downstream tasks remains challenging due to mismatches between pre-training objectives and task requirements. Graph prompt tuning offers a parameter-efficient…

Machine Learning · Computer Science 2026-02-06 Long D. Nguyen , Binh P. Nguyen

The performance of current Scene Graph Generation (SGG) models is severely hampered by hard-to-distinguish predicates, e.g., woman-on/standing on/walking on-beach. As general SGG models tend to predict head predicates and re-balancing…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Xinyu Lyu , Lianli Gao , Pengpeng Zeng , Heng Tao Shen , Jingkuan Song

Prompt Learning has recently gained great popularity in bridging the gap between pretraining tasks and various downstream tasks. It freezes Pretrained Language Models (PLMs) and only tunes a few task-related parameters (prompts) for…

Computation and Language · Computer Science 2022-06-07 Yuezihan Jiang , Hao Yang , Junyang Lin , Hanyu Zhao , An Yang , Chang Zhou , Hongxia Yang , Zhi Yang , Bin Cui

In-context learning (ICL) empowers large language models (LLMs) to tackle new tasks by using a series of training instances as prompts. Since generating the prompts needs to sample from a vast pool of instances and annotate them (e.g., add…

Machine Learning · Computer Science 2024-06-07 Zihan Chen , Song Wang , Cong Shen , Jundong Li

Graph Neural Networks (GNNs) have achieved remarkable success in various graph-based tasks (e.g., node classification or link prediction). Despite their triumphs, GNNs still face challenges such as long training and inference times,…

Machine Learning · Computer Science 2025-07-15 Chu-Yuan Wei , Shun-Yao Liu , Sheng-Da Zhuo , Chang-Dong Wang , Shu-Qiang Huang , Mohsen Guizani

Prompt learning has demonstrated impressive efficacy in the fine-tuning of multimodal large models to a wide range of downstream tasks. Nonetheless, applying existing prompt learning methods for the diagnosis of neurological disorder still…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Liang Peng , Songyue Cai , Zongqian Wu , Huifang Shang , Xiaofeng Zhu , Xiaoxiao Li

Existing graph contrastive learning methods rely on augmentation techniques based on random perturbations (e.g., randomly adding or dropping edges and nodes). Nevertheless, altering certain edges or nodes can unexpectedly change the graph…

Machine Learning · Computer Science 2022-11-08 Huidong Liang , Xingjian Du , Bilei Zhu , Zejun Ma , Ke Chen , Junbin Gao