English
Related papers

Related papers: Unsupervised Prompting for Graph Neural Networks

200 papers

Language models (LMs) trained on vast quantities of unlabelled data have greatly advanced the field of natural language processing (NLP). In this study, we re-visit the widely accepted notion in NLP that continued pre-training LMs on…

Computation and Language · Computer Science 2023-10-09 Zhengxiang Shi , Aldo Lipani

Recently, graph neural networks (GNNs) have been shown powerful capacity at modeling structural data. However, when adapted to downstream tasks, it usually requires abundant task-specific labeled data, which can be extremely scarce in…

Machine Learning · Computer Science 2022-03-04 Yupeng Hou , Binbin Hu , Wayne Xin Zhao , Zhiqiang Zhang , Jun Zhou , Ji-Rong Wen

In this paper, we propose a novel graph-based approach for semi-supervised learning problems, which considers an adaptive adjacency of the examples throughout the unsupervised portion of the training. Adjacency of the examples is inferred…

Machine Learning · Computer Science 2020-08-06 Ozsel Kilinc , Ismail Uysal

In recent years, graph neural networks (GNN) have achieved significant developments in a variety of graph analytical tasks. Nevertheless, GNN's superior performance will suffer from serious damage when the collected node features or…

Machine Learning · Computer Science 2023-09-07 Sichao Fu , Qinmu Peng , Yang He , Baokun Du , Xinge You

One fundamental challenge in graph machine learning is generalizing to new graphs. Many existing methods following the inductive setup can generalize to test graphs with new structures, but assuming the feature and label spaces remain the…

Machine Learning · Computer Science 2025-04-09 Jianan Zhao , Zhaocheng Zhu , Mikhail Galkin , Hesham Mostafa , Michael Bronstein , Jian Tang

Graph neural networks (GNNs) have shown great ability for node classification on graphs. However, the success of GNNs relies on abundant labeled data, while obtaining high-quality labels is costly and challenging, especially for newly…

Machine Learning · Computer Science 2025-06-02 Yilong Wang , Tianxiang Zhao , Zongyu Wu , Suhang Wang

Prompt learning is one of the most effective and trending ways to adapt powerful vision-language foundation models like CLIP to downstream datasets by tuning learnable prompt vectors with very few samples. However, although prompt learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Cairong Zhao , Yubin Wang , Xinyang Jiang , Yifei Shen , Kaitao Song , Dongsheng Li , Duoqian Miao

Fraud detection problems are usually formulated as a machine learning problem on a graph. Recently, Graph Neural Networks (GNNs) have shown solid performance on fraud detection. The successes of most previous methods heavily rely on rich…

Machine Learning · Computer Science 2021-10-05 Chen Wang , Yingtong Dou , Min Chen , Jia Chen , Zhiwei Liu , Philip S. Yu

Large Language Model (LLM) has demonstrated significant ability in various Natural Language Processing tasks. However, their effectiveness is highly dependent on the phrasing of the task prompt, leading to research on automatic prompt…

Computation and Language · Computer Science 2024-02-06 Moxin Li , Wenjie Wang , Fuli Feng , Yixin Cao , Jizhi Zhang , Tat-Seng Chua

Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of…

Machine Learning · Computer Science 2025-06-02 Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

We consider the problem of learning generalized policies for classical planning domains using graph neural networks from small instances represented in lifted STRIPS. The problem has been considered before but the proposed neural…

Artificial Intelligence · Computer Science 2022-05-13 Simon Ståhlberg , Blai Bonet , Hector Geffner

The success of deep learning notoriously requires larger amounts of costly annotated data. This has led to the development of self-supervised learning (SSL) that aims to alleviate this limitation by creating domain specific pretext tasks on…

Machine Learning · Computer Science 2020-06-19 Wei Jin , Tyler Derr , Haochen Liu , Yiqi Wang , Suhang Wang , Zitao Liu , Jiliang Tang

We present a new paradigm for fine-tuning large-scale visionlanguage pre-trained models on downstream task, dubbed Prompt Regularization (ProReg). Different from traditional fine-tuning which easily overfits to the downstream task data,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Beier Zhu , Yulei Niu , Saeil Lee , Minhoe Hur , Hanwang Zhang

Accurate traffic prediction is essential for optimizing transportation systems, enhancing resource allocation, and improving overall urban administration. Spatio-temporal graph neural networks (GNNs) have achieved state-of-the-art…

Machine Learning · Computer Science 2026-05-12 Qianru Zhang , Xinyi Gao , Alexander Zhou , Reynold Cheng , Siu-Ming Yiu , Hongzhi Yin

Unsupervised graph anomaly detection aims at identifying rare patterns that deviate from the majority in a graph without the aid of labels, which is important for a variety of real-world applications. Recent advances have utilized Graph…

Machine Learning · Computer Science 2025-05-27 Yuanchen Bei , Sheng Zhou , Jinke Shi , Yao Ma , Haishuai Wang , Jiajun Bu

Graph neural networks (GNNs) are widely used for learning node embeddings in graphs, typically adopting a message-passing scheme. This approach, however, leads to the neighbor explosion problem, with exponentially growing computational and…

Machine Learning · Computer Science 2025-07-08 Zichao Yue , Chenhui Deng , Zhiru Zhang

The success of Graph Neural Networks (GNN) in learning on non-Euclidean data arouses many subtopics, such as Label-inputted GNN (LGNN) and Implicit GNN (IGNN). LGNN, explicitly inputting supervising information (a.k.a. labels) in GNN,…

Machine Learning · Computer Science 2023-06-01 Yi Luo , Guiduo Duan , Guangchun Luo , Aiguo Chen

Graph Convolutional Networks(GCNs) play a crucial role in graph learning tasks, however, learning graph embedding with few supervised signals is still a difficult problem. In this paper, we propose a novel training algorithm for Graph…

Machine Learning · Computer Science 2020-02-21 Ke Sun , Zhouchen Lin , Zhanxing Zhu

Do current large language models (LLMs) better solve graph reasoning and generation tasks with parameter updates? In this paper, we propose InstructGraph, a framework that empowers LLMs with the abilities of graph reasoning and generation…

Computation and Language · Computer Science 2024-02-15 Jianing Wang , Junda Wu , Yupeng Hou , Yao Liu , Ming Gao , Julian McAuley

Recent research has demonstrated the efficacy of pre-training graph neural networks (GNNs) to capture the transferable graph semantics and enhance the performance of various downstream tasks. However, the semantic knowledge learned from…

Machine Learning · Computer Science 2023-12-19 Mouxiang Chen , Zemin Liu , Chenghao Liu , Jundong Li , Qiheng Mao , Jianling Sun