English
Related papers

Related papers: ULTRA-DP: Unifying Graph Pre-training with Multi-t…

200 papers

Given the ubiquity of graph data, it is intriguing to ask: Is it possible to train a graph foundation model on a broad range of graph data across diverse domains? A major hurdle toward this goal lies in the fact that graphs from different…

Machine Learning · Computer Science 2024-09-24 Xingtong Yu , Chang Zhou , Yuan Fang , Xinming Zhang

graph neural networks (GNNs) are the dominant paradigm for modeling and handling graph structure data by learning universal node representation. The traditional way of training GNNs depends on a great many labeled data, which results in…

Machine Learning · Computer Science 2022-09-12 Shuai Ma , Jian-wei Liu , Xin Zuo

Graph ``pre-training and prompt-tuning'' aligns downstream tasks with pre-trained objectives to enable efficient knowledge transfer under limited supervision. However, current methods typically rely on single-filter backbones (e.g.,…

Machine Learning · Computer Science 2026-01-13 Haitong Luo , Suhang Wang , Weiyao Zhang , Ruiqi Meng , Xuying Meng , Yujun Zhang

How can we enhance the node features acquired from Pretrained Models (PMs) to better suit downstream graph learning tasks? Graph Neural Networks (GNNs) have become the state-of-the-art approach for many high-impact, real-world graph…

Machine Learning · Computer Science 2025-04-01 Jing Zhu , Xiang Song , Vassilis N. Ioannidis , Danai Koutra , Christos Faloutsos

Graphs are ubiquitous for modeling complex relationships between objects across various fields. Graph neural networks (GNNs) have become a mainstream technique for graph-based applications, but their performance heavily relies on abundant…

Machine Learning · Computer Science 2025-02-27 Xingtong Yu , Jie Zhang , Yuan Fang , Renhe Jiang

Graph neural networks (GNNs) have emerged as powerful models for learning representations of graph data showing state of the art results in various tasks. Nevertheless, the superiority of these methods is usually supported by either…

Machine Learning · Computer Science 2024-11-22 Tianqi Zhao , Megha Khosla

Graph Neural Networks (GNN) are indispensable in learning from graph-structured data, yet their rising computational costs, especially on massively connected graphs, pose significant challenges in terms of execution performance. To tackle…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-05 Aishwarya Sarkar , Sayan Ghosh , Nathan R. Tallent , Ali Jannesari

Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual graph representation learning aims to generate…

Machine Learning · Computer Science 2024-08-22 Wenbin Hu , Huihao Jing , Qi Hu , Haoran Li , Yangqiu Song

GNN prompting aims to adapt models across tasks and graphs without requiring extensive retraining. However, most existing graph prompt methods still require task-specific parameter updates and face the issue of generalizing across graphs,…

Machine Learning · Computer Science 2026-04-02 Yaqi Chen , Shixun Huang , Ryan Twemlow , Lei Wang , John Le , Sheng Wang , Willy Susilo , Jun Yan , Jun Shen

Dynamic graph data mining has gained popularity in recent years due to the rich information contained in dynamic graphs and their widespread use in the real world. Despite the advances in dynamic graph neural networks (DGNNs), the rich…

Machine Learning · Computer Science 2023-12-27 Yuanchen Bei , Hao Xu , Sheng Zhou , Huixuan Chi , Haishuai Wang , Mengdi Zhang , Zhao Li , Jiajun Bu

Graphs with abundant attributes are essential in modeling interconnected entities and enhancing predictions across various real-world applications. Traditional Graph Neural Networks (GNNs) often require re-training for different graph tasks…

Computation and Language · Computer Science 2026-05-26 Yanchao Tan , Hang Lv , Pengxiang Zhan , Shiping Wang , Carl Yang

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Recently, Graph Neural Networks (GNNs) have proven their effectiveness for recommender systems. Existing studies have applied GNNs to capture collaborative relations in the data. However, in real-world scenarios, the relations in a…

Information Retrieval · Computer Science 2021-11-30 Xiaohan Li , Zhiwei Liu , Stephen Guo , Zheng Liu , Hao Peng , Philip S. Yu , Kannan Achan

Cold-start problem is a fundamental challenge for recommendation tasks. Despite the recent advances on Graph Neural Networks (GNNs) incorporate the high-order collaborative signal to alleviate the problem, the embeddings of the cold-start…

Information Retrieval · Computer Science 2020-12-15 Bowen Hao , Jing Zhang , Hongzhi Yin , Cuiping Li , Hong Chen

Graph Anomaly Detection (GAD) is a challenging and practical research topic where Graph Neural Networks (GNNs) have recently shown promising results. The effectiveness of existing GNNs in GAD has been mainly attributed to the simultaneous…

Machine Learning · Computer Science 2024-10-25 Jiashun Cheng , Zinan Zheng , Yang Liu , Jianheng Tang , Hongwei Wang , Yu Rong , Jia Li , Fugee Tsung

Graph representation learning has attracted lots of attention recently. Existing graph neural networks fed with the complete graph data are not scalable due to limited computation and memory costs. Thus, it remains a great challenge to…

Machine Learning · Computer Science 2020-11-24 Yizhu Jiao , Yun Xiong , Jiawei Zhang , Yao Zhang , Tianqi Zhang , Yangyong Zhu

Graph neural networks (GNNs) have achieved remarkable success across a wide range of applications, such as recommendation, drug discovery, and question answering. Behind the success of GNNs lies the backpropagation (BP) algorithm, which is…

Machine Learning · Computer Science 2024-04-16 Namyong Park , Xing Wang , Antoine Simoulin , Shuai Yang , Grey Yang , Ryan Rossi , Puja Trivedi , Nesreen Ahmed

Recent years have witnessed great success in handling node classification tasks with Graph Neural Networks (GNNs). However, most existing GNNs are based on the assumption that node samples for different classes are balanced, while for many…

Machine Learning · Computer Science 2021-06-22 Lirong Wu , Haitao Lin , Zhangyang Gao , Cheng Tan , Stan. Z. Li

This paper presents a novel graph-based deep learning model for tasks involving relations between two nodes (edge-centric tasks), where the focus lies on predicting relationships and interactions between pairs of nodes rather than node…

Machine Learning · Computer Science 2025-07-08 Eugenio Borzone , Leandro Di Persia , Matias Gerard

Graph neural networks (GNNs) are among the most powerful tools in deep learning. They routinely solve complex problems on unstructured networks, such as node classification, graph classification, or link prediction, with high accuracy.…

Machine Learning · Computer Science 2023-08-21 Maciej Besta , Torsten Hoefler