English
Related papers

Related papers: MentorGNN: Deriving Curriculum for Pre-Training GN…

200 papers

Graph Neural Networks (GNNs) have recently been used for node and graph classification tasks with great success, but GNNs model dependencies among the attributes of nearby neighboring nodes rather than dependencies among observed node…

Machine Learning · Computer Science 2020-09-30 Mengyue Hang , Jennifer Neville , Bruno Ribeiro

End-to-end training of graph neural networks (GNN) on large graphs presents several memory and computational challenges, and limits the application to shallow architectures as depth exponentially increases the memory and space complexities.…

Machine Learning · Computer Science 2023-09-06 Oscar Pina , Verónica Vilaplana

Many Graph Neural Network (GNN) training systems have emerged recently to support efficient GNN training. Since GNNs embody complex data dependencies between training samples, the training of GNNs should address distinct challenges…

Machine Learning · Computer Science 2024-03-21 Hao Yuan , Yajiong Liu , Yanfeng Zhang , Xin Ai , Qiange Wang , Chaoyi Chen , Yu Gu , Ge Yu

Graph neural networks (GNNs) have attracted much attention due to their ability to leverage the intrinsic geometries of the underlying data. Although many different types of GNN models have been developed, with many benchmarking procedures…

Recently, much exertion has been paid to design graph self-supervised methods to obtain generalized pre-trained models, and adapt pre-trained models onto downstream tasks through fine-tuning. However, there exists an inherent gap between…

Machine Learning · Computer Science 2023-08-16 Yun Zhu , Jianhao Guo , Siliang Tang

Graph Neural Networks (GNNs) have become essential in interpreting relational data across various domains, yet, they often struggle to generalize to unseen graph data that differs markedly from training instances. In this paper, we…

Machine Learning · Computer Science 2024-12-10 Xinke Jiang , Rihong Qiu , Yongxin Xu , Wentao Zhang , Yichen Zhu , Ruizhe Zhang , Yuchen Fang , Xu Chu , Junfeng Zhao , Yasha Wang

Deep graph neural networks (GNNs) have achieved excellent results on various tasks on increasingly large graph datasets with millions of nodes and edges. However, memory complexity has become a major obstacle when training deep GNNs for…

Machine Learning · Computer Science 2022-04-12 Guohao Li , Matthias Müller , Bernard Ghanem , Vladlen Koltun

In many real-world network datasets such as co-authorship, co-citation, email communication, etc., relationships are complex and go beyond pairwise. Hypergraphs provide a flexible and natural modeling tool to model such complex…

Machine Learning · Computer Science 2019-05-23 Naganand Yadati , Madhav Nimishakavi , Prateek Yadav , Vikram Nitin , Anand Louis , Partha Talukdar

In recent years, graph neural networks (GNNs) have emerged as a successful tool in a variety of graph-related applications. However, the performance of GNNs can be deteriorated when noisy connections occur in the original graph structures;…

Machine Learning · Computer Science 2022-01-19 Yixin Liu , Yu Zheng , Daokun Zhang , Hongxu Chen , Hao Peng , Shirui Pan

Graph-based recommendation has achieved great success in recent years. The classical graph recommendation model utilizes ID embedding to store essential collaborative information. However, this ID-based paradigm faces challenges in…

Information Retrieval · Computer Science 2026-05-12 Yiwen Chen , Yiqing Wu , Huishi Luo , Fuzhen Zhuang , Deqing Wang , Zhao Zhang

Pre-training powerful Graph Neural Networks (GNNs) with unlabeled graph data in a self-supervised manner has emerged as a prominent technique in recent years. However, inevitable objective gaps often exist between pre-training and…

Machine Learning · Computer Science 2025-03-04 Xingbo Fu , Yinhan He , Jundong Li

Graph neural networks (GNNs) have emerged as a powerful model to capture critical graph patterns. Instead of treating them as black boxes in an end-to-end fashion, attempts are arising to explain the model behavior. Existing works mainly…

Machine Learning · Computer Science 2024-02-22 Yi Nian , Yurui Chang , Wei Jin , Lu Lin

Graph neural networks (GNNs) have emerged as a powerful tool for effectively mining and learning from graph-structured data, with applications spanning numerous domains. However, most research focuses on static graphs, neglecting the…

Machine Learning · Computer Science 2024-04-30 Yanping Zheng , Lu Yi , Zhewei Wei

In recent years, graph neural networks (GNNs) have been widely applied in tackling combinatorial optimization problems. However, existing methods still suffer from limited accuracy when addressing that on complex graphs and exhibit poor…

Machine Learning · Computer Science 2025-11-13 Yuyao Long

Deep neural networks are ubiquitously adopted in many applications, such as computer vision, natural language processing, and graph analytics. However, well-trained neural networks can make prediction errors after deployment as the world…

Machine Learning · Computer Science 2024-10-29 Zhimeng Jiang , Zirui Liu , Xiaotian Han , Qizhang Feng , Hongye Jin , Qiaoyu Tan , Kaixiong Zhou , Na Zou , Xia Hu

Recent advancements in graph learning have revolutionized the way to understand and analyze data with complex structures. Notably, Graph Neural Networks (GNNs), i.e. neural network architectures designed for learning graph representations,…

Machine Learning · Computer Science 2024-07-09 Yu Huang , Min Zhou , Menglin Yang , Zhen Wang , Muhan Zhang , Jie Wang , Hong Xie , Hao Wang , Defu Lian , Enhong Chen

Recently, the paradigm of pre-training and fine-tuning graph neural networks has been intensively studied and applied in a wide range of graph mining tasks. Its success is generally attributed to the structural consistency between…

Machine Learning · Computer Science 2023-12-22 Yifei Sun , Qi Zhu , Yang Yang , Chunping Wang , Tianyu Fan , Jiajun Zhu , Lei Chen

Graph Neural Networks (GNNs) are a powerful tool for machine learning on graphs.GNNs combine node feature information with the graph structure by recursively passing neural messages along edges of the input graph. However, incorporating…

Machine Learning · Computer Science 2019-11-15 Rex Ying , Dylan Bourgeois , Jiaxuan You , Marinka Zitnik , Jure Leskovec

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

Machine Learning · Computer Science 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

Property prediction on molecular graphs is an important application of Graph Neural Networks. Recently, unlabeled molecular data has become abundant, which facilitates the rapid development of self-supervised learning for GNNs in the…

Machine Learning · Computer Science 2023-10-31 Kha-Dinh Luong , Ambuj Singh