English
Related papers

Related papers: AGL: a Scalable System for Industrial-purpose Grap…

200 papers

Subgraph-based graph representation learning (SGRL) has been recently proposed to deal with some fundamental challenges encountered by canonical graph neural networks (GNNs), and has demonstrated advantages in many important data science…

Machine Learning · Computer Science 2022-08-04 Haoteng Yin , Muhan Zhang , Yanbang Wang , Jianguo Wang , Pan Li

Graph Neural Networks (GNNs) are a new and increasingly popular family of deep neural network architectures to perform learning on graphs. Training them efficiently is challenging due to the irregular nature of graph data. The problem…

Machine Learning · Computer Science 2021-06-15 Marco Serafini , Hui Guan

Graph Neural Networks (GNNs) have received much attention in the graph deep learning domain. However, recent research empirically and theoretically shows that deep GNNs suffer from over-fitting and over-smoothing problems. The usual…

Machine Learning · Computer Science 2022-09-05 Chuxiong Sun , Jie Hu , Hongming Gu , Jinpeng Chen , Mingchuan Yang

We propose AGS-GNN, a novel attribute-guided sampling algorithm for Graph Neural Networks (GNNs) that exploits node features and connectivity structure of a graph while simultaneously adapting for both homophily and heterophily in graphs.…

Machine Learning · Computer Science 2024-05-27 Siddhartha Shankar Das , S M Ferdous , Mahantesh M Halappanavar , Edoardo Serra , Alex Pothen

Social recommendation based on social network has achieved great success in improving the performance of recommendation system. Since social network (user-user relations) and user-item interactions are both naturally represented as…

Information Retrieval · Computer Science 2021-09-27 Yiming Zhang , Lingfei Wu , Qi Shen , Yitong Pang , Zhihua Wei , Fangli Xu , Ethan Chang , Bo Long

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

Graph neural networks (GNNs) have emerged as a powerful approach for solving many network mining tasks. However, learning on large graphs remains a challenge - many recently proposed scalable GNN approaches rely on an expensive…

Graph neural networks (GNNs) have achieved breakthroughs in various real-world downstream tasks due to their powerful expressiveness. As the scale of real-world graphs has been continuously growing, a storage-based approach to GNN training…

Machine Learning · Computer Science 2026-01-07 Myung-Hwan Jang , Jeong-Min Park , Yunyong Ko , Sang-Wook Kim

Graphs are omnipresent and GNNs are a powerful family of neural networks for learning over graphs. Despite their popularity, scaling GNNs either by deepening or widening suffers from prevalent issues of unhealthy gradients,…

Machine Learning · Computer Science 2023-08-25 Ajay Jaiswal , Shiwei Liu , Tianlong Chen , Ying Ding , Zhangyang Wang

The scalable solution of large sparse linear systems is a bottleneck in scientific computing and graph analysis. While algebraic multigrid (AMG) offers optimal linear scaling, its performance is severely constrained by the trade-off between…

Machine Learning · Computer Science 2026-05-27 Yali Fink , Ido Ben-Yair , Lars Ruthotto , Eran Treister

We propose an adaptive graph coarsening method to jointly learn graph neural network (GNN) parameters and merge nodes via K-means clustering during training. As real-world graphs grow larger, processing them directly becomes increasingly…

Machine Learning · Computer Science 2025-10-01 Rostyslav Olshevskyi , Madeline Navarro , Santiago Segarra

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

Machine Learning · Computer Science 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu

Managing evolving graph data presents substantial challenges in storage and privacy, and training graph neural networks (GNNs) on such data often leads to catastrophic forgetting, impairing performance on earlier tasks. Despite existing…

Machine Learning · Computer Science 2025-05-29 Yinlin Zhu , Miao Hu , Di Wu

Recent advances in graph learning have paved the way for innovative retrieval-augmented generation (RAG) systems that leverage the inherent relational structures in graph data. However, many existing approaches suffer from rigid, fixed…

Information Retrieval · Computer Science 2025-03-26 Yuan Li , Jun Hu , Jiaxin Jiang , Zemin Liu , Bryan Hooi , Bingsheng He

Classical graph algorithms work well for combinatorial problems that can be thoroughly formalized and abstracted. Once the algorithm is derived, it generalizes to instances of any size. However, developing an algorithm that handles complex…

Machine Learning · Computer Science 2022-12-12 Florian Grötschla , Joël Mathys , Roger Wattenhofer

Improving the training and inference performance of graph neural networks (GNNs) is faced with a challenge uncommon in general neural networks: creating mini-batches requires a lot of computation and data movement due to the exponential…

Most real-world graphs are dynamic in nature, with continuous and rapid updates to the graph topology, and vertex and edge properties. Such frequent updates pose significant challenges for inferencing over Graph Neural Networks (GNNs).…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-09 Pranjal Naman , Yogesh Simmhan

Graph neural networks (GNN) have shown great success in learning from graph-structured data. They are widely used in various applications, such as recommendation, fraud detection, and search. In these domains, the graphs are typically…

Machine Learning · Computer Science 2021-08-04 Da Zheng , Chao Ma , Minjie Wang , Jinjing Zhou , Qidong Su , Xiang Song , Quan Gan , Zheng Zhang , George Karypis

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

Machine Learning · Computer Science 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

Unsupervised graph representation learning aims to learn low-dimensional node embeddings without supervision while preserving graph topological structures and node attributive features. Previous graph neural networks (GNN) require a large…

Machine Learning · Computer Science 2020-09-04 Yanqiao Zhu , Yichen Xu , Feng Yu , Shu Wu , Liang Wang