English
Related papers

Related papers: SpanGNN: Towards Memory-Efficient Graph Neural Net…

200 papers

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

We address the efficiency issue for the construction of a deep graph neural network (GNN). The approach exploits the idea of representing each input graph as a fixed point of a dynamical system (implemented through a recurrent neural…

Machine Learning · Computer Science 2019-11-21 Claudio Gallicchio , Alessio Micheli

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

Graph Neural Networks have recently become a prevailing paradigm for various high-impact graph analytical problems. Existing efforts can be mainly categorized as spectral-based and spatial-based methods. The major challenge for the former…

Machine Learning · Computer Science 2022-02-22 Yushun Dong , Kaize Ding , Brian Jalaian , Shuiwang Ji , Jundong Li

Graph Neural Networks (GNNs) have demonstrated impressive performance across diverse graph-based tasks by leveraging message passing to capture complex node relationships. However, on large-scale real-world graphs, GNNs face two major…

Machine Learning · Computer Science 2026-03-10 Xiang Li , Jianpeng Qi , Haobing Liu , Yuan Cao , Guoqing Chao , Zhongying Zhao , Junyu Dong , Xinwang Liu , Yanwei Yu

Graph neural networks (GNN) suffer from severe inefficiency. It is mainly caused by the exponential growth of node dependency with the increase of layers. It extremely limits the application of stochastic optimization algorithms so that the…

Machine Learning · Computer Science 2024-04-23 Hongyuan Zhang , Yanan Zhu , Xuelong Li

Graph Attention Networks (GATs) have been intensively studied and widely used in graph data learning tasks. Existing GATs generally adopt the self-attention mechanism to conduct graph edge attention learning, requiring expensive…

Neural and Evolutionary Computing · Computer Science 2022-09-28 Beibei Wang , Bo Jiang

Sequential recommendation effectively addresses information overload by modeling users' temporal and sequential interaction patterns. To overcome the limitations of supervision signals, recent approaches have adopted self-supervised…

Information Retrieval · Computer Science 2024-06-03 Yuxi Liu , Lianghao Xia , Chao Huang

Graph Neural Networks (GNNs) are key tools for graph representation learning, demonstrating strong results across diverse prediction tasks. In this paper, we present Convexified Message-Passing Graph Neural Networks (CGNNs), a novel and…

Machine Learning · Computer Science 2026-01-27 Saar Cohen , Noa Agmon , Uri Shaham

Many real-world graphs (networks) are heterogeneous with different types of nodes and edges. Heterogeneous graph embedding, aiming at learning the low-dimensional node representations of a heterogeneous graph, is vital for various…

Social and Information Networks · Computer Science 2021-12-15 Wentao Xu , Yingce Xia , Weiqing Liu , Jiang Bian , Jian Yin , Tie-Yan Liu

Graph neural networks (GNNs) have delivered remarkable results in various fields. However, the rapid increase in the scale of graph data has introduced significant performance bottlenecks for GNN inference. Both computational complexity and…

Machine Learning · Computer Science 2025-03-11 Xiabao Wu , Yongchao Liu , Wei Qin , Chuntao Hong

Training Graph Neural Networks (GNNs) on real-world graphs consisting of billions of nodes and edges is quite challenging, primarily due to the substantial memory needed to store the graph and its intermediate node and edge features, and…

Machine Learning · Computer Science 2023-08-08 Kaidi Cao , Rui Deng , Shirley Wu , Edward W Huang , Karthik Subbian , Jure Leskovec

The recent rapid growth in mobile data traffic entails a pressing demand for improving the throughput of the underlying wireless communication networks. Network node deployment has been considered as an effective approach for throughput…

Networking and Internet Architecture · Computer Science 2022-09-16 Yifei Yang , Dongmian Zou , Xiaofan He

Training Graph Neural Networks(GNNs) on a large monolithic graph presents unique challenges as the graph cannot fit within a single machine and it cannot be decomposed into smaller disconnected components. Distributed sampling-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Hesham Mostafa , Adam Grabowski , Md Asadullah Turja , Juan Cervino , Alejandro Ribeiro , Nageen Himayat

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Graph Neural Networks (GNNs) have recently been applied to graph learning tasks and achieved state-of-the-art (SOTA) results. However, many competitive methods run GNNs multiple times with subgraph extraction and customized labeling to…

Machine Learning · Computer Science 2023-02-14 Lecheng Kong , Yixin Chen , Muhan Zhang

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and…

Machine Learning · Computer Science 2021-09-22 Wenzheng Feng , Jie Zhang , Yuxiao Dong , Yu Han , Huanbo Luan , Qian Xu , Qiang Yang , Evgeny Kharlamov , Jie Tang

Graph Neural Networks (GNNs) are the predominant technique for learning over graphs. However, there is relatively little understanding of why GNNs are successful in practice and whether they are necessary for good performance. Here, we show…

Machine Learning · Computer Science 2020-11-04 Qian Huang , Horace He , Abhay Singh , Ser-Nam Lim , Austin R. Benson

An increasing number of machine learning tasks require dealing with large graph datasets, which capture rich and complex relationship among potentially billions of elements. Graph Neural Network (GNN) becomes an effective way to address the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-26 Rong Zhu , Kun Zhao , Hongxia Yang , Wei Lin , Chang Zhou , Baole Ai , Yong Li , Jingren Zhou

Graph neural networks (GNNs) are powerful tools for exploring and learning from graph structures and features. As such, achieving high-performance execution for GNNs becomes crucially important. Prior works have proposed to explore the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-30 Yangjie Zhou , Yaoxu Song , Jingwen Leng , Zihan Liu , Weihao Cui , Zhendong Zhang , Cong Guo , Quan Chen , Li Li , Minyi Guo