English
Related papers

Related papers: Demystifying MPNNs: Message Passing as Merely Effi…

200 papers

Graph neural networks (GNNs) provide state-of-the-art results in a wide variety of tasks which typically involve predicting features at the vertices of a graph. They are built from layers of graph convolutions which serve as a powerful…

Machine Learning · Statistics 2024-11-08 Mauricio Velasco , Kaiying O'Hare , Bernardo Rychtenberg , Soledad Villar

Graph Neural Networks (GNNs) have already been widely applied in various graph mining tasks. However, they suffer from the shallow architecture issue, which is the key impediment that hinders the model performance improvement. Although…

Machine Learning · Computer Science 2021-08-03 Wentao Zhang , Zeang Sheng , Yuezihan Jiang , Yikuan Xia , Jun Gao , Zhi Yang , Bin Cui

Graph Neural Networks (GNNs) have become essential for handling large-scale graph applications. However, the computational demands of GNNs necessitate the development of efficient methods to accelerate inference. Mixed precision…

Machine Learning · Computer Science 2025-05-15 Samir Moustafa , Nils M. Kriege , Wilfried N. Gansterer

Existing Graph Neural Networks (GNNs) follow the message-passing mechanism that conducts information interaction among nodes iteratively. While considerable progress has been made, such node interaction paradigms still have the following…

Machine Learning · Computer Science 2023-04-14 Jie Chen , Zilong Li , Yin Zhu , Junping Zhang , Jian Pu

Graph Neural Networks (GNNs) have achieved remarkable success across diverse tasks on graph-structured data, primarily through the use of learned weights in message passing layers. In this paper, we demonstrate that random weights can be…

Machine Learning · Computer Science 2025-02-04 Thu Bui , Carola-Bibiane Schönlieb , Bruno Ribeiro , Beatrice Bevilacqua , Moshe Eliasof

Graph neural networks (GNNs) have gained traction over the past few years for their superior performance in numerous machine learning tasks. Graph Convolutional Neural Networks (GCN) are a common variant of GNNs that are known to have high…

Machine Learning · Computer Science 2022-07-06 Sannat Singh Bhasin , Vaibhav Holani , Divij Sanjanwala

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

Machine Learning · Computer Science 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin

Graph neural networks (GNNs) have attracted considerable attention from the research community. It is well established that GNNs are usually roughly divided into spatial and spectral methods. Despite that spectral GNNs play an important…

Machine Learning · Computer Science 2023-02-14 Deyu Bo , Xiao Wang , Yang Liu , Yuan Fang , Yawen Li , Chuan Shi

Real data collected from different applications that have additional topological structures and connection information are amenable to be represented as a weighted graph. Considering the node labeling problem, Graph Neural Networks (GNNs)…

Social and Information Networks · Computer Science 2020-02-06 Xiaoxiao Li , Joao Saude

Graph Neural Networks (GNNs) are a promising deep learning approach for circumventing many real-world problems on graph-structured data. However, these models usually have at least one of four fundamental limitations: over-smoothing,…

Machine Learning · Computer Science 2022-10-03 Xun Liu , Alex Hay-Man Ng , Fangyuan Lei , Yikuan Zhang , Zhengmin Li

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

Machine Learning · Computer Science 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

Rule-based fine-grained IP geolocation methods are hard to generalize in computer networks which do not follow hypothetical rules. Recently, deep learning methods, like multi-layer perceptron (MLP), are tried to increase generalization…

Machine Learning · Computer Science 2023-04-18 Shichang Ding , Xiangyang Luo , Jinwei Wang , Xiaoming Fu

Graph Neural Networks (GNNs) are a powerful tool for machine learning on graphs.GNNs combine node feature information with the graph structure by recursively passing neural messages along edges of the input graph. However, incorporating…

Machine Learning · Computer Science 2019-11-15 Rex Ying , Dylan Bourgeois , Jiaxuan You , Marinka Zitnik , Jure Leskovec

Graph Neural Networks (GNNs) have become the standard approach for learning and reasoning over relational data, leveraging the message-passing mechanism that iteratively propagates node embeddings through graph structures. While GNNs have…

Machine Learning · Computer Science 2025-01-14 Xiaoyu Li , Yingyu Liang , Zhenmei Shi , Zhao Song , Wei Wang , Jiahao Zhang

The algorithms based on message passing neural networks (MPNNs) on graphs have recently achieved great success for various graph applications. However, studies find that these methods always propagate the information to very limited…

Artificial Intelligence · Computer Science 2026-02-10 Mingcan Wang , Junchang Xin , Zhongming Yao , Kaifu Long , Zhiqiong Wang

Graphs are a powerful data structure to represent relational data and are widely used to describe complex real-world data structures. Probabilistic Graphical Models (PGMs) have been well-developed in the past years to mathematically model…

Artificial Intelligence · Computer Science 2023-01-31 Chenqing Hua , Sitao Luan , Qian Zhang , Jie Fu

Graph Neural Networks (GNN) are currently the most popular approach for learning and prediction on graph-structured data and are deployed in various fields, from social network analysis to drug discovery. However, there is limited…

Methodology · Statistics 2026-05-26 Nil Ayday , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

We analyze graph smoothing with \emph{mean aggregation}, where each node successively receives the average of the features of its neighbors. Indeed, it has quickly been observed that Graph Neural Networks (GNNs), which generally follow some…

Machine Learning · Statistics 2022-10-11 Nicolas Keriven

Lots of learning tasks require dealing with graph data which contains rich relation information among elements. Modeling physics systems, learning molecular fingerprints, predicting protein interface, and classifying diseases demand a model…

Machine Learning · Computer Science 2021-10-07 Jie Zhou , Ganqu Cui , Shengding Hu , Zhengyan Zhang , Cheng Yang , Zhiyuan Liu , Lifeng Wang , Changcheng Li , Maosong Sun