English
Related papers

Related papers: Accurate and Scalable Graph Neural Networks via Me…

200 papers

Message-passing algorithms based on the Belief Propagation (BP) equations constitute a well-known distributed computational scheme. It is exact on tree-like graphical models and has also proven to be effective in many problems defined on…

Machine Learning · Computer Science 2022-07-20 Carlo Lucibello , Fabrizio Pittorino , Gabriele Perugini , Riccardo Zecchina

Label imbalance and homophily-heterophily mixture are the fundamental problems encountered when applying Graph Neural Networks (GNNs) to Graph Fraud Detection (GFD) tasks. Existing GNN-based GFD models are designed to augment graph…

Artificial Intelligence · Computer Science 2024-12-03 Wei Zhuo , Zemin Liu , Bryan Hooi , Bingsheng He , Guang Tan , Rizal Fathony , Jia Chen

Message Passing Neural Networks (MPNNs) are a staple of graph machine learning. MPNNs iteratively update each node's representation in an input graph by aggregating messages from the node's neighbors, which necessitates a memory complexity…

Machine Learning · Computer Science 2024-12-24 Ben Finkelshtein , İsmail İlkan Ceylan , Michael Bronstein , Ron Levie

Graph Neural Networks (GNNs) have superior capability in learning graph data. Full-graph GNN training generally has high accuracy, however, it suffers from large peak memory usage and encounters the Out-of-Memory problem when handling large…

Machine Learning · Computer Science 2024-06-10 Xizhi Gu , Hongzheng Li , Shihong Gao , Xinyan Zhang , Lei Chen , Yingxia Shao

This study utilizes community structures to address node degree biases in message-passing (MP) via learnable graph augmentations and novel graph transformers. Recent augmentation-based methods showed that MP neural networks often perform…

Machine Learning · Computer Science 2023-12-29 Van Thuy Hoang , O-Joun Lee

Graph Nerual Networks (GNNs) are effective models in graph embedding. It extracts shallow features and neighborhood information by aggregating neighbor information to learn the embedding representation of different nodes. However, the local…

Social and Information Networks · Computer Science 2023-12-14 Kejia Zhang

Graph neural networks (GNNs) are a powerful inductive bias for modelling algorithmic reasoning procedures and data structures. Their prowess was mainly demonstrated on tasks featuring Markovian dynamics, where querying any associated data…

Machine Learning · Computer Science 2021-04-28 Heiko Strathmann , Mohammadamin Barekatain , Charles Blundell , Petar Veličković

This paper studies asynchronous message passing (AMP), a new paradigm for applying neural network based learning to graphs. Existing graph neural networks use the synchronous distributed computing model and aggregate their neighbors in each…

Machine Learning · Computer Science 2022-05-25 Lukas Faber , Roger Wattenhofer

Graph Neural Networks (GNNs) have seen significant advances in recent years, yet their application to multigraphs, where parallel edges exist between the same pair of nodes, remains under-explored. Standard GNNs, designed for simple graphs,…

Machine Learning · Computer Science 2024-12-11 H. Çağrı Bilgi , Lydia Y. Chen , Kubilay Atasu

Explaining graph neural networks (GNNs) has become more and more important recently. Higher-order interpretation schemes, such as GNN-LRP (layer-wise relevance propagation for GNN), emerged as powerful tools for unraveling how different…

Machine Learning · Computer Science 2026-05-22 Ping Xiong , Thomas Schnake , Grégoire Montavon , Klaus-Robert Müller , Shinichi Nakajima

Graph Neural Networks (GNNs) have shown promising potential in graph representation learning. The majority of GNNs define a local message-passing mechanism, propagating information over the graph by stacking multiple layers. These methods,…

Machine Learning · Computer Science 2024-02-20 Ali Behrouz , Farnoosh Hashemi

Graph Neural Networks (GNNs) that are based on the message passing (MP) paradigm generally exchange information between 1-hop neighbors to build node representations at each layer. In principle, such networks are not able to capture…

Machine Learning · Computer Science 2023-11-29 Vijay Prakash Dwivedi , Ladislav Rampášek , Mikhail Galkin , Ali Parviz , Guy Wolf , Anh Tuan Luu , Dominique Beaini

Hypergraphs are crucial for modelling higher-order interactions in real-world data. Hypergraph neural networks (HNNs) effectively utilise these structures by message passing to generate informative node features for various downstream tasks…

Machine Learning · Computer Science 2025-03-12 Bohan Tang , Zexi Liu , Keyue Jiang , Siheng Chen , Xiaowen Dong

Massive Multiple-Input Multiple-Out (MIMO) detection is an important problem in modern wireless communication systems. While traditional Belief Propagation (BP) detectors perform poorly on loopy graphs, the recent Graph Neural Networks…

Information Theory · Computer Science 2022-06-15 Hongyi Li , Junxiang Wang , Yongchao Wang

Graph neural networks based on iterative one-hop message passing have been shown to struggle in harnessing the information from distant nodes effectively. Conversely, graph transformers allow each node to attend to all other nodes directly,…

Machine Learning · Computer Science 2024-06-06 Yuhui Ding , Antonio Orvieto , Bobby He , Thomas Hofmann

Graph Neural Networks (GNNs) have revolutionized the field of graph learning by learning expressive graph representations from massive graph data. As a common pattern to train powerful GNNs, the "pre-training, adaptation" scheme first…

Machine Learning · Computer Science 2025-10-28 Xingbo Fu , Zhenyu Lei , Zihan Chen , Binchi Zhang , Chuxu Zhang , Jundong Li

Graph neural networks (GNNs) have achieved champion in wide applications. Neural message passing is a typical key module for feature propagation by aggregating neighboring features. In this work, we propose a new message passing based on…

Machine Learning · Computer Science 2023-03-01 Xinliang Liu , Bingxin Zhou , Chutian Zhang , Yu Guang Wang

Graph Neural Networks (GNNs) have emerged as powerful tools for predicting outcomes in graph-structured data. However, a notable limitation of GNNs is their inability to provide robust uncertainty estimates, which undermines their…

Machine Learning · Computer Science 2024-10-10 S. Akansha

Pre-trained graph neural networks (GNNs) transfer well, but adapting them to downstream tasks remains challenging due to mismatches between pre-training objectives and task requirements. Graph prompt tuning offers a parameter-efficient…

Machine Learning · Computer Science 2026-02-06 Long D. Nguyen , Binh P. Nguyen

Graph neural networks (GNNs) and message passing neural networks (MPNNs) have been proven to be expressive for subgraph structures in many applications. Some applications in heterogeneous graphs require explicit edge modeling, such as…

Machine Learning · Computer Science 2021-12-17 Xin Liu , Yangqiu Song