English
Related papers

Related papers: PANDA: Expanded Width-Aware Message Passing Beyond…

200 papers

Graph Neural Networks (GNNs) have shown great potential in the field of graph representation learning. Standard GNNs define a local message-passing mechanism which propagates information over the whole graph domain by stacking multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Xiaoxin He , Bryan Hooi , Thomas Laurent , Adam Perold , Yann LeCun , Xavier Bresson

This paper examines the problem of information routing in a large-scale communication network, which can be formulated as a constrained statistical learning problem having access to only local information. We delineate a novel State…

Networking and Internet Architecture · Computer Science 2024-12-10 Sourajit Das , Navid NaderiAlizadeh , Alejandro Ribeiro

Graph Neural Networks (GNNs) are popular deep learning models designed to process graph-structured data through recursive neighborhood aggregations in the message passing process. When applied to semi-supervised node classification, the…

Machine Learning · Computer Science 2025-01-13 Kevin Mancini , Islem Rekik

Graph Neural Networks (GNNs) have shown great potential in graph data analysis due to their powerful representation capabilities. However, as the network depth increases, the issue of over-smoothing becomes more severe, causing node…

Machine Learning · Computer Science 2025-07-09 Kaichen Ouyang

Most graph neural networks follow the message passing mechanism. However, it faces the over-smoothing problem when multiple times of message passing is applied to a graph, causing indistinguishable node representations and prevents the…

Machine Learning · Computer Science 2023-02-06 Yunchong Song , Chenghu Zhou , Xinbing Wang , Zhouhan Lin

Topological deep learning (TDL) has emerged as a powerful tool for modeling higher-order interactions in relational data. However, phenomena such as oversquashing in topological message-passing remain understudied and lack theoretical…

Machine Learning · Computer Science 2025-06-10 Diaaeldin Taha , James Chapman , Marzieh Eidi , Karel Devriendt , Guido Montúfar

Graph neural networks (GNNs) are widely used in graph learning and most architectures propagate information by passing messages between vertices. In this work, we shift our attention to GNNs that perform message passing on edges and…

Machine Learning · Computer Science 2026-02-03 Pablo Barceló , Fabian Jogl , Alexander Kozachinskiy , Matthias Lanzinger , Stefan Neumann , Cristóbal Rojas

Power control for the device-to-device interference channel with single-antenna transceivers has been widely analyzed with both model-based methods and learning-based approaches. Although the learning-based approaches, i.e., datadriven and…

Signal Processing · Electrical Eng. & Systems 2023-07-25 Dohoon Kim , Shenghui Song

Graph neural networks are powerful architectures for structured datasets. However, current methods struggle to represent long-range dependencies. Scaling the depth or width of GNNs is insufficient to broaden receptive fields as larger GNNs…

Machine Learning · Computer Science 2022-01-24 Zhanghao Wu , Paras Jain , Matthew A. Wright , Azalia Mirhoseini , Joseph E. Gonzalez , Ion Stoica

A prominent paradigm for graph neural networks is based on the message-passing framework. In this framework, information communication is realized only between neighboring nodes. The challenge of approaches that use this paradigm is to…

Machine Learning · Computer Science 2023-09-18 Maysam Behmanesh , Maximilian Krahn , Maks Ovsjanikov

Message-passing Graph Neural Networks (GNNs), which collect information from adjacent nodes achieve dismal performance on heterophilic graphs. Various schemes have been proposed to solve this problem, and propagating signed information on…

Machine Learning · Computer Science 2024-10-01 Yoonhyuk Choi , Jiho Choi , Taewook Ko , Chong-Kwon Kim

Message passing neural networks (MPNNs) learn the representation of graph-structured data based on graph original information, including node features and graph structures, and have shown astonishing improvement in node classification…

Machine Learning · Computer Science 2023-01-30 Xiao Liu , Lijun Zhang , Hui Guan

Graph Neural Networks (GNNs) have become important tools for machine learning on graph-structured data. In this paper, we explore the synergistic combination of graph encoding, graph rewiring, and graph attention, by introducing Graph…

Machine Learning · Computer Science 2025-03-18 Tongzhou Liao , Barnabás Póczos

Graph Neural Networks (GNNs) have become essential in high-stakes domains such as drug discovery, yet their black-box nature remains a significant barrier to trustworthiness. While self-explainable GNNs attempt to bridge this gap, they…

Machine Learning · Computer Science 2026-02-25 Chuqin Geng , Li Zhang , Haolin Ye , Ziyu Zhao , Yuhe Jiang , Tara Saba , Xinyu Wang , Xujie Si

Graph Neural Network (GNN) resembles the diffusion process, leading to the over-smoothing of learned representations when stacking many layers. Hence, the reverse process of message passing can produce the distinguishable node…

Social and Information Networks · Computer Science 2024-06-12 MoonJeong Park , Jaeseung Heo , Dongwoo Kim

Graph neural networks (GNNs) emerged recently as a standard toolkit for learning from data on graphs. Current GNN designing works depend on immense human expertise to explore different message-passing mechanisms, and require manual…

Machine Learning · Computer Science 2021-06-25 Shaofei Cai , Liang Li , Jincan Deng , Beichen Zhang , Zheng-Jun Zha , Li Su , Qingming Huang

We consider a transmitter that encodes data packets using network coding and broadcasts coded packets. A receiver employing network decoding recovers the data packets if a sufficient number of error-free coded packets are gathered. The…

Information Theory · Computer Science 2024-02-13 Ioannis Chatzigeorgiou , Dmitry Savostyanov

The celebrated message-passing updates for graph neural networks allow representing large-scale graphs with local and computationally tractable updates. However, the updates suffer from backtracking, i.e., a message flowing through the same…

Machine Learning · Computer Science 2024-09-26 Seonghyun Park , Narae Ryu , Gahee Kim , Dongyeop Woo , Se-Young Yun , Sungsoo Ahn

Several recent works use positional encodings to extend the receptive fields of graph neural network (GNN) layers equipped with attention mechanisms. These techniques, however, extend receptive fields to the complete graph, at substantial…

Machine Learning · Computer Science 2023-12-14 Rickard Brüel-Gabrielsson , Mikhail Yurochkin , Justin Solomon

Graph Neural Networks learn on graph-structured data by iteratively aggregating local neighborhood information. While this local message passing paradigm imparts a powerful inductive bias and exploits graph sparsity, it also yields three…

Machine Learning · Computer Science 2025-11-07 Ryien Hosseini , Filippo Simini , Venkatram Vishwanath , Rebecca Willett , Henry Hoffmann