English
Related papers

Related papers: Preventing Representational Rank Collapse in MPNNs…

200 papers

Graph-structured data are ubiquitous. However, graphs encode diverse types of information and thus play different roles in data representation. In this paper, we distinguish the \textit{representational} and the \textit{correlational} roles…

Machine Learning · Computer Science 2021-03-22 Jiaqi Ma , Bo Chang , Xuefei Zhang , Qiaozhu Mei

Graph neural networks (GNNs) have achieved champion in wide applications. Neural message passing is a typical key module for feature propagation by aggregating neighboring features. In this work, we propose a new message passing based on…

Machine Learning · Computer Science 2023-03-01 Xinliang Liu , Bingxin Zhou , Chutian Zhang , Yu Guang Wang

In this paper we cast neural networks defined on graphs as message-passing neural networks (MPNNs) in order to study the distinguishing power of different classes of such models. We are interested in whether certain architectures are able…

Machine Learning · Computer Science 2020-04-07 Floris Geerts , Filip Mazowiecki , Guillermo A. Pérez

Graph convolutional learning has led to many exciting discoveries in diverse areas. However, in some applications, traditional graphs are insufficient to capture the structure and intricacies of the data. In such scenarios, multigraphs…

Machine Learning · Computer Science 2023-04-26 Landon Butler , Alejandro Parada-Mayorga , Alejandro Ribeiro

Graph neural networks (GNNs) are widely used in domains like social networks and biological systems. However, the locality assumption of GNNs, which limits information exchange to neighboring nodes, hampers their ability to capture…

Machine Learning · Computer Science 2023-07-04 Tingting Dan , Jiaqi Ding , Ziquan Wei , Shahar Z Kovalsky , Minjeong Kim , Won Hwa Kim , Guorong Wu

Despite the enormous success of graph neural networks (GNNs), most existing GNNs can only be applicable to undirected graphs where relationships among connected nodes are two-way symmetric (i.e., information can be passed back and forth).…

Machine Learning · Computer Science 2021-10-15 Zhuo Tan , Bin Liu , Guosheng Yin

Distributed power allocation is important for interference-limited wireless networks with dense transceiver pairs. In this paper, we aim to design low signaling overhead distributed power allocation schemes by using graph neural networks…

Signal Processing · Electrical Eng. & Systems 2023-03-06 Yifan Gu , Changyang She , Zhi Quan , Chen Qiu , Xiaodong Xu

In this paper, we provide a theory of using graph neural networks (GNNs) for multi-node representation learning (where we are interested in learning a representation for a set of more than one node, such as link). We know that GNN is…

Machine Learning · Computer Science 2022-01-19 Muhan Zhang , Pan Li , Yinglong Xia , Kai Wang , Long Jin

Recently a variety of methods have been developed to encode graphs into low-dimensional vectors that can be easily exploited by machine learning algorithms. The majority of these methods start by embedding the graph nodes into a…

Machine Learning · Computer Science 2018-09-13 Yu Jin , Joseph F. JaJa

Graph Neural Networks (GNNs) have seen significant advances in recent years, yet their application to multigraphs, where parallel edges exist between the same pair of nodes, remains under-explored. Standard GNNs, designed for simple graphs,…

Machine Learning · Computer Science 2024-12-11 H. Çağrı Bilgi , Lydia Y. Chen , Kubilay Atasu

Inspired by the extensive success of deep learning, graph neural networks (GNNs) have been proposed to learn expressive node representations and demonstrated promising performance in various graph learning tasks. However, existing endeavors…

Machine Learning · Computer Science 2022-04-05 Kaize Ding , Jianling Wang , James Caverlee , Huan Liu

Existing Graph Neural Networks (GNNs) follow the message-passing mechanism that conducts information interaction among nodes iteratively. While considerable progress has been made, such node interaction paradigms still have the following…

Machine Learning · Computer Science 2023-04-14 Jie Chen , Zilong Li , Yin Zhu , Junping Zhang , Jian Pu

Over-smoothing remains a major challenge in Graph Neural Networks (GNNs), where repeated message passing causes node representations to converge and lose discriminative power. To address this, we propose a novel node selection strategy…

Machine Learning · Computer Science 2025-05-29 Hyunsik Yun

Hypergraph representations are both more efficient and better suited to describe data characterized by relations between two or more objects. In this work, we present a new graph neural network based on message passing capable of processing…

Machine Learning · Computer Science 2022-09-19 Sajjad Heydari , Lorenzo Livi

In recent years, Graph Neural Networks (GNNs) have been popular in the graph classification task. Currently, shallow GNNs are more common due to the well-known over-smoothing problem facing deeper GNNs. However, they are sub-optimal without…

Machine Learning · Computer Science 2023-02-20 Lanning Wei , Zhiqiang He , Huan Zhao , Quanming Yao

Geometric deep learning has made great strides towards generalizing the design of structure-aware neural networks from traditional domains to non-Euclidean ones, giving rise to graph neural networks (GNN) that can be applied to…

Machine Learning · Statistics 2024-10-28 Frederik Wenkel , Yimeng Min , Matthew Hirn , Michael Perlmutter , Guy Wolf

Hypergraphs effectively model higher-order relationships in natural phenomena, capturing complex interactions beyond pairwise connections. We introduce a novel hypergraph message passing framework inspired by interacting particle systems,…

Machine Learning · Computer Science 2025-05-27 Yixuan Ma , Kai Yi , Pietro Lio , Shi Jin , Yu Guang Wang

While Graph Neural Networks (GNNs) have achieved remarkable success, their design largely relies on empirical intuition rather than theoretical understanding. In this paper, we present a comprehensive analysis of GNN behavior through three…

Machine Learning · Computer Science 2025-02-04 Qin Jiang , Chengjia Wang , Michael Lones , Wei Pang

Message passing neural networks (MPNN) have seen a steep rise in popularity since their introduction as generalizations of convolutional neural networks to graph-structured data, and are now considered state-of-the-art tools for solving a…

Machine Learning · Computer Science 2022-08-05 Sohir Maskey , Ron Levie , Yunseok Lee , Gitta Kutyniok

Topological deep learning (TDL) has emerged as a powerful tool for modeling higher-order interactions in relational data. However, phenomena such as oversquashing in topological message-passing remain understudied and lack theoretical…

Machine Learning · Computer Science 2025-06-10 Diaaeldin Taha , James Chapman , Marzieh Eidi , Karel Devriendt , Guido Montúfar