English
Related papers

Related papers: Gumbel-MPNN: Graph Rewiring with Gumbel-Softmax

200 papers

Node classification tasks on graphs are addressed via fully-trained deep message-passing models that learn a hierarchy of node representations via multiple aggregations of a node's neighbourhood. While effective on graphs that exhibit a…

Machine Learning · Computer Science 2023-07-19 Alessio Micheli , Domenico Tortorella

Recent years have witnessed fast developments of graph neural networks (GNNs) that have benefited myriad graph analytic tasks and applications. Most GNNs rely on the homophily assumption that nodes belonging to the same class are more…

Machine Learning · Computer Science 2026-04-21 Xin Zheng , Yi Wang , Yixin Liu , Ming Li , Miao Zhang , Di Jin , Philip S. Yu , Shirui Pan

Graph neural networks (GNNs) have achieved remarkable advances in graph-oriented tasks. However, real-world graphs invariably contain a certain proportion of heterophilous nodes, challenging the homophily assumption of traditional GNNs and…

Machine Learning · Computer Science 2025-02-04 Jiajun Zhou , Shengbo Gong , Xuanze Chen , Chenxuan Xie , Shanqing Yu , Qi Xuan , Xiaoniu Yang

Unsupervised graph representation learning (UGRL) based on graph neural networks (GNNs), has received increasing attention owing to its efficacy in handling graph-structured data. However, existing UGRL methods ideally assume that the node…

Machine Learning · Computer Science 2024-07-30 Shiyuan Li , Yixin Liu , Qingfeng Chen , Geoffrey I. Webb , Shirui Pan

Real-world graphs exhibit increasing heterophily, where nodes no longer tend to be connected to nodes with the same label, challenging the homophily assumption of classical graph neural networks (GNNs) and impeding their performance.…

Machine Learning · Computer Science 2024-08-22 Jiajun Zhou , Chenxuan Xie , Shengbo Gong , Jiaxu Qian , Shanqing Yu , Qi Xuan , Xiaoniu Yang

Graph Nerual Networks (GNNs) are effective models in graph embedding. It extracts shallow features and neighborhood information by aggregating neighbor information to learn the embedding representation of different nodes. However, the local…

Social and Information Networks · Computer Science 2023-12-14 Kejia Zhang

With the widespread use of Graph Neural Networks (GNNs) for representation learning from network data, the fairness of GNN models has raised great attention lately. Fair GNNs aim to ensure that node representations can be accurately…

Social and Information Networks · Computer Science 2024-10-23 Guixian Zhang , Guan Yuan , Debo Cheng , Lin Liu , Jiuyong Li , Shichao Zhang

The Gumbel-Softmax is a continuous distribution over the simplex that is often used as a relaxation of discrete distributions. Because it can be readily interpreted and easily reparameterized, it enjoys widespread use. We propose a modular…

Machine Learning · Statistics 2022-08-30 Andres Potapczynski , Gabriel Loaiza-Ganem , John P. Cunningham

Graph Neural Networks (GNNs) learn low dimensional representations of nodes by aggregating information from their neighborhood in graphs. However, traditional GNNs suffer from two fundamental shortcomings due to their local ($l$-hop…

Machine Learning · Computer Science 2021-04-28 Kashob Kumar Roy , Amit Roy , A K M Mahbubur Rahman , M Ashraful Amin , Amin Ahsan Ali

Graph Neural Networks (GNNs) excel at learning from structured data, yet fairness in regression tasks remains underexplored. Existing approaches mainly target classification and representation-level debiasing, which cannot fully address the…

Machine Learning · Computer Science 2025-10-24 Soyoung Park , Sungsu Lim

Heterophily, or the tendency of connected nodes in networks to have different class labels or dissimilar features, has been identified as challenging for many Graph Neural Network (GNN) models. While the challenges of applying GNNs for node…

Machine Learning · Computer Science 2024-09-27 Jiong Zhu , Gaotang Li , Yao-An Yang , Jing Zhu , Xuehao Cui , Danai Koutra

A hallmark of graph neural networks is their ability to distinguish the isomorphism class of their inputs. This study derives hardness results for the classification variant of graph isomorphism in the message-passing model (MPNN). MPNN…

Machine Learning · Computer Science 2020-10-19 Andreas Loukas

Message-passing graph neural networks (MPGNNs) are commonly compared with the Weisfeiler-Lehman (WL) color-refinement procedure, but this comparison does not quantify the resource parameters a network needs to realize color refinement with…

Machine Learning · Computer Science 2026-05-11 Guanyu Cui , Yuhe Guo , Zhewei Wei , Hsin-Hao Su

Graph Neural Networks (GNNs) have shown remarkable performance on graph-structured data. However, recent empirical studies suggest that GNNs are very susceptible to distribution shift. There is still significant ambiguity about why…

Machine Learning · Computer Science 2023-06-07 Qi Zhu , Yizhu Jiao , Natalia Ponomareva , Jiawei Han , Bryan Perozzi

Graph Convolutional Networks (GCNs) are predominantly tailored for graphs displaying homophily, where similar nodes connect, but often fail on heterophilic graphs. The strategy of adopting distinct approaches to learn from homophilic and…

Machine Learning · Computer Science 2025-04-09 Han Lei , Jiaxing Xu , Xia Dong , Yiping Ke

We bridge two research directions on graph neural networks (GNNs), by formalizing the relation between heterophily of node labels (i.e., connected nodes tend to have dissimilar labels) and the robustness of GNNs to adversarial attacks. Our…

Machine Learning · Computer Science 2022-07-26 Jiong Zhu , Junchen Jin , Donald Loveland , Michael T. Schaub , Danai Koutra

Graphs with heterophily have been regarded as challenging scenarios for Graph Neural Networks (GNNs), where nodes are connected with dissimilar neighbors through various patterns. In this paper, we present theoretical understandings of the…

Machine Learning · Computer Science 2024-06-05 Junfu Wang , Yuanfang Guo , Liang Yang , Yunhong Wang

Flexible duplex networks allow users to dynamically employ uplink and downlink channels without static time scheduling, thereby utilizing the network resources efficiently. This work investigates the sum-rate maximization of flexible duplex…

Networking and Internet Architecture · Computer Science 2023-03-16 Tharaka Perera , Saman Atapattu , Yuting Fang , Prathapasinghe Dharmawansa , Jamie Evans

Both Transformer and Graph Neural Networks (GNNs) have been employed in the domain of learning to rank (LTR). However, these approaches adhere to two distinct yet complementary problem formulations: ranking score regression based on…

Machine Learning · Computer Science 2024-09-26 Yuchen Li , Haoyi Xiong , Linghe Kong , Zeyi Sun , Hongyang Chen , Shuaiqiang Wang , Dawei Yin

Graph neural networks (GNNs) have recently emerged as a dominant paradigm for machine learning with graphs. Research on GNNs has mainly focused on the family of message passing neural networks (MPNNs). Similar to the Weisfeiler-Leman (WL)…

Machine Learning · Statistics 2022-07-05 Giannis Nikolentzos , George Dasoulas , Michalis Vazirgiannis