English
Related papers

Related papers: Position: Spectral GNNs Are Neither Spectral Nor S…

200 papers

Effective node representation lies at the heart of Graph Neural Networks (GNNs), as it directly impacts their ability to perform downstream tasks such as node classification and link prediction. Most existing GNNs, particularly message…

Machine Learning · Computer Science 2025-11-26 Md Joshem Uddin , Astrit Tola , Varin Sikand , Cuneyt Gurcan Akcora , Baris Coskunuzer

Real-world networks exhibit prominent hierarchical and modular structures, with various subgraphs as building blocks. Most existing studies simply consider distinct subgraphs as motifs and use only their numbers to characterize the…

Social and Information Networks · Computer Science 2019-12-17 Qi Xuan , Jinhuan Wang , Minghao Zhao , Junkun Yuan , Chenbo Fu , Zhongyuan Ruan , Guanrong Chen

Over-smoothing in Graph Neural Networks (GNNs) causes collapse in distinct node features, particularly on heterophilic graphs where adjacent nodes often have dissimilar labels. Although sheaf neural networks partially mitigate this problem,…

Machine Learning · Computer Science 2025-11-11 Yoonhyuk Choi , Jiho Choi , Chong-Kwon Kim

It has been observed that message-passing graph neural networks (GNN) sometimes struggle to maintain a healthy balance between the efficient/scalable modeling of long-range dependencies across nodes while avoiding unintended consequences…

Machine Learning · Computer Science 2025-05-21 Yongyi Yang , Tang Liu , Yangkun Wang , Zengfeng Huang , David Wipf

While Graph Neural Networks (GNNs) have achieved remarkable success, their design largely relies on empirical intuition rather than theoretical understanding. In this paper, we present a comprehensive analysis of GNN behavior through three…

Machine Learning · Computer Science 2025-02-04 Qin Jiang , Chengjia Wang , Michael Lones , Wei Pang

Graph neural networks (GNNs) have emerged as powerful tools for processing relational data in applications. However, GNNs suffer from the problem of oversmoothing, the property that the features of all nodes exponentially converge to the…

Machine Learning · Statistics 2025-05-22 Bastian Epping , Alexandre René , Moritz Helias , Michael T. Schaub

Graph Neural Networks (GNNs) require a relatively large number of labeled nodes and a reliable/uncorrupted graph connectivity structure in order to obtain good performance on the semi-supervised node classification task. The performance of…

Machine Learning · Computer Science 2021-07-01 Abdullah Alchihabi , Yuhong Guo

Graph Neural Networks (GNNs) have emerged as a powerful category of learning architecture for handling graph-structured data. However, existing GNNs typically ignore crucial structural characteristics in node-induced subgraphs, which thus…

Machine Learning · Computer Science 2023-06-13 Kaixuan Chen , Shunyu Liu , Tongtian Zhu , Tongya Zheng , Haofei Zhang , Zunlei Feng , Jingwen Ye , Mingli Song

Graph neural networks (GNN) have shown outstanding applications in many fields where data is fundamentally represented as graphs (e.g., chemistry, biology, recommendation systems). In this vein, communication networks comprise many…

While Graph Neural Networks (GNNs) have achieved remarkable results in a variety of applications, recent studies exposed important shortcomings in their ability to capture the structure of the underlying graph. It has been shown that the…

Machine Learning · Computer Science 2023-09-26 Giorgos Bouritsas , Fabrizio Frasca , Stefanos Zafeiriou , Michael M. Bronstein

Graph Neural Networks (GNNs) have excelled in handling graph-structured data, attracting significant research interest. However, two primary challenges have emerged: interference between topology and attributes distorting node…

Machine Learning · Computer Science 2024-11-19 Yachao Yang , Yanfeng Sun , Jipeng Guo , Junbin Gao , Shaofan Wang , Fujiao Ju , Baocai Yin

Graph Neural Networks (GNNs) have achieved significant success in addressing node classification tasks. However, the effectiveness of traditional GNNs degrades on heterophilic graphs, where connected nodes often belong to different labels…

Machine Learning · Computer Science 2025-11-11 Asela Hevapathige , Asiri Wijesinghe , Ahad N. Zehmakan

Many improvements on GNNs can be deemed as operations on the spectrum of the underlying graph matrix, which motivates us to directly study the characteristics of the spectrum and their effects on GNN performance. By generalizing most…

Machine Learning · Computer Science 2022-06-22 Mingqi Yang , Yanming Shen , Rui Li , Heng Qi , Qiang Zhang , Baocai Yin

Graph neural networks (GNNs) have demonstrated remarkable capabilities in learning from graph-structured data, often outperforming traditional Multilayer Perceptrons (MLPs) in numerous graph-based tasks. Although existing works have…

Machine Learning · Computer Science 2025-06-09 Wei Huang , Yuan Cao , Haonan Wang , Xin Cao , Taiji Suzuki

Despite their theoretical advantages, spectral methods based on the graph Fourier transform (GFT) are seldom used in graph neural networks (GNNs) due to the cost of computing the eigenbasis and the lack of vertex-domain locality in spectral…

Machine Learning · Computer Science 2026-02-24 Samuel Fernández-Menduiña , Eduardo Pavez , Antonio Ortega

Graph neural networks (GNNs) have recently been demonstrated to perform well on a variety of network-based tasks such as decentralized control and resource allocation, and provide computationally efficient methods for these tasks which have…

Machine Learning · Computer Science 2021-12-15 Raghu Arghal , Eric Lei , Shirin Saeedi Bidokhti

Fairness-aware Graph Neural Networks (GNNs) often face a challenging trade-off, where prioritizing fairness may require compromising utility. In this work, we re-examine fairness through the lens of spectral graph theory, aiming to…

Machine Learning · Computer Science 2024-08-14 Renqiang Luo , Huafei Huang , Shuo Yu , Zhuoyang Han , Estrid He , Xiuzhen Zhang , Feng Xia

Graph Transformers (GTs) have recently emerged as popular alternatives to traditional message-passing Graph Neural Networks (GNNs), due to their theoretically superior expressiveness and impressive performance reported on standard node…

Machine Learning · Computer Science 2024-10-29 Yuankai Luo , Lei Shi , Xiao-Ming Wu

Graph heterophily, where connected nodes have different labels, has attracted significant interest recently. Most existing works adopt a simplified approach - using low-pass filters for homophilic graphs and high-pass filters for…

Machine Learning · Computer Science 2025-10-14 Shuaicheng Zhang , Haohui Wang , Junhong Lin , Xiaojie Guo , Yada Zhu , Si Zhang , Dongqi Fu , Dawei Zhou

Graph neural networks (GNNs) have emerged as a powerful framework for a wide range of node-level graph learning tasks. However, their performance typically depends on random or minimally informed initial feature representations, where poor…

Machine Learning · Computer Science 2026-02-24 Shiyu Chen , Cencheng Shen , Youngser Park , Carey E. Priebe