English
Related papers

Related papers: Are We Measuring Oversmoothing in Graph Neural Net…

200 papers

Graph neural networks (GNNs) have achieved tremendous success on multiple graph-based learning tasks by fusing network structure and node features. Modern GNN models are built upon iterative aggregation of neighbor's/proximity features by…

Machine Learning · Computer Science 2021-06-15 Susheel Suresh , Vinith Budde , Jennifer Neville , Pan Li , Jianzhu Ma

Graph neural networks (GNNs) are able to leverage the structure of graph data by passing messages along the edges of the graph. While this allows GNNs to learn features depending on the graph structure, for certain graph topologies it leads…

Machine Learning · Computer Science 2023-02-17 Kedar Karhadkar , Pradeep Kr. Banerjee , Guido Montúfar

A common issue in Graph Neural Networks (GNNs) is known as over-smoothing. By increasing the number of iterations within the message-passing of GNNs, the nodes' representations of the input graph align with each other and become…

Machine Learning · Computer Science 2021-10-22 Christian M. M. Frey , Yunpu Ma , Matthias Schubert

Graph Neural Networks (GNNs) have become mainstream methods for solving the semi-supervised node classification problem. However, due to the uneven location distribution of labeled nodes in the graph, labeled nodes are only accessible to a…

Machine Learning · Computer Science 2023-12-22 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Long Jin

Most graph neural networks (GNNs) are prone to the phenomenon of over-squashing in which node features become insensitive to information from distant nodes in the graph. Recent works have shown that the topology of the graph has the…

Machine Learning · Computer Science 2023-11-30 Julia Balla

Graph Neural Networks (GNNs) have emerged as one of the leading approaches for machine learning on graph-structured data. Despite their great success, critical computational challenges such as over-smoothing, over-squashing, and limited…

Machine Learning · Computer Science 2023-09-14 Zhiqi Shao , Dai Shi , Andi Han , Yi Guo , Qibin Zhao , Junbin Gao

Recommendation models utilizing Graph Convolutional Networks (GCNs) have achieved state-of-the-art performance, as they can integrate both the node information and the topological structure of the user-item interaction graph. However, these…

Information Retrieval · Computer Science 2022-11-28 Xin Zhou , Donghui Lin , Yong Liu , Chunyan Miao

Graph Neural Networks (GNNs) are powerful at solving graph classification tasks, yet applied problems often contain noisy labels. In this work, we study GNN robustness to label noise, demonstrate GNN failure modes when models struggle to…

Message Passing Neural Networks (MPNNs) is the building block of graph foundation models, but fundamentally suffer from oversmoothing and oversquashing. There has recently been a surge of interest in fixing both issues. Existing efforts…

Machine Learning · Computer Science 2025-10-21 Li Sun , Zhenhao Huang , Ming Zhang , Philip S. Yu

Graph neural networks (GNNs) are a powerful solution for various structure learning applications due to their strong representation capabilities for graph data. However, traditional GNNs, relying on message-passing mechanisms that gather…

Machine Learning · Computer Science 2024-03-19 Wei Duan , Jie Lu , Yu Guang Wang , Junyu Xuan

Graph Convolutional Network (GCN) with the powerful capacity to explore graph-structural data has gained noticeable success in recent years. Nonetheless, most of the existing GCN-based models suffer from the notorious over-smoothing issue,…

Machine Learning · Computer Science 2023-04-17 Zhaoliang Chen , Zhihao Wu , Zhenghong Lin , Shiping Wang , Claudia Plant , Wenzhong Guo

Graph convolutional networks (GCNs) have shown promising results in processing graph data by extracting structure-aware features. This gave rise to extensive work in geometric deep learning, focusing on designing network architectures that…

Machine Learning · Computer Science 2022-01-20 Yimeng Min , Frederik Wenkel , Guy Wolf

Despite the recent success of graph neural networks (GNN), common architectures often exhibit significant limitations, including sensitivity to oversmoothing, long-range dependencies, and spurious edges, e.g., as can occur as a result of…

Machine Learning · Computer Science 2021-12-06 Yongyi Yang , Tang Liu , Yangkun Wang , Jinjing Zhou , Quan Gan , Zhewei Wei , Zheng Zhang , Zengfeng Huang , David Wipf

Graph Neural Networks (GNNs) extend the success of neural networks to graph-structured data by accounting for their intrinsic geometry. While extensive research has been done on developing GNN models with superior performance according to a…

Graph neural networks (GNNs) have achieved success in various inference tasks on graph-structured data. However, common challenges faced by many GNNs in the literature include the problem of graph node embedding under various geometries and…

Machine Learning · Computer Science 2023-03-03 Qiyu Kang , Kai Zhao , Yang Song , Sijie Wang , Rui She , Wee Peng Tay

As one of the most fundamental tasks in graph theory, subgraph matching is a crucial task in many fields, ranging from information retrieval, computer vision, biology, chemistry and natural language processing. Yet subgraph matching problem…

Machine Learning · Computer Science 2022-09-19 Zixun Lan , Limin Yu , Linglong Yuan , Zili Wu , Qiang Niu , Fei Ma

State-of-the-art Graph Neural Networks (GNNs) have limited scalability with respect to the graph and model sizes. On large graphs, increasing the model depth often means exponential expansion of the scope (i.e., receptive field). Beyond…

Recent studies on Graph Neural Networks(GNNs) provide both empirical and theoretical evidence supporting their effectiveness in capturing structural patterns on both homophilic and certain heterophilic graphs. Notably, most real-world…

Machine Learning · Computer Science 2023-10-17 Haitao Mao , Zhikai Chen , Wei Jin , Haoyu Han , Yao Ma , Tong Zhao , Neil Shah , Jiliang Tang

Graph neural networks (GNNs) have become pivotal tools for processing graph-structured data, leveraging the message passing scheme as their core mechanism. However, traditional GNNs often grapple with issues such as instability,…

Spectral Theory · Mathematics 2026-05-20 Yuanhong Jiang , Dongmian Zou , Xiaoqun Zhang , Yu Guang Wang

In recent years, Graph Convolutional Networks (GCNs) have gained popularity for their exceptional ability to process graph-structured data. Existing GCN-based approaches typically employ a shallow model architecture due to the…

Machine Learning · Computer Science 2025-04-22 Jielong Lu , Zhihao Wu , Zhiling Cai , Yueyang Pi , Shiping Wang
‹ Prev 1 4 5 6 7 8 10 Next ›