English
Related papers

Related papers: Rethinking Over-Smoothing in Graph Neural Networks…

200 papers

Graph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data across various domains. Despite their great successful, one critical challenge is often overlooked by existing works, i.e., the…

Machine Learning · Computer Science 2024-02-15 Tianxiang Zhao , Xiang Zhang , Suhang Wang

Graph Echo State Networks (GESN) have already demonstrated their efficacy and efficiency in graph classification tasks. However, semi-supervised node classification brought out the problem of over-smoothing in end-to-end trained deep…

Machine Learning · Computer Science 2022-10-31 Domenico Tortorella , Alessio Micheli

Graph Neural Networks (GNNs) have proven effective in various medical imaging applications, such as automated disease diagnosis. However, due to the local neighborhood aggregation paradigm in message passing which characterizes these…

Machine Learning · Computer Science 2024-11-05 K. Mancini , I. Rekik

Graph neural networks (GNNs) have achieved tremendous success on multiple graph-based learning tasks by fusing network structure and node features. Modern GNN models are built upon iterative aggregation of neighbor's/proximity features by…

Machine Learning · Computer Science 2021-06-15 Susheel Suresh , Vinith Budde , Jennifer Neville , Pan Li , Jianzhu Ma

In this work, we propose to train a graph neural network via resampling from a graphon estimate obtained from the underlying network data. More specifically, the graphon or the link probability matrix of the underlying network is first…

Machine Learning · Computer Science 2021-09-07 Ziqing Hu , Yihao Fang , Lizhen Lin

Graph Neural Networks (GNNs) have been emerging as a promising method for relational representation including recommender systems. However, various challenging issues of social graphs hinder the practical usage of GNNs for social…

Social and Information Networks · Computer Science 2019-08-08 Kyung-Min Kim , Donghyun Kwak , Hanock Kwak , Young-Jin Park , Sangkwon Sim , Jae-Han Cho , Minkyu Kim , Jihun Kwon , Nako Sung , Jung-Woo Ha

Graph convolutional networks have been successfully applied in various graph-based tasks. In a typical graph convolutional layer, node features are updated by aggregating neighborhood information. Repeatedly applying graph convolutions can…

Machine Learning · Computer Science 2022-07-11 Haimin Zhang , Min Xu , Guoqiang Zhang , Kenta Niwa

Graphs are useful for representing various realworld objects. However, graph neural networks (GNNs) tend to suffer from over-smoothing, where the representations of nodes of different classes become similar as the number of layers…

Machine Learning · Computer Science 2024-10-22 Jun Kato , Airi Mita , Keita Gobara , Akihiro Inokuchi

A graph convolutional network (GCN) employs a graph filtering kernel tailored for data with irregular structures. However, simply stacking more GCN layers does not improve performance; instead, the output converges to an uninformative…

Machine Learning · Computer Science 2022-11-04 Jin Zeng , Yang Liu , Gene Cheung , Wei Hu

Graph Neural Networks (GNNs) have attracted much attention due to their ability in learning representations from graph-structured data. Despite the successful applications of GNNs in many domains, the optimization of GNNs is less well…

Machine Learning · Computer Science 2023-09-06 Langzhang Liang , Zenglin Xu , Zixing Song , Irwin King , Yuan Qi , Jieping Ye

Graph neural networks (GNNs) hold the promise of learning efficient representations of graph-structured data, and one of its most important applications is semi-supervised node classification. However, in this application, GNN frameworks…

Machine Learning · Computer Science 2023-05-04 Jiaqi Sun , Lin Zhang , Shenglin Zhao , Yujiu Yang

Message Passing Neural Networks (MPNNs) are instances of Graph Neural Networks that leverage the graph to send messages over the edges. This inductive bias leads to a phenomenon known as over-squashing, where a node feature is insensitive…

Machine Learning · Computer Science 2023-05-25 Francesco Di Giovanni , Lorenzo Giusti , Federico Barbero , Giulia Luise , Pietro Lio' , Michael Bronstein

Neighborhood Aggregation Strategy (NAS) is a widely used approach in graph embedding, underpinning both Graph Neural Networks (GNNs) and Weisfeiler-Lehman (WL) methods. However, NAS-based methods are identified to be prone to…

Machine Learning · Computer Science 2026-02-17 Shuaibin Song , Kai Ming Ting , Kaifeng Zhang , Tianrun Liang

Graph Transformers (GTs) have emerged as a promising graph learning tool, leveraging their all-pair connected property to effectively capture global information. To address the over-smoothing problem in deep GNNs, global attention was…

Machine Learning · Computer Science 2025-12-17 Chaohao Yuan , Zhenjie Song , Ercan Engin Kuruoglu , Kangfei Zhao , Yang Liu , Deli Zhao , Hong Cheng , Yu Rong

Message Passing Graph Neural Networks are known to suffer from two problems that are sometimes believed to be diametrically opposed: over-squashing and over-smoothing. The former results from topological bottlenecks that hamper the…

Machine Learning · Computer Science 2024-10-31 Adarsh Jamadandi , Celia Rubio-Madrigal , Rebekka Burkholz

Graph neural networks (GNNs) have achieved strong performance across various real-world domains. Nevertheless, they suffer from oversquashing, where long-range information is distorted as it is compressed through limited message-passing…

Machine Learning · Computer Science 2026-04-03 Tanvir Hossain , Muhammad Ifte Khairul Islam , Lilia Chebbah , Charles Fanning , Esra Akbas

Graph Neural Networks (GNNs) with equivariant properties have achieved significant success in modeling complex dynamic systems and molecular properties. However, their expressiveness ability is limited by: (1) Existing methods often…

Machine Learning · Computer Science 2025-11-04 Yingxu Wang , Nan Yin , Mingyan Xiao , Xinhao Yi , Siwei Liu , Shangsong Liang

Graph neural network (GNN) has shown convincing performance in learning powerful node representations that preserve both node attributes and graph structural information. However, many GNNs encounter problems in effectiveness and efficiency…

Machine Learning · Computer Science 2022-01-03 Jiyang Bai , Yuxiang Ren , Jiawei Zhang

While graph neural networks (GNNs) have allowed researchers to successfully apply neural networks to non-Euclidean domains, deep GNNs often exhibit lower predictive performance than their shallow counterparts. This phenomena has been…

Machine Learning · Computer Science 2025-05-20 Keqin Wang , Yulong Yang , Ishan Saha , Christine Allen-Blanchette

Graph convolutional networks (GCNs) are a powerful deep learning approach for graph-structured data. Recently, GCNs and subsequent variants have shown superior performance in various application areas on real-world datasets. Despite their…

Machine Learning · Computer Science 2020-07-07 Ming Chen , Zhewei Wei , Zengfeng Huang , Bolin Ding , Yaliang Li