中文
相关论文

相关论文: GraTO: Graph Neural Network Framework Tackling Ove…

200 篇论文

Despite the recent success of graph neural networks (GNN), common architectures often exhibit significant limitations, including sensitivity to oversmoothing, long-range dependencies, and spurious edges, e.g., as can occur as a result of…

机器学习 · 计算机科学 2021-12-06 Yongyi Yang , Tang Liu , Yangkun Wang , Jinjing Zhou , Quan Gan , Zhewei Wei , Zheng Zhang , Zengfeng Huang , David Wipf

The over-smoothing problem is an obstacle of developing deep graph neural network (GNN). Although many approaches to improve the over-smoothing problem have been proposed, there is still a lack of comprehensive understanding and conclusion…

机器学习 · 计算机科学 2023-03-02 Weichen Zhao , Chenguang Wang , Congying Han , Tiande Guo

Oversmoothing has been recognized as a main obstacle to building deep Graph Neural Networks (GNNs), limiting the performance. This position paper argues that the influence of oversmoothing has been overstated and advocates for a further…

机器学习 · 计算机科学 2025-06-06 MoonJeong Park , Sunghyun Choi , Jaeseung Heo , Eunhyeok Park , Dongwoo Kim

Graph neural networks (GNNs) have emerged as powerful tools for processing relational data in applications. However, GNNs suffer from the problem of oversmoothing, the property that the features of all nodes exponentially converge to the…

机器学习 · 统计学 2025-05-22 Bastian Epping , Alexandre René , Moritz Helias , Michael T. Schaub

Graph Neural Networks (GNNs) have achieved promising performance on a wide range of graph-based tasks. Despite their success, one severe limitation of GNNs is the over-smoothing issue (indistinguishable representations of nodes in different…

机器学习 · 计算机科学 2019-11-19 Deli Chen , Yankai Lin , Wei Li , Peng Li , Jie Zhou , Xu Sun

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a neural message passing…

机器学习 · 计算机科学 2021-03-19 Tien Huu Do , Duc Minh Nguyen , Giannis Bekoulis , Adrian Munteanu , Nikos Deligiannis

Graph Convolutional Networks (GCN) is a pioneering model for graph-based semi-supervised learning. However, GCN does not perform well on sparsely-labeled graphs. Its two-layer version cannot effectively propagate the label information to…

机器学习 · 计算机科学 2025-02-24 Wei Ye , Zexi Huang , Yunqi Hong , Ambuj Singh

Graph Convolutional Networks (GCNs) suffer from performance degradation when models go deeper. However, earlier works only attributed the performance degeneration to over-smoothing. In this paper, we conduct theoretical and experimental…

机器学习 · 计算机科学 2024-01-24 Weigang Lu , Yibing Zhan , Binbin Lin , Ziyu Guan , Liu Liu , Baosheng Yu , Wei Zhao , Yaming Yang , Dacheng Tao

Graph Neural Networks (GNNs), a type of neural network that can learn from graph-structured data through neighborhood information aggregation, have shown superior performance in various downstream tasks. However, as the number of layers…

机器学习 · 计算机科学 2024-11-01 Jingbo Zhou , Yixuan Du , Ruqiong Zhang , Jun Xia , Zhizhi Yu , Zelin Zang , Di Jin , Carl Yang , Rui Zhang , Stan Z. Li

Graph neural networks (GNNs) are one of the most popular research topics for deep learning. GNN methods typically have been designed on top of the graph signal processing theory. In particular, diffusion equations have been widely used for…

机器学习 · 计算机科学 2023-06-16 Jeongwhan Choi , Seoyoung Hong , Noseong Park , Sung-Bae Cho

\emph{Over-fitting} and \emph{over-smoothing} are two main obstacles of developing deep Graph Convolutional Networks (GCNs) for node classification. In particular, over-fitting weakens the generalization ability on small dataset, while…

机器学习 · 计算机科学 2020-03-13 Yu Rong , Wenbing Huang , Tingyang Xu , Junzhou Huang

Graph Neural Networks (GNNs) have established themselves as the preferred methodology in a multitude of domains, ranging from computer vision to computational biology, especially in contexts where data inherently conform to graph…

机器学习 · 计算机科学 2024-04-05 Yifan Qu , Oliver Krzysik , Hans De Sterck , Omer Ege Kara

Graph convolutional networks (GCNs) have shown promising results in processing graph data by extracting structure-aware features. This gave rise to extensive work in geometric deep learning, focusing on designing network architectures that…

机器学习 · 计算机科学 2022-01-20 Yimeng Min , Frederik Wenkel , Guy Wolf

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

机器学习 · 计算机科学 2026-05-05 Hugo Attali , Nathalie Pernelle , Davide Buscaldi , Fragkiskos D. Malliaros

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

机器学习 · 计算机科学 2026-05-04 Hugo Attali , Davide Buscaldi , Nathalie Pernelle , Fragkiskos D. Malliaros

Graph neural networks (GNNs) manifest pathologies including over-smoothing and limited discriminating power as a result of suboptimally expressive aggregating mechanisms. We herein present a unifying framework for stochastic aggregation…

机器学习 · 统计学 2021-03-01 Yuanqing Wang , Theofanis Karaletsos

In recent years, Graph Neural Networks (GNNs) have shown superior performance on diverse applications on real-world datasets. To improve the model capacity and alleviate the over-smoothing problem, several methods proposed to incorporate…

机器学习 · 计算机科学 2021-12-28 Lanning Wei , Huan Zhao , Zhiqiang He

It is known that the current graph neural networks (GNNs) are difficult to make themselves deep due to the problem known as over-smoothing. Multi-scale GNNs are a promising approach for mitigating the over-smoothing problem. However, there…

机器学习 · 计算机科学 2021-01-07 Kenta Oono , Taiji Suzuki

Recent years have witnessed remarkable success achieved by graph neural networks (GNNs) in many real-world applications such as recommendation and drug discovery. Despite the success, oversmoothing has been identified as one of the key…

机器学习 · 计算机科学 2022-06-17 Wei Jin , Xiaorui Liu , Yao Ma , Charu Aggarwal , Jiliang Tang

Graph Neural Networks (GNNs) have achieved great success in various graph mining tasks.However, drastic performance degradation is always observed when a GNN is stacked with many layers. As a result, most GNNs only have shallow…

机器学习 · 计算机科学 2022-06-10 Wentao Zhang , Zeang Sheng , Ziqi Yin , Yuezihan Jiang , Yikuan Xia , Jun Gao , Zhi Yang , Bin Cui