中文
相关论文

相关论文: Tackling Over-Smoothing for General Graph Convolut…

200 篇论文

The over-smoothing problem is an obstacle of developing deep graph neural network (GNN). Although many approaches to improve the over-smoothing problem have been proposed, there is still a lack of comprehensive understanding and conclusion…

机器学习 · 计算机科学 2023-03-02 Weichen Zhao , Chenguang Wang , Congying Han , Tiande Guo

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

无序系统与神经网络 · 物理学 2026-02-23 O. Duranthon , L. Zdeborová

Graph neural networks (GNNs) have achieved significant success in various applications. Most GNNs learn the node features with information aggregation of its neighbors and feature transformation in each layer. However, the node features…

机器学习 · 计算机科学 2024-07-30 Dongzhuoran Zhou , Hui Yang , Bo Xiong , Yue Ma , Evgeny Kharlamov

Graph Convolutional Network (GCN) with the powerful capacity to explore graph-structural data has gained noticeable success in recent years. Nonetheless, most of the existing GCN-based models suffer from the notorious over-smoothing issue,…

机器学习 · 计算机科学 2023-04-17 Zhaoliang Chen , Zhihao Wu , Zhenghong Lin , Shiping Wang , Claudia Plant , Wenzhong Guo

Graph convolutional networks (GCNs) have been proved to be very practical to handle various graph-related tasks. It has attracted considerable research interest to study deep GCNs, due to their potential superior performance compared with…

机器学习 · 计算机科学 2023-02-13 Lei Zhang , Xiaodong Yan , Jianshan He , Ruopeng Li , Wei Chu

Oversmoothing has long been identified as a major limitation of Graph Neural Networks (GNNs): input node features are smoothed at each layer and converge to a non-informative representation, if the weights of the GNN are sufficiently…

机器学习 · 计算机科学 2026-03-16 Nicolas Keriven

A graph convolutional network (GCN) employs a graph filtering kernel tailored for data with irregular structures. However, simply stacking more GCN layers does not improve performance; instead, the output converges to an uninformative…

机器学习 · 计算机科学 2022-11-04 Jin Zeng , Yang Liu , Gene Cheung , Wei Hu

Graph Convolutional Network (GCN) has achieved great success and has been applied in various fields including recommender systems. However, GCN still suffers from many issues such as training difficulties, over-smoothing, vulnerable to…

信息检索 · 计算机科学 2020-05-01 Shaowen Peng , Tsunenori Mine

Graph Convolutional Networks (GCN) are Graph Neural Networks where the convolutions are applied over a graph. In contrast to Convolutional Neural Networks, GCN's are designed to perform inference on graphs, where the number of nodes can…

机器学习 · 计算机科学 2024-06-12 Adrian Moldovan , Angel Caţaron , Răzvan Andonie

Oversmoothing has been claimed as a primary bottleneck for multi-layered graph neural networks (GNNs). Multiple analyses have examined how and why oversmoothing occurs. However, none of the prior work addressed how optimization is performed…

机器学习 · 计算机科学 2024-10-08 MoonJeong Park , Dongwoo Kim

Graph neural networks (GNNs) are processing architectures that exploit graph structural information to model representations from network data. Despite their success, GNNs suffer from sub-optimal generalization performance given limited…

机器学习 · 计算机科学 2021-06-08 Zhan Gao , Subhrajit Bhattacharya , Leiming Zhang , Rick S. Blum , Alejandro Ribeiro , Brian M. Sadler

Graph Neural Networks (GNNs) set the state-of-the-art in representation learning for graph-structured data. They are used in many domains, from online social networks to complex molecules. Most GNNs leverage the message-passing paradigm and…

机器学习 · 计算机科学 2025-03-06 Tuğrul Hasan Karabulut , İnci M. Baytaş

Linearized Graph Neural Networks (GNNs) have attracted great attention in recent years for graph representation learning. Compared with nonlinear Graph Neural Network (GNN) models, linearized GNNs are much more time-efficient and can…

机器学习 · 计算机科学 2023-02-02 Yulin Zhu , Xing Ai , Qimai Li , Xiao-Ming Wu , Kai Zhou

Oversmoothing in Graph Neural Networks (GNNs) poses a significant challenge as network depth increases, leading to homogenized node representations and a loss of expressiveness. In this work, we approach the oversmoothing problem from a…

机器学习 · 计算机科学 2024-12-11 Biswadeep Chakraborty , Harshit Kumar , Saibal Mukhopadhyay

Graph Neural Networks (GNNs) have achieved a lot of success on graph-structured data. However, it is observed that the performance of graph neural networks does not improve as the number of layers increases. This effect, known as…

机器学习 · 计算机科学 2020-06-25 Chen Cai , Yusu Wang

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

机器学习 · 计算机科学 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

Graph Neural Networks (GNNs) have achieved promising performance on a wide range of graph-based tasks. Despite their success, one severe limitation of GNNs is the over-smoothing issue (indistinguishable representations of nodes in different…

机器学习 · 计算机科学 2019-11-19 Deli Chen , Yankai Lin , Wei Li , Peng Li , Jie Zhou , Xu Sun

In recent years, hypergraph learning has attracted great attention due to its capacity in representing complex and high-order relationships. However, current neural network approaches designed for hypergraphs are mostly shallow, thus…

机器学习 · 计算机科学 2022-11-03 Guanzi Chen , Jiying Zhang , Xi Xiao , Yang Li

Owing to the remarkable capability of extracting effective graph embeddings, graph convolutional network (GCN) and its variants have been successfully applied to a broad range of tasks, such as node classification, link prediction, and…

机器学习 · 计算机科学 2021-07-13 Ronghang Zhu , Zhiqiang Tao , Yaliang Li , Sheng Li