English
Related papers

Related papers: P-DROP: Poisson-Based Dropout for Graph Neural Net…

200 papers

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a neural message passing…

Machine Learning · Computer Science 2021-03-19 Tien Huu Do , Duc Minh Nguyen , Giannis Bekoulis , Adrian Munteanu , Nikos Deligiannis

\emph{Over-fitting} and \emph{over-smoothing} are two main obstacles of developing deep Graph Convolutional Networks (GCNs) for node classification. In particular, over-fitting weakens the generalization ability on small dataset, while…

Machine Learning · Computer Science 2020-03-13 Yu Rong , Wenbing Huang , Tingyang Xu , Junzhou Huang

Graph Neural Networks (GNNs), a type of neural network that can learn from graph-structured data through neighborhood information aggregation, have shown superior performance in various downstream tasks. However, as the number of layers…

Machine Learning · Computer Science 2024-11-01 Jingbo Zhou , Yixuan Du , Ruqiong Zhang , Jun Xia , Zhizhi Yu , Zelin Zang , Di Jin , Carl Yang , Rui Zhang , Stan Z. Li

Message Passing Neural Networks (MPNNs) are a class of Graph Neural Networks (GNNs) that propagate information across the graph via local neighborhoods. The scheme gives rise to two key challenges: over-smoothing and over-squashing. While…

Machine Learning · Computer Science 2025-05-30 Jasraj Singh , Keyue Jiang , Brooks Paige , Laura Toni

Graph Neural Networks (GNNs) have shown to be powerful tools for graph analytics. The key idea is to recursively propagate and aggregate information along edges of the given graph. Despite their success, however, the existing GNNs are…

Machine Learning · Computer Science 2020-11-16 Dongsheng Luo , Wei Cheng , Wenchao Yu , Bo Zong , Jingchao Ni , Haifeng Chen , Xiang Zhang

Graph convolutional network (GCN) is now an effective tool to deal with non-Euclidean data, such as social networks in social behavior analysis, molecular structure analysis in the field of chemistry, and skeleton-based action recognition.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Ziqing Yang , Shoudong Han , Jun Zhao

Graph Neural Networks (GNNs) have achieved promising results in tasks such as node classification and graph classification. However, recent studies reveal that GNNs are vulnerable to backdoor attacks, posing a significant threat to their…

Machine Learning · Computer Science 2025-03-13 Zhiwei Zhang , Minhua Lin , Junjie Xu , Zongyu Wu , Enyan Dai , Suhang Wang

Graph neural networks (GNNs) are widely used in domains like social networks and biological systems. However, the locality assumption of GNNs, which limits information exchange to neighboring nodes, hampers their ability to capture…

Machine Learning · Computer Science 2023-07-04 Tingting Dan , Jiaqi Ding , Ziquan Wei , Shahar Z Kovalsky , Minjeong Kim , Won Hwa Kim , Guorong Wu

Graph Neural Network (GNN) achieves great success for node-level and graph-level tasks via encoding meaningful topological structures of networks in various domains, ranging from social to biological networks. However, repeated aggregation…

Machine Learning · Computer Science 2025-08-26 Tanvir Hossain , Khaled Mohammed Saifuddin , Muhammad Ifte Khairul Islam , Farhan Tanvir , Esra Akbas

It has been discovered that Graph Convolutional Networks (GCNs) encounter a remarkable drop in performance when multiple layers are piled up. The main factor that accounts for why deep GCNs fail lies in over-smoothing, which isolates the…

Machine Learning · Computer Science 2023-06-22 Jiaqi Han , Wenbing Huang , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is…

Machine Learning · Computer Science 2021-10-19 Langzhang Liang , Cuiyun Gao , Shiyi Chen , Shishi Duan , Yu pan , Junjin Zheng , Lei Wang , Zenglin Xu

Increasing the depth of GCN, which is expected to permit more expressivity, is shown to incur performance detriment especially on node classification. The main cause of this lies in over-smoothing. The over-smoothing issue drives the output…

Machine Learning · Computer Science 2022-07-12 Wenbing Huang , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang

Graph Neural Networks (GNNs) have shown great potential in graph data analysis due to their powerful representation capabilities. However, as the network depth increases, the issue of over-smoothing becomes more severe, causing node…

Machine Learning · Computer Science 2025-07-09 Kaichen Ouyang

Graph neural networks (GNNs), which learn the representation of a node by aggregating its neighbors, have become an effective computational tool in downstream applications. Over-smoothing is one of the key issues which limit the performance…

Machine Learning · Computer Science 2020-06-15 Kaixiong Zhou , Xiao Huang , Yuening Li , Daochen Zha , Rui Chen , Xia Hu

Graph Neural Networks (GNNs) are powerful tools for graph representation learning. Despite their rapid development, GNNs also face some challenges, such as over-fitting, over-smoothing, and non-robustness. Previous works indicate that these…

Machine Learning · Computer Science 2023-07-04 Taoran Fang , Zhiqing Xiao , Chunping Wang , Jiarong Xu , Xuan Yang , Yang Yang

Graph Neural Networks (GNNs) set the state-of-the-art in representation learning for graph-structured data. They are used in many domains, from online social networks to complex molecules. Most GNNs leverage the message-passing paradigm and…

Machine Learning · Computer Science 2025-03-06 Tuğrul Hasan Karabulut , İnci M. Baytaş

This paper studies Dropout Graph Neural Networks (DropGNNs), a new approach that aims to overcome the limitations of standard GNN frameworks. In DropGNNs, we execute multiple runs of a GNN on the input graph, with some of the nodes randomly…

Machine Learning · Computer Science 2021-11-12 Pál András Papp , Karolis Martinkus , Lukas Faber , Roger Wattenhofer

In recent years, Graph Convolutional Networks (GCNs) have gained popularity for their exceptional ability to process graph-structured data. Existing GCN-based approaches typically employ a shallow model architecture due to the…

Machine Learning · Computer Science 2025-04-22 Jielong Lu , Zhihao Wu , Zhiling Cai , Yueyang Pi , Shiping Wang

In recent years, Graph Neural Networks (GNNs) have achieved remarkable success in many graph mining tasks. However, scaling them to large graphs is challenging due to the high computational and storage costs of repeated feature propagation…

Machine Learning · Computer Science 2025-04-11 Yuxuan Liang , Wentao Zhang , Zeang Sheng , Ling Yang , Quanqing Xu , Jiawei Jiang , Yunhai Tong , Bin Cui

Deep neural networks possess strong representational capacity yet remain vulnerable to overfitting, primarily because neurons tend to co-adapt in ways that, while capturing complex and fine-grained feature interactions, also reinforce…

Machine Learning · Computer Science 2025-12-16 Gelesh G Omathil , Sreeja CS
‹ Prev 1 2 3 10 Next ›