English
Related papers

Related papers: P-DROP: Poisson-Based Dropout for Graph Neural Net…

200 papers

Graph neural networks (GNNs) are widely used in many applications. However, their robustness against adversarial attacks is criticized. Prior studies show that using unnoticeable modifications on graph topology or nodal features can…

Machine Learning · Computer Science 2020-02-27 Xianfeng Tang , Yandong Li , Yiwei Sun , Huaxiu Yao , Prasenjit Mitra , Suhang Wang

Node features of graph neural networks (GNNs) tend to become more similar with the increase of the network depth. This effect is known as over-smoothing, which we axiomatically define as the exponential convergence of suitable similarity…

Machine Learning · Computer Science 2023-03-21 T. Konstantin Rusch , Michael M. Bronstein , Siddhartha Mishra

Dropout is a simple but efficient regularization technique for achieving better generalization of deep neural networks (DNNs); hence it is widely used in tasks based on DNNs. During training, dropout randomly discards a portion of the…

Neural and Evolutionary Computing · Computer Science 2020-10-22 Hiroshi Inoue

Existing Graph Neural Networks (GNNs) follow the message-passing mechanism that conducts information interaction among nodes iteratively. While considerable progress has been made, such node interaction paradigms still have the following…

Machine Learning · Computer Science 2023-04-14 Jie Chen , Zilong Li , Yin Zhu , Junping Zhang , Jian Pu

The performance of graph neural nets (GNNs) is known to gradually decrease with increasing number of layers. This decay is partly attributed to oversmoothing, where repeated graph convolutions eventually make node embeddings…

Machine Learning · Computer Science 2020-02-14 Lingxiao Zhao , Leman Akoglu

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

Disordered Systems and Neural Networks · Physics 2026-02-23 O. Duranthon , L. Zdeborová

Graph Neural Networks (GNNs) have achieved a lot of success with graph-structured data. However, it is observed that the performance of GNNs does not improve (or even worsen) as the number of layers increases. This effect has known as…

Machine Learning · Computer Science 2023-01-10 Yeskendir Koishekenov

Current Graph Neural Networks (GNNs) suffer from the over-smoothing problem, which results in indistinguishable node representations and low model performance with more GNN layers. Many methods have been put forward to tackle this problem…

Machine Learning · Computer Science 2022-10-25 Xinshun Feng , Herun Wan , Shangbin Feng , Hongrui Wang , Jun Zhou , Qinghua Zheng , Minnan Luo

The over-smoothing problem is an obstacle of developing deep graph neural network (GNN). Although many approaches to improve the over-smoothing problem have been proposed, there is still a lack of comprehensive understanding and conclusion…

Machine Learning · Computer Science 2023-03-02 Weichen Zhao , Chenguang Wang , Congying Han , Tiande Guo

Oversmoothing is a central challenge of building more powerful Graph Neural Networks (GNNs). While previous works have only demonstrated that oversmoothing is inevitable when the number of graph convolutions tends to infinity, in this…

Machine Learning · Computer Science 2023-03-02 Xinyi Wu , Zhengdao Chen , William Wang , Ali Jadbabaie

Node representation learning by using Graph Neural Networks (GNNs) has been widely explored. However, in recent years, compelling evidence has revealed that GNN-based node representation learning can be substantially deteriorated by…

Machine Learning · Computer Science 2023-12-19 Jun Zhuang , Mohammad Al Hasan

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and…

Machine Learning · Computer Science 2021-09-22 Wenzheng Feng , Jie Zhang , Yuxiao Dong , Yu Han , Huanbo Luan , Qian Xu , Qiang Yang , Evgeny Kharlamov , Jie Tang

Graph Neural Networks (GNNs) have demonstrated remarkable success in learning from graph-structured data. However, the influence of the input graph's topology on GNN behavior remains poorly understood. In this work, we explore whether GNNs…

Machine Learning · Statistics 2025-02-26 Amine Mohamed Aboussalah , Abdessalam Ed-dib

Graph neural networks (GNNs) have emerged as powerful tools for processing relational data in applications. However, GNNs suffer from the problem of oversmoothing, the property that the features of all nodes exponentially converge to the…

Machine Learning · Statistics 2025-05-22 Bastian Epping , Alexandre René , Moritz Helias , Michael T. Schaub

Graph Convolutional Neural Network (GCN), a widely adopted method for analyzing relational data, enhances node discriminability through the aggregation of neighboring information. Usually, stacking multiple layers can improve the…

Machine Learning · Computer Science 2024-08-07 Furong Peng , Kang Liu , Xuan Lu , Yuhua Qian , Hongren Yan , Chao Ma

In supply chain networks, firms dynamically form or dissolve partnerships to adapt to market fluctuations, posing a challenge for predicting future supply relationships. We model the occurrence of supply edges (firm i to firm j) as a…

Applications · Statistics 2025-08-19 Ling Xiang , Quan Hu , Xiang Zhang , Wei Lan , Bin Liu

Graph Neural Networks (GNNs) are gaining popularity across various domains due to their effectiveness in learning graph-structured data. Nevertheless, they have been shown to be susceptible to backdoor poisoning attacks, which pose serious…

Machine Learning · Computer Science 2024-07-10 Yuxuan Zhu , Michael Mandulak , Kerui Wu , George Slota , Yuseok Jeon , Ka-Ho Chow , Lei Yu

Graph neural networks (GNNs) are processing architectures that exploit graph structural information to model representations from network data. Despite their success, GNNs suffer from sub-optimal generalization performance given limited…

Machine Learning · Computer Science 2021-06-08 Zhan Gao , Subhrajit Bhattacharya , Leiming Zhang , Rick S. Blum , Alejandro Ribeiro , Brian M. Sadler

Graph convolutional networks (GCNs) are a powerful deep learning approach for graph-structured data. Recently, GCNs and subsequent variants have shown superior performance in various application areas on real-world datasets. Despite their…

Machine Learning · Computer Science 2020-07-07 Ming Chen , Zhewei Wei , Zengfeng Huang , Bolin Ding , Yaliang Li

Dropout has been proven to be an effective algorithm for training robust deep networks because of its ability to prevent overfitting by avoiding the co-adaptation of feature detectors. Current explanations of dropout include bagging, naive…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Xu Shen , Xinmei Tian , Tongliang Liu , Fang Xu , Dacheng Tao