中文
相关论文

相关论文: P-DROP: Poisson-Based Dropout for Graph Neural Net…

200 篇论文

Graph neural networks (GNNs) are widely used in many applications. However, their robustness against adversarial attacks is criticized. Prior studies show that using unnoticeable modifications on graph topology or nodal features can…

机器学习 · 计算机科学 2020-02-27 Xianfeng Tang , Yandong Li , Yiwei Sun , Huaxiu Yao , Prasenjit Mitra , Suhang Wang

Node features of graph neural networks (GNNs) tend to become more similar with the increase of the network depth. This effect is known as over-smoothing, which we axiomatically define as the exponential convergence of suitable similarity…

机器学习 · 计算机科学 2023-03-21 T. Konstantin Rusch , Michael M. Bronstein , Siddhartha Mishra

Dropout is a simple but efficient regularization technique for achieving better generalization of deep neural networks (DNNs); hence it is widely used in tasks based on DNNs. During training, dropout randomly discards a portion of the…

神经与进化计算 · 计算机科学 2020-10-22 Hiroshi Inoue

Existing Graph Neural Networks (GNNs) follow the message-passing mechanism that conducts information interaction among nodes iteratively. While considerable progress has been made, such node interaction paradigms still have the following…

机器学习 · 计算机科学 2023-04-14 Jie Chen , Zilong Li , Yin Zhu , Junping Zhang , Jian Pu

The performance of graph neural nets (GNNs) is known to gradually decrease with increasing number of layers. This decay is partly attributed to oversmoothing, where repeated graph convolutions eventually make node embeddings…

机器学习 · 计算机科学 2020-02-14 Lingxiao Zhao , Leman Akoglu

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

无序系统与神经网络 · 物理学 2026-02-23 O. Duranthon , L. Zdeborová

Graph Neural Networks (GNNs) have achieved a lot of success with graph-structured data. However, it is observed that the performance of GNNs does not improve (or even worsen) as the number of layers increases. This effect has known as…

机器学习 · 计算机科学 2023-01-10 Yeskendir Koishekenov

Current Graph Neural Networks (GNNs) suffer from the over-smoothing problem, which results in indistinguishable node representations and low model performance with more GNN layers. Many methods have been put forward to tackle this problem…

机器学习 · 计算机科学 2022-10-25 Xinshun Feng , Herun Wan , Shangbin Feng , Hongrui Wang , Jun Zhou , Qinghua Zheng , Minnan Luo

The over-smoothing problem is an obstacle of developing deep graph neural network (GNN). Although many approaches to improve the over-smoothing problem have been proposed, there is still a lack of comprehensive understanding and conclusion…

机器学习 · 计算机科学 2023-03-02 Weichen Zhao , Chenguang Wang , Congying Han , Tiande Guo

Oversmoothing is a central challenge of building more powerful Graph Neural Networks (GNNs). While previous works have only demonstrated that oversmoothing is inevitable when the number of graph convolutions tends to infinity, in this…

机器学习 · 计算机科学 2023-03-02 Xinyi Wu , Zhengdao Chen , William Wang , Ali Jadbabaie

Node representation learning by using Graph Neural Networks (GNNs) has been widely explored. However, in recent years, compelling evidence has revealed that GNN-based node representation learning can be substantially deteriorated by…

机器学习 · 计算机科学 2023-12-19 Jun Zhuang , Mohammad Al Hasan

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and…

机器学习 · 计算机科学 2021-09-22 Wenzheng Feng , Jie Zhang , Yuxiao Dong , Yu Han , Huanbo Luan , Qian Xu , Qiang Yang , Evgeny Kharlamov , Jie Tang

Graph Neural Networks (GNNs) have demonstrated remarkable success in learning from graph-structured data. However, the influence of the input graph's topology on GNN behavior remains poorly understood. In this work, we explore whether GNNs…

机器学习 · 统计学 2025-02-26 Amine Mohamed Aboussalah , Abdessalam Ed-dib

Graph neural networks (GNNs) have emerged as powerful tools for processing relational data in applications. However, GNNs suffer from the problem of oversmoothing, the property that the features of all nodes exponentially converge to the…

机器学习 · 统计学 2025-05-22 Bastian Epping , Alexandre René , Moritz Helias , Michael T. Schaub

Graph Convolutional Neural Network (GCN), a widely adopted method for analyzing relational data, enhances node discriminability through the aggregation of neighboring information. Usually, stacking multiple layers can improve the…

机器学习 · 计算机科学 2024-08-07 Furong Peng , Kang Liu , Xuan Lu , Yuhua Qian , Hongren Yan , Chao Ma

In supply chain networks, firms dynamically form or dissolve partnerships to adapt to market fluctuations, posing a challenge for predicting future supply relationships. We model the occurrence of supply edges (firm i to firm j) as a…

应用统计 · 统计学 2025-08-19 Ling Xiang , Quan Hu , Xiang Zhang , Wei Lan , Bin Liu

Graph Neural Networks (GNNs) are gaining popularity across various domains due to their effectiveness in learning graph-structured data. Nevertheless, they have been shown to be susceptible to backdoor poisoning attacks, which pose serious…

机器学习 · 计算机科学 2024-07-10 Yuxuan Zhu , Michael Mandulak , Kerui Wu , George Slota , Yuseok Jeon , Ka-Ho Chow , Lei Yu

Graph neural networks (GNNs) are processing architectures that exploit graph structural information to model representations from network data. Despite their success, GNNs suffer from sub-optimal generalization performance given limited…

机器学习 · 计算机科学 2021-06-08 Zhan Gao , Subhrajit Bhattacharya , Leiming Zhang , Rick S. Blum , Alejandro Ribeiro , Brian M. Sadler

Graph convolutional networks (GCNs) are a powerful deep learning approach for graph-structured data. Recently, GCNs and subsequent variants have shown superior performance in various application areas on real-world datasets. Despite their…

机器学习 · 计算机科学 2020-07-07 Ming Chen , Zhewei Wei , Zengfeng Huang , Bolin Ding , Yaliang Li

Dropout has been proven to be an effective algorithm for training robust deep networks because of its ability to prevent overfitting by avoiding the co-adaptation of feature detectors. Current explanations of dropout include bagging, naive…

计算机视觉与模式识别 · 计算机科学 2019-12-02 Xu Shen , Xinmei Tian , Tongliang Liu , Fang Xu , Dacheng Tao