English
Related papers

Related papers: Structure-Aware DropEdge Towards Deep Graph Convol…

200 papers

Deep neural networks have proved very successful in domains where large training sets are available, but when the number of training samples is small, their performance suffers from overfitting. Prior methods of reducing overfitting such as…

Computer Vision and Pattern Recognition · Computer Science 2016-01-28 Jiaji Huang , Qiang Qiu , Robert Calderbank , Guillermo Sapiro

Over-smoothing is a severe problem which limits the depth of Graph Convolutional Networks. This article gives a comprehensive analysis of the mechanism behind Graph Convolutional Networks and the over-smoothing effect. The article proposes…

Machine Learning · Computer Science 2022-02-02 Fang Sun

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

Recent studies have shown that Graph Convolutional Networks (GCNs) are vulnerable to adversarial attacks on the graph structure. Although multiple works have been proposed to improve their robustness against such structural adversarial…

Machine Learning · Computer Science 2021-09-14 Liang Chen , Jintang Li , Qibiao Peng , Yang Liu , Zibin Zheng , Carl Yang

In this work we investigate an observation made by Kipf \& Welling, who suggested that untrained GCNs can generate meaningful node embeddings. In particular, we investigate the effect of training only a single layer of a GCN, while keeping…

Machine Learning · Computer Science 2024-10-18 Dimitrios Kelesis , Dimitris Fotakis , Georgios Paliouras

Graph Convolutional Networks (GCNs) achieve great success in non-Euclidean structure data processing recently. In existing studies, deeper layers are used in CCNs to extract deeper features of Euclidean structure data. However, for…

Machine Learning · Computer Science 2022-03-14 Junhua Ma , Jiajun Li , Xueming Li , Xu Li

The vanilla Graph Convolutional Network (GCN) uses a low-pass filter to extract low-frequency signals from graph topology, which may lead to the over-smoothing problem when GCN goes deep. To this end, various methods have been proposed to…

Machine Learning · Computer Science 2024-02-13 Chen Huang , Haoyang Li , Yifan Zhang , Wenqiang Lei , Jiancheng Lv

Graph Convolution Networks (GCN) are widely used in learning graph representations due to their effectiveness and efficiency. However, they suffer from the notorious over-smoothing problem, in which the learned representations of densely…

Machine Learning · Computer Science 2020-04-10 Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Graph Convolutional Networks (GCN) are Graph Neural Networks where the convolutions are applied over a graph. In contrast to Convolutional Neural Networks, GCN's are designed to perform inference on graphs, where the number of nodes can…

Machine Learning · Computer Science 2024-06-12 Adrian Moldovan , Angel Caţaron , Răzvan Andonie

Graph convolutional networks (GCNs) have recently achieved great empirical success in learning graph-structured data. To address its scalability issue due to the recursive embedding of neighboring features, graph topology sampling has been…

Machine Learning · Computer Science 2023-12-12 Hongkang Li , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Graph convolution networks have recently garnered a lot of attention for representation learning on non-Euclidean feature spaces. Recent research has focused on stacking multiple layers like in convolutional neural networks for the…

Machine Learning · Computer Science 2021-05-05 Rangan Das , Bikram Boote , Saumik Bhattacharya , Ujjwal Maulik

Graph Neural Networks (GNNs) suffer from over-smoothing in deep architectures and expressiveness bounded by the 1-Weisfeiler-Leman (1-WL) test. We adapt Manifold-Constrained Hyper-Connections (\mhc)~\citep{xie2025mhc}, recently proposed for…

Machine Learning · Computer Science 2026-01-07 Subhankar Mishra

Clustering techniques attempt to group objects with similar properties into a cluster. Clustering the nodes of an attributed graph, in which each node is associated with a set of feature attributes, has attracted significant attention.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chaojie Ji , Hongwei Chen , Ruxin Wang , Yunpeng Cai , Hongyan Wu

Using a large number of parameters , deep neural networks have achieved remarkable performance on computer vison and natural language processing tasks. However the networks usually suffer from overfitting by using too much parameters.…

Computer Vision and Pattern Recognition · Computer Science 2018-10-24 Zhengsu Chen Jianwei Niu Qi Tian

Oversmoothing is a common phenomenon observed in graph neural networks (GNNs), in which an increase in the network depth leads to a deterioration in their performance. Graph contrastive learning (GCL) is emerging as a promising way of…

Machine Learning · Computer Science 2024-02-26 Jintang Li , Wangbin Sun , Ruofan Wu , Yuchang Zhu , Liang Chen , Zibin Zheng

Graph convolutional network (GCN) based approaches have achieved significant progress for solving complex, graph-structured problems. GCNs incorporate the graph structure information and the node (or edge) features through message passing…

Machine Learning · Computer Science 2021-05-04 Saurav Manchanda , Da Zheng , George Karypis

GNNs are widely used to solve various tasks including node classification and link prediction. Most of the GNN architectures assume the initial embedding to be random or generated from popular distributions. These initial embeddings require…

Machine Learning · Computer Science 2024-01-31 Shraban Kumar Chatterjee , Suman Kundu

Graph neural networks (GNNs) are a powerful solution for various structure learning applications due to their strong representation capabilities for graph data. However, traditional GNNs, relying on message-passing mechanisms that gather…

Machine Learning · Computer Science 2024-03-19 Wei Duan , Jie Lu , Yu Guang Wang , Junyu Xuan

As much as Graph Convolutional Networks (GCNs) have shown tremendous success in recommender systems and collaborative filtering (CF), the mechanism of how they, especially the core components (\textit{i.e.,} neighborhood aggregation)…

Information Retrieval · Computer Science 2022-04-26 Shaowen Peng , Kazunari Sugiyama , Tsunenori Mine

It is known that the current graph neural networks (GNNs) are difficult to make themselves deep due to the problem known as over-smoothing. Multi-scale GNNs are a promising approach for mitigating the over-smoothing problem. However, there…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki