English
Related papers

Related papers: DRGCN: Dynamic Evolving Initial Residual for Deep …

200 papers

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is…

Machine Learning · Computer Science 2021-10-19 Langzhang Liang , Cuiyun Gao , Shiyi Chen , Shishi Duan , Yu pan , Junjin Zheng , Lei Wang , Zenglin Xu

Graph Convolutional Networks (GCNs) are known to suffer from performance degradation as the number of layers increases, which is usually attributed to over-smoothing. Despite the apparent consensus, we observe that there exists a…

Machine Learning · Computer Science 2021-10-29 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi

Oversmoothing has been assumed to be the major cause of performance drop in deep graph convolutional networks (GCNs). In this paper, we propose a new view that deep GCNs can actually learn to anti-oversmooth during training. This work…

Machine Learning · Computer Science 2020-06-19 Chaoqi Yang , Ruijie Wang , Shuochao Yao , Shengzhong Liu , Tarek Abdelzaher

Graph convolutional networks (GCNs) and their variants have achieved great success in dealing with graph-structured data. Nevertheless, it is well known that deep GCNs suffer from the over-smoothing problem, where node representations tend…

Machine Learning · Computer Science 2022-04-22 Wei Huang , Yayong Li , Weitao Du , Jie Yin , Richard Yi Da Xu , Ling Chen , Miao Zhang

Graph Convolutional Network (GCN) has achieved great success and has been applied in various fields including recommender systems. However, GCN still suffers from many issues such as training difficulties, over-smoothing, vulnerable to…

Information Retrieval · Computer Science 2020-05-01 Shaowen Peng , Tsunenori Mine

\emph{Over-fitting} and \emph{over-smoothing} are two main obstacles of developing deep Graph Convolutional Networks (GCNs) for node classification. In particular, over-fitting weakens the generalization ability on small dataset, while…

Machine Learning · Computer Science 2020-03-13 Yu Rong , Wenbing Huang , Tingyang Xu , Junzhou Huang

Graph Convolutional Networks (GCNs) have been drawing significant attention with the power of representation learning on graphs. Unlike Convolutional Neural Networks (CNNs), which are able to take advantage of stacking very deep layers,…

Machine Learning · Computer Science 2020-06-16 Guohao Li , Chenxin Xiong , Ali Thabet , Bernard Ghanem

Graph convolutional neural networks (GCNs) generalize tradition convolutional neural networks (CNNs) from low-dimensional regular graphs (e.g., image) to high dimensional irregular graphs (e.g., text documents on word embeddings). Due to…

Machine Learning · Computer Science 2021-03-30 Mehrnaz Najafi , Philip S. Yu

It has been discovered that Graph Convolutional Networks (GCNs) encounter a remarkable drop in performance when multiple layers are piled up. The main factor that accounts for why deep GCNs fail lies in over-smoothing, which isolates the…

Machine Learning · Computer Science 2023-06-22 Jiaqi Han , Wenbing Huang , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang

Increasing the depth of GCN, which is expected to permit more expressivity, is shown to incur performance detriment especially on node classification. The main cause of this lies in over-smoothing. The over-smoothing issue drives the output…

Machine Learning · Computer Science 2022-07-12 Wenbing Huang , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang

Graph neural networks (GNNs) are widely used in domains like social networks and biological systems. However, the locality assumption of GNNs, which limits information exchange to neighboring nodes, hampers their ability to capture…

Machine Learning · Computer Science 2023-07-04 Tingting Dan , Jiaqi Ding , Ziquan Wei , Shahar Z Kovalsky , Minjeong Kim , Won Hwa Kim , Guorong Wu

Graph neural networks (GNNs) have emerged as powerful tools for processing relational data in applications. However, GNNs suffer from the problem of oversmoothing, the property that the features of all nodes exponentially converge to the…

Machine Learning · Statistics 2025-05-22 Bastian Epping , Alexandre René , Moritz Helias , Michael T. Schaub

Convolutional Neural Network (CNN) has demonstrated impressive ability to represent hyperspectral images and to achieve promising results in hyperspectral image classification. However, traditional CNN models can only operate convolution on…

Image and Video Processing · Electrical Eng. & Systems 2019-05-16 Sheng Wan , Chen Gong , Ping Zhong , Bo Du , Lefei Zhang , Jian Yang

Effectively detecting anomalous nodes in attributed networks is crucial for the success of many real-world applications such as fraud and intrusion detection. Existing approaches have difficulties with three major issues: sparsity and…

Machine Learning · Computer Science 2020-10-01 Yulong Pei , Tianjin Huang , Werner van Ipenburg , Mykola Pechenizkiy

Despite the enormous success of Graph Convolutional Networks (GCNs) in modeling graph-structured data, most of the current GCNs are shallow due to the notoriously challenging problems of over-smoothening and information squashing along with…

Machine Learning · Computer Science 2022-10-18 Ajay Jaiswal , Peihao Wang , Tianlong Chen , Justin F. Rousseau , Ying Ding , Zhangyang Wang

Graph Convolution Networks (GCNs) are becoming more and more popular for learning node representations on graphs. Though there exist various developments on sampling and aggregation to accelerate the training process and improve the…

Machine Learning · Computer Science 2020-10-30 Xu Zou , Qiuye Jia , Jianwei Zhang , Chang Zhou , Hongxia Yang , Jie Tang

Geometric deep learning has made great strides towards generalizing the design of structure-aware neural networks from traditional domains to non-Euclidean ones, giving rise to graph neural networks (GNN) that can be applied to…

Machine Learning · Statistics 2024-10-28 Frederik Wenkel , Yimeng Min , Matthew Hirn , Michael Perlmutter , Guy Wolf

Despite the wide application of Graph Convolutional Network (GCN), one major limitation is that it does not benefit from the increasing depth and suffers from the oversmoothing problem. In this work, we first characterize this phenomenon…

Graph Convolutional Networks (GCNs) are state-of-the-art graph based representation learning models by iteratively stacking multiple layers of convolution aggregation operations and non-linear activation operations. Recently, in…

Information Retrieval · Computer Science 2020-01-29 Lei Chen , Le Wu , Richang Hong , Kun Zhang , Meng Wang

Graph convolutional network (GCN) based approaches have achieved significant progress for solving complex, graph-structured problems. GCNs incorporate the graph structure information and the node (or edge) features through message passing…

Machine Learning · Computer Science 2021-05-04 Saurav Manchanda , Da Zheng , George Karypis