English
Related papers

Related papers: Layer-wise Adaptive Graph Convolution Networks Usi…

200 papers

Oversmoothing is a fundamental limitation of deep graph convolutional networks (GCNs), causing node representations to collapse as depth increases. While many prior approaches mitigate this effect through architectural modifications or…

Machine Learning · Computer Science 2026-02-10 Sai Vamsi Alisetti

Graph neural networks (GNNs) have received tremendous attention due to their superiority in learning node representations. These models rely on message passing and feature transformation functions to encode the structural and feature…

Machine Learning · Computer Science 2021-12-02 Kai Guo , Kaixiong Zhou , Xia Hu , Yu Li , Yi Chang , Xin Wang

Graph convolutional networks (GCNs) have been successfully applied in node classification tasks of network mining. However, most of these models based on neighborhood aggregation are usually shallow and lack the "graph pooling" mechanism,…

Social and Information Networks · Computer Science 2019-06-11 Fenyu Hu , Yanqiao Zhu , Shu Wu , Liang Wang , Tieniu Tan

Graph convolutional networks (GCNs) have been attracting widespread attentions due to their encouraging performance and powerful generalizations. However, few work provide a general view to interpret various GCNs and guide GCNs' designs. In…

Machine Learning · Computer Science 2023-07-04 Shiping Wang , Zhihao Wu , Yuhong Chen , Yong Chen

Convolution Neural Networks on Graphs are important generalization and extension of classical CNNs. While previous works generally assumed that the graph structures of samples are regular with unified dimensions, in many applications, they…

Machine Learning · Computer Science 2017-08-17 Ruoyu Li , Junzhou Huang

Graph Convolution Networks (GCN) are widely used in learning graph representations due to their effectiveness and efficiency. However, they suffer from the notorious over-smoothing problem, in which the learned representations of densely…

Machine Learning · Computer Science 2020-04-10 Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Graph Convolutional Networks (GCNs) suffer from severe performance degradation in deep architectures due to over-smoothing. While existing studies primarily attribute the over-smoothing to repeated applications of graph Laplacian operators,…

Machine Learning · Computer Science 2025-07-23 Furong Peng , Jinzhen Gao , Xuan Lu , Kang Liu , Yifan Huo , Sheng Wang

Many interesting problems in machine learning are being revisited with new deep learning tools. For graph-based semisupervised learning, a recent important development is graph convolutional networks (GCNs), which nicely integrate local…

Machine Learning · Computer Science 2018-01-24 Qimai Li , Zhichao Han , Xiao-Ming Wu

Deep learning models have been shown to outperform methods that rely on summary statistics, like the power spectrum, in extracting information from complex cosmological data sets. However, due to differences in the subgrid physics…

Cosmology and Nongalactic Astrophysics · Physics 2024-04-16 Andrea Roncoli , Aleksandra Ćiprijanović , Maggie Voetberg , Francisco Villaescusa-Navarro , Brian Nord

Graph Neural Networks (GNNs) set the state-of-the-art in representation learning for graph-structured data. They are used in many domains, from online social networks to complex molecules. Most GNNs leverage the message-passing paradigm and…

Machine Learning · Computer Science 2025-03-06 Tuğrul Hasan Karabulut , İnci M. Baytaş

Graph Neural Networks (GNNs) are limited in their propagation operators. In many cases, these operators often contain non-negative elements only and are shared across channels, limiting the expressiveness of GNNs. Moreover, some GNNs suffer…

Machine Learning · Computer Science 2023-05-08 Moshe Eliasof , Lars Ruthotto , Eran Treister

Graph Neural Networks (GNNs) are increasingly becoming the favorite method for graph learning. They exploit the semi-supervised nature of deep learning, and they bypass computational bottlenecks associated with traditional graph learning…

Machine Learning · Computer Science 2023-11-08 Mashaan Alshammari , John Stavrakakis , Adel F. Ahmed , Masahiro Takatsuka

Graph Convolutional Networks (GCNs) have been widely studied for compact data representation and semi-supervised learning tasks. However, existing GCNs usually use a fixed neighborhood graph which is not guaranteed to be optimal for…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Bo Jiang , Leiling Wang , Jin Tang , Bin Luo

The decoupled Graph Convolutional Network (GCN), a recent development of GCN that decouples the neighborhood aggregation and feature transformation in each convolutional layer, has shown promising performance for graph representation…

Machine Learning · Computer Science 2022-11-16 Jinsong Chen , Boyu Li , Kun He

Oversmoothing is a common challenge in learning graph neural networks (GNN), where, as layers increase, embedding features learned from GNNs quickly become similar or indistinguishable, making them incapable of differentiating network…

Machine Learning · Computer Science 2025-07-22 Yufei Jin , Xingquan Zhu

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Graph convolutional network (GCN) is a powerful model studied broadly in various graph structural data learning tasks. However, to mitigate the over-smoothing phenomenon, and deal with heterogeneous graph structural data, the design of GCN…

Machine Learning · Statistics 2024-12-12 Jia Cai , Zhilong Xiong , Shaogao Lv

Adaptive gradient methods such as Adam have gained increasing popularity in deep learning optimization. However, it has been observed that compared with (stochastic) gradient descent, Adam can converge to a different solution with a…

Machine Learning · Computer Science 2021-08-26 Difan Zou , Yuan Cao , Yuanzhi Li , Quanquan Gu

The design of deep graph models still remains to be investigated and the crucial part is how to explore and exploit the knowledge from different hops of neighbors in an efficient way. In this paper, we propose a novel RNN-like deep graph…

Machine Learning · Computer Science 2021-03-16 Ke Sun , Zhanxing Zhu , Zhouchen Lin

Spectral graph convolutional neural networks (CNNs) require approximation to the convolution to alleviate the computational complexity, resulting in performance loss. This paper proposes the topology adaptive graph convolutional network…

Machine Learning · Computer Science 2018-02-13 Jian Du , Shanghang Zhang , Guanhang Wu , Jose M. F. Moura , Soummya Kar