English
Related papers

Related papers: SkipNode: On Alleviating Performance Degradation f…

200 papers

The robustness of the much-used Graph Convolutional Networks (GCNs) to perturbations of their input is becoming a topic of increasing importance. In this paper, the random GCN is introduced for which a random matrix theory analysis is…

Machine Learning · Computer Science 2022-02-22 Mohamed El Amine Seddik , Changmin Wu , Johannes F. Lutzeyer , Michalis Vazirgiannis

In recent years, Graph Neural Networks (GNNs) have been popular in the graph classification task. Currently, shallow GNNs are more common due to the well-known over-smoothing problem facing deeper GNNs. However, they are sub-optimal without…

Machine Learning · Computer Science 2023-02-20 Lanning Wei , Zhiqiang He , Huan Zhao , Quanming Yao

Graph Neural Networks (GNNs) have emerged as a notorious alternative to address learning problems dealing with non-Euclidean datasets. However, although most works assume that the graph is perfectly known, the observed topology is prone to…

Machine Learning · Computer Science 2023-12-12 Victor M. Tenorio , Samuel Rey , Antonio G. Marques

This work analyzes the solution trajectory of gradient-based algorithms via a novel basis function decomposition. We show that, although solution trajectories of gradient-based algorithms may vary depending on the learning task, they behave…

Machine Learning · Computer Science 2022-10-05 Jianhao Ma , Lingjun Guo , Salar Fattahi

Current GNN-oriented NAS methods focus on the search for different layer aggregate components with shallow and simple architectures, which are limited by the 'over-smooth' problem. To further explore the benefits from structural diversity…

Machine Learning · Computer Science 2021-09-22 Guosheng Feng , Chunnan Wang , Hongzhi Wang

Graph convolutional networks (GCNs) have emerged as powerful models for graph learning tasks, exhibiting promising performance in various domains. While their empirical success is evident, there is a growing need to understand their…

Machine Learning · Computer Science 2025-09-30 Guangrui Yang , Ming Li , Han Feng , Xiaosheng Zhuang

The smoothing issue in graph learning leads to indistinguishable node representations, posing significant challenges for graph-related tasks. However, our experiments reveal that this problem can uncover underlying properties of node…

Machine Learning · Computer Science 2024-10-18 Xiangyu Dong , Xingyi Zhang , Yanni Sun , Lei Chen , Mingxuan Yuan , Sibo Wang

Graph Convolutional Networks (GCNs) have gained significant developments in representation learning on graphs. However, current GCNs suffer from two common challenges: 1) GCNs are only effective with shallow structures; stacking multiple…

Machine Learning · Computer Science 2019-12-13 Menghan Wang , Kun Zhang , Gulin Li , Keping Yang , Luo Si

Graph Convolutional Neural Networks (GCNs) possess strong capabilities for processing graph data in non-grid domains. They can capture the topological logical structure and node features in graphs and integrate them into nodes' final…

Machine Learning · Computer Science 2024-03-26 Yinwei Wu

We propose Graph-Coupled Oscillator Networks (GraphCON), a novel framework for deep learning on graphs. It is based on discretizations of a second-order system of ordinary differential equations (ODEs), which model a network of nonlinear…

GNNs are widely used to solve various tasks including node classification and link prediction. Most of the GNN architectures assume the initial embedding to be random or generated from popular distributions. These initial embeddings require…

Machine Learning · Computer Science 2024-01-31 Shraban Kumar Chatterjee , Suman Kundu

Graph Convolutional Networks (GCNs) are state-of-the-art graph based representation learning models by iteratively stacking multiple layers of convolution aggregation operations and non-linear activation operations. Recently, in…

Information Retrieval · Computer Science 2020-01-29 Lei Chen , Le Wu , Richang Hong , Kun Zhang , Meng Wang

Graph Convolutional Networks (GCNs) and their variants have achieved significant performances on various recommendation tasks. However, many existing GCN models tend to perform recursive aggregations among all related nodes, which can arise…

Information Retrieval · Computer Science 2022-10-17 Yue Xu , Hao Chen , Zengde Deng , Yuanchen Bei , Feiran Huang

The fundamental principle of Graph Neural Networks (GNNs) is to exploit the structural information of the data by aggregating the neighboring nodes using a `graph convolution' in conjunction with a suitable choice for the network…

Machine Learning · Computer Science 2023-11-01 Mahalakshmi Sabanayagam , Pascal Esser , Debarghya Ghoshdastidar

Deep learning models for graphs, especially Graph Convolutional Networks (GCNs), have achieved remarkable performance in the task of semi-supervised node classification. However, recent studies show that GCNs suffer from adversarial…

Machine Learning · Computer Science 2020-12-14 Haoxi Zhan , Xiaobing Pei

Oversmoothing is a common challenge in learning graph neural networks (GNN), where, as layers increase, embedding features learned from GNNs quickly become similar or indistinguishable, making them incapable of differentiating network…

Machine Learning · Computer Science 2025-07-22 Yufei Jin , Xingquan Zhu

We analyze graph smoothing with \emph{mean aggregation}, where each node successively receives the average of the features of its neighbors. Indeed, it has quickly been observed that Graph Neural Networks (GNNs), which generally follow some…

Machine Learning · Statistics 2022-10-11 Nicolas Keriven

Graph neural networks (GNNs) encounter significant computational challenges when handling large-scale graphs, which severely restricts their efficacy across diverse applications. To address this limitation, graph condensation has emerged as…

Machine Learning · Computer Science 2023-12-12 Xinyi Gao , Tong Chen , Yilong Zang , Wentao Zhang , Quoc Viet Hung Nguyen , Kai Zheng , Hongzhi Yin

The rapid expansion of multimedia contents has led to the emergence of multimodal recommendation systems. It has attracted increasing attention in recommendation systems because its full utilization of data from different modalities…

Information Retrieval · Computer Science 2024-12-30 Zheyu Chen , Jinfeng Xu , Haibo Hu

In representation learning on graph-structured data, many popular graph neural networks (GNNs) fail to capture long-range dependencies, leading to performance degradation. Furthermore, this weakness is magnified when the concerned graph is…

Machine Learning · Computer Science 2024-03-07 Mengying Jiang , Guizhong Liu , Yuanchao Su , Xinliang Wu