English
Related papers

Related papers: Adaptive Initial Residual Connections for GNNs wit…

200 papers

Attention-based graph neural networks (GNNs), such as graph attention networks (GATs), have become popular neural architectures for processing graph-structured data and learning node embeddings. Despite their empirical success, these models…

Machine Learning · Statistics 2023-06-07 Dexiong Chen , Paolo Pellizzoni , Karsten Borgwardt

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

Machine Learning · Computer Science 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

The graph neural network (GNN) models have presented impressive achievements in numerous machine learning tasks. However, many existing GNN models are shown to be vulnerable to adversarial attacks, which creates a stringent need to build…

Machine Learning · Computer Science 2022-10-04 Zepeng Zhang , Songtao Lu , Zengfeng Huang , Ziping Zhao

Network embedding is the process of learning low-dimensional representations for nodes in a network, while preserving node features. Existing studies only leverage network structure information and focus on preserving structural features.…

Machine Learning · Computer Science 2019-03-29 Conghui Zheng , Li Pan , Peng Wu

The irreducible complexity of natural phenomena has led Graph Neural Networks to be employed as a standard model to perform representation learning tasks on graph-structured data. While their capacity to capture local and global patterns is…

Machine Learning · Computer Science 2024-02-13 Lorenzo Giusti

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

In this paper, we propose an end-to-end graph learning framework, namely Iterative Deep Graph Learning (IDGL), for jointly and iteratively learning graph structure and graph embedding. The key rationale of IDGL is to learn a better graph…

Machine Learning · Computer Science 2020-10-26 Yu Chen , Lingfei Wu , Mohammed J. Zaki

Graph Neural Networks (GNNs) face a fundamental adaptability challenge: their fixed message-passing architectures struggle with the immense diversity of real-world graphs, where optimal computational strategies vary by local structure and…

Machine Learning · Computer Science 2025-10-27 Yunlong Chu , Minglai Shao , Zengyi Wo , Bing Hao , Yuhang Liu , Ruijie Wang , Jianxin Li

Message passing has become the dominant framework in graph representation learning. The essential idea of the message-passing framework is to update node embeddings based on the information aggregated from local neighbours. However, most…

Machine Learning · Computer Science 2024-04-16 Haimin Zhang , Min Xu

Graph Attention Networks (GATs) are the state-of-the-art neural architecture for representation learning with graphs. GATs learn attention functions that assign weights to nodes so that different nodes have different influences in the…

Machine Learning · Computer Science 2019-10-29 Guangtao Wang , Rex Ying , Jing Huang , Jure Leskovec

Graph neural networks compute node representations by performing multiple message-passing steps that consist in local aggregations of node features. Having deep models that can leverage longer-range interactions between nodes is hindered by…

Machine Learning · Computer Science 2025-06-27 Alessio Micheli , Domenico Tortorella

Despite Graph neural networks' significant performance gain over many classic techniques in various graph-related downstream tasks, their successes are restricted in shallow models due to over-smoothness and the difficulties of…

Machine Learning · Computer Science 2023-12-15 Jin Li , Qirong Zhang , Shuling Xu , Xinlong Chen , Longkun Guo , Yang-Geng Fu

We present Gradient Gating (G$^2$), a novel framework for improving the performance of Graph Neural Networks (GNNs). Our framework is based on gating the output of GNN layers with a mechanism for multi-rate flow of message passing…

Graph Neural Networks (GNNs) have shown exceptional success in graph representation learning and a wide range of real-world applications. However, scaling deeper GNNs poses challenges due to the neighbor explosion problem when training on…

Machine Learning · Computer Science 2025-11-18 Rui Xue

Graph neural networks (GNNs) learn node representations by passing and aggregating messages between neighboring nodes. GNNs have been applied successfully in several application domains and achieved promising performance. However, GNNs…

Machine Learning · Computer Science 2021-12-14 Zeyu Zhang , Yulong Pei

Graph neural networks (GNNs) work remarkably well in semi-supervised node regression, yet a rigorous theory explaining when and why they succeed remains lacking. To address this gap, we study an aggregate-and-readout model that encompasses…

Machine Learning · Statistics 2026-02-20 Juntong Chen , Claire Donnat , Olga Klopp , Johannes Schmidt-Hieber

Graph neural networks (GNNs) have brought revolutionary advancements to the field of link prediction (LP), providing powerful tools for mining potential relationships in graphs. However, existing methods face challenges when dealing with…

Machine Learning · Computer Science 2025-12-30 Huashen Lu , Wensheng Gan , Guoting Chen , Zhichao Huang , Philip S. Yu

Graph-structured data such as social networks, functional brain networks, gene regulatory networks, communications networks have brought the interest in generalizing deep learning techniques to graph domains. In this paper, we are…

Machine Learning · Computer Science 2018-04-25 Xavier Bresson , Thomas Laurent

Graph neural networks (GNNs) have emerged as a powerful tool for graph classification and representation learning. However, GNNs tend to suffer from over-smoothing problems and are vulnerable to graph perturbations. To address these…

Machine Learning · Computer Science 2021-11-01 Yuzhou Chen , Baris Coskunuzer , Yulia R. Gel

Deep neural networks are ubiquitously adopted in many applications, such as computer vision, natural language processing, and graph analytics. However, well-trained neural networks can make prediction errors after deployment as the world…

Machine Learning · Computer Science 2024-10-29 Zhimeng Jiang , Zirui Liu , Xiaotian Han , Qizhang Feng , Hongye Jin , Qiaoyu Tan , Kaixiong Zhou , Na Zou , Xia Hu