English
Related papers

Related papers: Boosting Graph Neural Networks by Injecting Poolin…

200 papers

Distributed power allocation is important for interference-limited wireless networks with dense transceiver pairs. In this paper, we aim to design low signaling overhead distributed power allocation schemes by using graph neural networks…

Signal Processing · Electrical Eng. & Systems 2023-03-06 Yifan Gu , Changyang She , Zhi Quan , Chen Qiu , Xiaodong Xu

Over-smoothing remains a fundamental challenge in deep Graph Neural Networks (GNNs), where repeated message passing causes node representations to become indistinguishable. While existing solutions, such as residual connections and skip…

Machine Learning · Computer Science 2026-04-13 Xin He , Yili Wang , Yiwei Dai , Xin Wang

Despite the wide application of Graph Convolutional Network (GCN), one major limitation is that it does not benefit from the increasing depth and suffers from the oversmoothing problem. In this work, we first characterize this phenomenon…

Graph neural networks (GNNs) have revolutionized the field of machine learning on non-Euclidean data such as graphs and networks. GNNs effectively implement node representation learning through neighborhood aggregation and achieve…

Machine Learning · Computer Science 2024-04-30 Zehao Dong , Muhan Zhang , Yixin Chen

Graph Convolutional Neural Network (GCN), a widely adopted method for analyzing relational data, enhances node discriminability through the aggregation of neighboring information. Usually, stacking multiple layers can improve the…

Machine Learning · Computer Science 2024-08-07 Furong Peng , Kang Liu , Xuan Lu , Yuhua Qian , Hongren Yan , Chao Ma

Graph neural networks (GNNs) have achieved significant success in various applications. Most GNNs learn the node features with information aggregation of its neighbors and feature transformation in each layer. However, the node features…

Machine Learning · Computer Science 2024-07-30 Dongzhuoran Zhou , Hui Yang , Bo Xiong , Yue Ma , Evgeny Kharlamov

Graph neural networks (GNNs) and message passing neural networks (MPNNs) have been proven to be expressive for subgraph structures in many applications. Some applications in heterogeneous graphs require explicit edge modeling, such as…

Machine Learning · Computer Science 2021-12-17 Xin Liu , Yangqiu Song

Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of…

Machine Learning · Computer Science 2025-06-02 Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

Physics-informed Graph Neural Networks have achieved remarkable performance in learning through graph-structured data by mitigating common GNN challenges such as over-smoothing, over-squashing, and heterophily adaption. Despite these…

Machine Learning · Computer Science 2024-06-13 Dai Shi , Andi Han , Lequan Lin , Yi Guo , Zhiyong Wang , Junbin Gao

Graph Convolutional Networks (GCNs) suffer from performance degradation when models go deeper. However, earlier works only attributed the performance degeneration to over-smoothing. In this paper, we conduct theoretical and experimental…

Machine Learning · Computer Science 2024-01-24 Weigang Lu , Yibing Zhan , Binbin Lin , Ziyu Guan , Liu Liu , Baosheng Yu , Wei Zhao , Yaming Yang , Dacheng Tao

Graph Neural Networks (GNNs) have shown success in learning from graph structured data containing node/edge feature information, with application to social networks, recommendation, fraud detection and knowledge graph reasoning. In this…

Machine Learning · Computer Science 2021-11-24 Xiang Song , Runjie Ma , Jiahang Li , Muhan Zhang , David Paul Wipf

Graph Neural Networks (GNNs) have demonstrated strong performance in graph mining tasks due to their message-passing mechanism, which is aligned with the homophily assumption that adjacent nodes exhibit similar behaviors. However, in many…

Machine Learning · Computer Science 2024-05-29 Zhuonan Zheng , Yuanchen Bei , Sheng Zhou , Yao Ma , Ming Gu , HongJia XU , Chengyu Lai , Jiawei Chen , Jiajun Bu

Training deep graph neural networks (GNNs) poses a challenging task, as the performance of GNNs may suffer from the number of hidden message-passing layers. The literature has focused on the proposals of {over-smoothing} and…

Machine Learning · Statistics 2023-02-27 Yirui Liu , Xinghao Qiao , Liying Wang , Jessica Lam

Graph Nerual Networks (GNNs) are effective models in graph embedding. It extracts shallow features and neighborhood information by aggregating neighbor information to learn the embedding representation of different nodes. However, the local…

Social and Information Networks · Computer Science 2023-12-14 Kejia Zhang

Graph neural networks (GNNs) have demonstrated a significant success in various graph learning tasks, from graph classification to anomaly detection. There recently has emerged a number of approaches adopting a graph pooling operation…

Machine Learning · Computer Science 2023-03-28 Yuzhou Chen , Yulia R. Gel

Increasing the depth of GCN, which is expected to permit more expressivity, is shown to incur performance detriment especially on node classification. The main cause of this lies in over-smoothing. The over-smoothing issue drives the output…

Machine Learning · Computer Science 2022-07-12 Wenbing Huang , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang

Graph neural networks (GNNs) are emerging machine learning models on graphs. Permutation-equivariance and proximity-awareness are two important properties highly desirable for GNNs. Both properties are needed to tackle some challenging…

Machine Learning · Computer Science 2022-02-23 Ziwei Zhang , Chenhao Niu , Peng Cui , Jian Pei , Bo Zhang , Wenwu Zhu

Graph neural networks (GNNs) are commonly divided into message-passing neural networks (MPNNs) and spectral graph neural networks, reflecting two largely separate research traditions in machine learning and signal processing. This paper…

Despite Graph neural networks' significant performance gain over many classic techniques in various graph-related downstream tasks, their successes are restricted in shallow models due to over-smoothness and the difficulties of…

Machine Learning · Computer Science 2023-12-15 Jin Li , Qirong Zhang , Shuling Xu , Xinlong Chen , Longkun Guo , Yang-Geng Fu

A variety of graph neural networks (GNNs) frameworks for representation learning on graphs have been recently developed. These frameworks rely on aggregation and iteration scheme to learn the representation of nodes. However, information…

Machine Learning · Computer Science 2020-03-25 Xinhan Di , Pengqian Yu , Rui Bu , Mingchao Sun