English
Related papers

Related papers: Effects of Dropout on Performance in Long-range Gr…

200 papers

Deep learning methods for graphs achieve remarkable performance on many node-level and graph-level prediction tasks. However, despite the proliferation of the methods and their success, prevailing Graph Neural Networks (GNNs) neglect…

Machine Learning · Computer Science 2020-11-10 Emily Alsentzer , Samuel G. Finlayson , Michelle M. Li , Marinka Zitnik

Deep learning has been successfully adopted in mobile edge computing (MEC) to optimize task offloading and resource allocation. However, the dynamics of edge networks raise two challenges in neural network (NN)-based optimization methods:…

Systems and Control · Electrical Eng. & Systems 2023-06-21 Xiucheng Wang , Nan Cheng , Lianhao Fu , Wei Quan , Ruijin Sun , Yilong Hui , Tom Luan , Xuemin Shen

Existing Graph Neural Networks (GNNs) follow the message-passing mechanism that conducts information interaction among nodes iteratively. While considerable progress has been made, such node interaction paradigms still have the following…

Machine Learning · Computer Science 2023-04-14 Jie Chen , Zilong Li , Yin Zhu , Junping Zhang , Jian Pu

Graph neural networks (GNNs) is widely used to learn a powerful representation of graph-structured data. Recent work demonstrates that transferring knowledge from self-supervised tasks to downstream tasks could further improve graph…

Machine Learning · Computer Science 2021-07-21 Xueting Han , Zhenhuan Huang , Bang An , Jing Bai

The dominant paradigm for learning on graph-structured data is message passing. Despite being a strong inductive bias, the local message passing mechanism suffers from pathological issues such as over-smoothing, over-squashing, and limited…

Machine Learning · Computer Science 2025-04-15 Jacob Bamberger , Federico Barbero , Xiaowen Dong , Michael M. Bronstein

Graph Neural Networks (GNNs) are routinely used in molecular physics, social sciences, and economics to model many-body interactions in graph-like systems. However, GNNs are inherently local and can suffer from information flow bottlenecks.…

Computational Physics · Physics 2025-02-21 Alessandro Caruso , Jacopo Venturin , Lorenzo Giambagli , Edoardo Rolando , Frank Noé , Cecilia Clementi

It has been observed that message-passing graph neural networks (GNN) sometimes struggle to maintain a healthy balance between the efficient/scalable modeling of long-range dependencies across nodes while avoiding unintended consequences…

Machine Learning · Computer Science 2025-05-21 Yongyi Yang , Tang Liu , Yangkun Wang , Zengfeng Huang , David Wipf

Graph Neural Networks (GNNs) have achieved state-of-the-art (SOTA) performance in diverse domains. However, training GNNs on large-scale graphs poses significant challenges due to high memory demands and significant communication overhead…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-19 Arefin Niam , M S Q Zulkar Nine

Graph neural networks (GNN) have recently emerged as a vehicle for applying deep network architectures to graph and relational data. However, given the increasing size of industrial datasets, in many practical situations the message passing…

Machine Learning · Computer Science 2021-11-16 Qingru Zhang , David Wipf , Quan Gan , Le Song

Signal processing is crucial for satisfying the high data rate requirements of future sixth-generation (6G) wireless networks. However, the rapid growth of wireless networks has brought about massive data traffic, which hinders the…

Signal Processing · Electrical Eng. & Systems 2025-02-18 Ziheng Liu , Jiayi Zhang , Yiyang Zhu , Enyu Shi , Bo Ai

Graph Neural Networks (GNNs) have emerged as a cornerstone of deep learning, with most existing methods rooted in graph signal processing and diffusion equations to model message passing. However, these approaches inherently suffer from the…

Machine Learning · Computer Science 2026-05-26 Zexing Zhao , Guangsi Shi , Yu Gong , Tianyu Wang , Shirui Pan , Hongye Cheng , Yuxiao Li

Graph neural networks (GNNs) can extract features by learning both the representation of each objects (i.e., graph nodes) and the relationship across different objects (i.e., the edges that connect nodes), achieving state-of-the-art…

Hardware Architecture · Computer Science 2022-05-11 Yunjae Lee , Jinha Chung , Minsoo Rhu

Graph Neural Networks (GNNs), originally proposed for node classification, have also motivated many recent works on edge prediction (a.k.a., link prediction). However, existing methods lack elaborate design regarding the distinctions…

Machine Learning · Computer Science 2024-01-24 Jiarui Jin , Yangkun Wang , Weinan Zhang , Quan Gan , Xiang Song , Yong Yu , Zheng Zhang , David Wipf

Graph Neural Networks (GNNs) have achieved great success in various graph mining tasks.However, drastic performance degradation is always observed when a GNN is stacked with many layers. As a result, most GNNs only have shallow…

Machine Learning · Computer Science 2022-06-10 Wentao Zhang , Zeang Sheng , Ziqi Yin , Yuezihan Jiang , Yikuan Xia , Jun Gao , Zhi Yang , Bin Cui

Graph Neural Networks (GNNs) have emerged as one of the leading approaches for machine learning on graph-structured data. Despite their great success, critical computational challenges such as over-smoothing, over-squashing, and limited…

Machine Learning · Computer Science 2023-09-14 Zhiqi Shao , Dai Shi , Andi Han , Yi Guo , Qibin Zhao , Junbin Gao

Edge intelligence has arisen as a promising computing paradigm for supporting miscellaneous smart applications that rely on machine learning techniques. While the community has extensively investigated multi-tier edge deployment for…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Liekang Zeng , Chongyu Yang , Peng Huang , Zhi Zhou , Shuai Yu , Xu Chen

Traditional Graph Neural Networks (GNNs) rely on network homophily, which can lead to performance degradation due to over-smoothing in many real-world heterophily scenarios. Recent studies analyze the smoothing effect (separability) after…

Machine Learning · Computer Science 2024-11-05 Yoonhyuk Choi , Jiho Choi , Taewook Ko , Chong-Kwon Kim

Graph Convolutional Networks (GCNs) suffer from performance degradation when models go deeper. However, earlier works only attributed the performance degeneration to over-smoothing. In this paper, we conduct theoretical and experimental…

Machine Learning · Computer Science 2024-01-24 Weigang Lu , Yibing Zhan , Binbin Lin , Ziyu Guan , Liu Liu , Baosheng Yu , Wei Zhao , Yaming Yang , Dacheng Tao

Message-passing graph neural networks (MPNNs) emerged as powerful tools for processing graph-structured input. However, they operate on a fixed input graph structure, ignoring potential noise and missing information. Furthermore, their…

Machine Learning · Computer Science 2024-03-27 Chendi Qian , Andrei Manolache , Kareem Ahmed , Zhe Zeng , Guy Van den Broeck , Mathias Niepert , Christopher Morris

Graph neural network (GNN) has been demonstrated powerful in modeling graph-structured data. However, despite many successful cases of applying GNNs to various graph classification and prediction tasks, whether the graph geometrical…

Machine Learning · Computer Science 2023-07-20 Dai Shi , Yi Guo , Zhiqi Shao , Junbin Gao