中文
相关论文

相关论文: Tackling Oversmoothing in GNN via Graph Sparsifica…

200 篇论文

Graph Neural Networks (GNNs) have been emerging as a promising method for relational representation including recommender systems. However, various challenging issues of social graphs hinder the practical usage of GNNs for social…

社会与信息网络 · 计算机科学 2019-08-08 Kyung-Min Kim , Donghyun Kwak , Hanock Kwak , Young-Jin Park , Sangkwon Sim , Jae-Han Cho , Minkyu Kim , Jihun Kwon , Nako Sung , Jung-Woo Ha

Message passing has evolved as an effective tool for designing Graph Neural Networks (GNNs). However, most existing methods for message passing simply sum or average all the neighboring features to update node representations. They are…

机器学习 · 计算机科学 2022-06-17 Rui Yang , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

Graph Neural Networks (GNNs) have achieved a lot of success on graph-structured data. However, it is observed that the performance of graph neural networks does not improve as the number of layers increases. This effect, known as…

机器学习 · 计算机科学 2020-06-25 Chen Cai , Yusu Wang

Graph Neural Networks (GNNs) play a pivotal role in graph-based tasks for their proficiency in representation learning. Among the various GNN methods, spectral GNNs employing polynomial filters have shown promising performance on tasks…

机器学习 · 计算机科学 2025-01-09 Haipeng Ding , Zhewei Wei , Yuhang Ye

Graph Neural Networks (GNNs) perform computations on graphs by routing the signal between graph regions using a graph shift operator or a message passing scheme. Often, the propagation of the signal leads to a loss of information, where the…

机器学习 · 计算机科学 2026-05-14 Eden Nagar , Ya-Wei Eileen Lin , Ron Levie

We propose a unified framework for adaptive connection sampling in graph neural networks (GNNs) that generalizes existing stochastic regularization methods for training GNNs. The proposed framework not only alleviates over-smoothing and…

Graph neural networks (GNNs) are known to be vulnerable to oversmoothing due to their implicit homophily assumption. We mitigate this problem with a novel scheme that regulates the aggregation of messages, modulating the type and extent of…

机器学习 · 计算机科学 2025-12-03 Haishan Wang , Arno Solin , Vikas Garg

The attention mechanism has demonstrated superior performance for inference over nodes in graph neural networks (GNNs), however, they result in a high computational burden during both training and inference. We propose FastGAT, a method to…

机器学习 · 计算机科学 2020-10-06 Rakshith S Srinivasa , Cao Xiao , Lucas Glass , Justin Romberg , Jimeng Sun

Graph Neural Networks (GNNs) have achieved promising performance on a wide range of graph-based tasks. Despite their success, one severe limitation of GNNs is the over-smoothing issue (indistinguishable representations of nodes in different…

机器学习 · 计算机科学 2019-11-19 Deli Chen , Yankai Lin , Wei Li , Peng Li , Jie Zhou , Xu Sun

Graph convolutional networks (GCNs) are a powerful deep learning approach for graph-structured data. Recently, GCNs and subsequent variants have shown superior performance in various application areas on real-world datasets. Despite their…

机器学习 · 计算机科学 2020-07-07 Ming Chen , Zhewei Wei , Zengfeng Huang , Bolin Ding , Yaliang Li

While Graph Neural Networks (GNNs) have achieved enormous success in multiple graph analytical tasks, modern variants mostly rely on the strong inductive bias of homophily. However, real-world networks typically exhibit both homophilic and…

机器学习 · 计算机科学 2024-09-18 Jingwei Guo , Kaizhu Huang , Rui Zhang , Xinping Yi

Graphs are central to modeling complex systems in domains such as social networks, molecular chemistry, and neuroscience. While Graph Neural Networks, particularly Graph Convolutional Networks, have become standard tools for graph learning,…

机器学习 · 计算机科学 2025-11-03 Angelica Liguori , Ettore Ritacco , Pietro Sabatino , Annalisa Socievole

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

机器学习 · 计算机科学 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

In node classification tasks, graph convolutional neural networks (GCNs) have demonstrated competitive performance over traditional methods on diverse graph data. However, it is known that the performance of GCNs degrades with increasing…

机器学习 · 计算机科学 2022-11-29 Yujun Yan , Milad Hashemi , Kevin Swersky , Yaoqing Yang , Danai Koutra

The quality of signal propagation in message-passing graph neural networks (GNNs) strongly influences their expressivity as has been observed in recent works. In particular, for prediction tasks relying on long-range interactions, recursive…

机器学习 · 计算机科学 2022-08-09 Pradeep Kr. Banerjee , Kedar Karhadkar , Yu Guang Wang , Uri Alon , Guido Montúfar

Increasing the depth of GCN, which is expected to permit more expressivity, is shown to incur performance detriment especially on node classification. The main cause of this lies in over-smoothing. The over-smoothing issue drives the output…

机器学习 · 计算机科学 2022-07-12 Wenbing Huang , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang

In wireless networks characterized by dense connectivity, the significant signaling overhead generated by distributed link scheduling algorithms can exacerbate issues like congestion, energy consumption, and radio footprint expansion. To…

网络与互联网体系结构 · 计算机科学 2025-09-09 Zhongyuan Zhao , Gunjan Verma , Ananthram Swami , Santiago Segarra

In recent years, Graph Neural Networks (GNNs) have shown superior performance on diverse applications on real-world datasets. To improve the model capacity and alleviate the over-smoothing problem, several methods proposed to incorporate…

机器学习 · 计算机科学 2021-12-28 Lanning Wei , Huan Zhao , Zhiqiang He

In recent years, graph neural networks (GNNs) have achieved state-of-the-art performance for node classification. However, most existing GNNs would suffer from the graph imbalance problem. In many real-world scenarios, node classes are…

机器学习 · 计算机科学 2022-06-14 Tianxiang Zhao , Xiang Zhang , Suhang Wang

Graph neural networks (GNNs) have achieved significant success in various applications. Most GNNs learn the node features with information aggregation of its neighbors and feature transformation in each layer. However, the node features…

机器学习 · 计算机科学 2024-07-30 Dongzhuoran Zhou , Hui Yang , Bo Xiong , Yue Ma , Evgeny Kharlamov