English
Related papers

Related papers: Aggregation Buffer: Revisiting DropEdge with a New…

200 papers

Graph neural networks (GNNs) are processing architectures that exploit graph structural information to model representations from network data. Despite their success, GNNs suffer from sub-optimal generalization performance given limited…

Machine Learning · Computer Science 2021-06-08 Zhan Gao , Subhrajit Bhattacharya , Leiming Zhang , Rick S. Blum , Alejandro Ribeiro , Brian M. Sadler

\emph{Over-fitting} and \emph{over-smoothing} are two main obstacles of developing deep Graph Convolutional Networks (GCNs) for node classification. In particular, over-fitting weakens the generalization ability on small dataset, while…

Machine Learning · Computer Science 2020-03-13 Yu Rong , Wenbing Huang , Tingyang Xu , Junzhou Huang

It has been discovered that Graph Convolutional Networks (GCNs) encounter a remarkable drop in performance when multiple layers are piled up. The main factor that accounts for why deep GCNs fail lies in over-smoothing, which isolates the…

Machine Learning · Computer Science 2023-06-22 Jiaqi Han , Wenbing Huang , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang

Increasing the depth of GCN, which is expected to permit more expressivity, is shown to incur performance detriment especially on node classification. The main cause of this lies in over-smoothing. The over-smoothing issue drives the output…

Machine Learning · Computer Science 2022-07-12 Wenbing Huang , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang

Although Graph Neural Networks (GNNs) have exhibited the powerful ability to gather graph-structured information from neighborhood nodes via various message-passing mechanisms, the performance of GNNs is limited by poor generalization and…

Machine Learning · Computer Science 2024-08-15 Zhaoliang Chen , Zhihao Wu , Ylli Sadikaj , Claudia Plant , Hong-Ning Dai , Shiping Wang , Yiu-Ming Cheung , Wenzhong Guo

Graph Neural Networks (GNNs) have demonstrated significant success in graph learning and are widely adopted across various critical domains. However, the irregular connectivity between vertices leads to inefficient neighbor aggregation,…

Hardware Architecture · Computer Science 2025-06-27 Gongjian Sun , Mingyu Yan , Dengke Han , Runzhen Xue , Duo Wang , Xiaochun Ye , Dongrui Fan

Graph Neural Networks (GNNs) are powerful tools for graph representation learning. Despite their rapid development, GNNs also face some challenges, such as over-fitting, over-smoothing, and non-robustness. Previous works indicate that these…

Machine Learning · Computer Science 2023-07-04 Taoran Fang , Zhiqing Xiao , Chunping Wang , Jiarong Xu , Xuan Yang , Yang Yang

The paper discusses signed graphs, which model friendly or antagonistic relationships using edges marked with positive or negative signs, focusing on the task of link sign prediction. While Signed Graph Neural Networks (SGNNs) have…

Machine Learning · Computer Science 2024-10-03 Zeyu Zhang , Lu Li , Shuyan Wan , Sijie Wang , Zhiyi Wang , Zhiyuan Lu , Dong Hao , Wanli Li

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of…

Machine Learning · Computer Science 2023-03-22 Wenqi Wei , Mu Qiao , Divyesh Jadav

Graph neural networks (GNNs) are powerful tools for exploring and learning from graph structures and features. As such, achieving high-performance execution for GNNs becomes crucially important. Prior works have proposed to explore the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-30 Yangjie Zhou , Yaoxu Song , Jingwen Leng , Zihan Liu , Weihao Cui , Zhendong Zhang , Cong Guo , Quan Chen , Li Li , Minyi Guo

Data augmentation has been widely used to improve generalizability of machine learning models. However, comparatively little work studies data augmentation for graphs. This is largely due to the complex, non-Euclidean structure of graphs,…

Machine Learning · Computer Science 2020-12-03 Tong Zhao , Yozen Liu , Leonardo Neves , Oliver Woodford , Meng Jiang , Neil Shah

Message Passing Neural Networks (MPNNs) are a class of Graph Neural Networks (GNNs) that propagate information across the graph via local neighborhoods. The scheme gives rise to two key challenges: over-smoothing and over-squashing. While…

Machine Learning · Computer Science 2025-05-30 Jasraj Singh , Keyue Jiang , Brooks Paige , Laura Toni

The Graph Neural Network (GNN) has been widely used for graph data representation. However, the existing researches only consider the ideal balanced dataset, and the imbalanced dataset is rarely considered. Traditional methods such as…

Machine Learning · Computer Science 2022-05-10 S. Shi , Kai Qiao , Shuai Yang , L. Wang , J. Chen , Bin Yan

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a neural message passing…

Machine Learning · Computer Science 2021-03-19 Tien Huu Do , Duc Minh Nguyen , Giannis Bekoulis , Adrian Munteanu , Nikos Deligiannis

Heterogeneous Graph Neural Networks (HGNNs) have broadened the applicability of graph representation learning to heterogeneous graphs. However, the irregular memory access pattern of HGNNs leads to the buffer thrashing issue in HGNN…

Hardware Architecture · Computer Science 2024-04-09 Runzhen Xue , Mingyu Yan , Dengke Han , Yihan Teng , Zhimin Tang , Xiaochun Ye , Dongrui Fan

Augmented graphs play a vital role in regularizing Graph Neural Networks (GNNs), which leverage information exchange along edges in graphs, in the form of message passing, for learning. Due to their effectiveness, simple edge and node…

Machine Learning · Computer Science 2022-09-07 Hongyu Guo , Sun Sun

Data augmentation helps neural networks generalize better by enlarging the training set, but it remains an open question how to effectively augment graph data to enhance the performance of GNNs (Graph Neural Networks). While most existing…

Machine Learning · Computer Science 2022-03-30 Kezhi Kong , Guohao Li , Mucong Ding , Zuxuan Wu , Chen Zhu , Bernard Ghanem , Gavin Taylor , Tom Goldstein

This paper studies Dropout Graph Neural Networks (DropGNNs), a new approach that aims to overcome the limitations of standard GNN frameworks. In DropGNNs, we execute multiple runs of a GNN on the input graph, with some of the nodes randomly…

Machine Learning · Computer Science 2021-11-12 Pál András Papp , Karolis Martinkus , Lukas Faber , Roger Wattenhofer

Large-scale graphs are ubiquitous in real-world scenarios and can be trained by Graph Neural Networks (GNNs) to generate representation for downstream tasks. Given the abundant information and complex topology of a large-scale graph, we…

Machine Learning · Computer Science 2022-09-05 Xin Liu , Xunbin Xiong , Mingyu Yan , Runzhen Xue , Shirui Pan , Xiaochun Ye , Dongrui Fan

Graph neural network (GNN) has been demonstrated powerful in modeling graph-structured data. However, despite many successful cases of applying GNNs to various graph classification and prediction tasks, whether the graph geometrical…

Machine Learning · Computer Science 2023-07-20 Dai Shi , Yi Guo , Zhiqi Shao , Junbin Gao
‹ Prev 1 2 3 10 Next ›