English
Related papers

Related papers: Bonsai: Gradient-free Graph Condensation for Node …

200 papers

Graph Convolutional Networks (GCNs) achieve an impressive performance due to the remarkable representation ability in learning the graph information. However, GCNs, when implemented on a deep network, require expensive computation power,…

Machine Learning · Computer Science 2022-08-03 Zulun Zhu , Jiaying Peng , Jintang Li , Liang Chen , Qi Yu , Siqiang Luo

Graph neural networks (GNN) analysis engines are vital for real-world problems that use large graph models. Challenges for a GNN hardware platform include the ability to (a) host a variety of GNNs, (b) handle high sparsity in input vertex…

Hardware Architecture · Computer Science 2021-08-10 Sudipta Mondal , Susmita Dey Manasi , Kishor Kunal , S. Ramprasath , Sachin S. Sapatnekar

Node classifiers are required to comprehensively reduce prediction errors, training resources, and inference latency in the industry. However, most graph neural networks (GNN) concentrate only on one or two of them. The compromised aspects…

Machine Learning · Computer Science 2023-06-01 Yi Luo , Guangchun Luo , Ke Qin , Aiguo Chen

Graph Neural Networks (GNNs) have emerged as powerful tools for learning representations from structured data. Despite their growing popularity and success across various applications, GNNs encounter several challenges that limit their…

Machine Learning · Computer Science 2026-02-03 Yassine Abbahaddou

Graph Neural Networks (GNNs) have emerged as effective tools for learning tasks on graph-structured data. Recently, Graph-Informed (GI) layers were introduced to address regression tasks on graph nodes, extending their applicability beyond…

Machine Learning · Computer Science 2024-03-21 Francesco Della Santa

Teaching Graph Neural Networks (GNNs) to accurately classify nodes under severely noisy labels is an important problem in real-world graph learning applications, but is currently underexplored. Although pairwise training methods have…

Machine Learning · Computer Science 2023-06-06 Xuefeng Du , Tian Bian , Yu Rong , Bo Han , Tongliang Liu , Tingyang Xu , Wenbing Huang , Yixuan Li , Junzhou Huang

With the increasing computation of training graph neural networks (GNNs) on large-scale graphs, graph condensation (GC) has emerged as a promising solution to synthesize a compact, substitute graph of the large-scale original graph for…

Machine Learning · Computer Science 2025-10-09 Xinyi Gao , Yayong Li , Tong Chen , Guanhua Ye , Wentao Zhang , Hongzhi Yin

The MIT/IEEE/Amazon GraphChallenge.org encourages community approaches to developing new solutions for analyzing graphs and sparse data. Sparse AI analytics present unique scalability difficulties. The proposed Sparse Deep Neural Network…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Jeremy Kepner , Simon Alford , Vijay Gadepally , Michael Jones , Lauren Milechin , Ryan Robinett , Sid Samsi

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

In recent years, plentiful evidence illustrates that Graph Convolutional Networks (GCNs) achieve extraordinary accomplishments on the node classification task. However, GCNs may be vulnerable to adversarial attacks on label-scarce dynamic…

Machine Learning · Computer Science 2022-03-09 Jun Zhuang , Mohammad Al Hasan

Neural networks often struggle with high-dimensional but small sample-size tabular datasets. One reason is that current weight initialisation methods assume independence between weights, which can be problematic when there are insufficient…

Machine Learning · Computer Science 2024-08-20 Andrei Margeloiu , Nikola Simidjievski , Pietro Lio , Mateja Jamnik

Graph Transformer (GT), as a special type of Graph Neural Networks (GNNs), utilizes multi-head attention to facilitate high-order message passing. However, this also imposes several limitations in node classification applications: 1) nodes…

Machine Learning · Computer Science 2024-10-16 Jiajun Zhou , Xuanze Chen , Chenxuan Xie , Yu Shanqing , Qi Xuan , Xiaoniu Yang

Due to the significant computational challenge of training large-scale graph neural networks (GNNs), various sparse learning techniques have been exploited to reduce memory and storage costs. Examples include \textit{graph sparsification}…

Machine Learning · Computer Science 2023-02-07 Shuai Zhang , Meng Wang , Pin-Yu Chen , Sijia Liu , Songtao Lu , Miao Liu

Graph Neural Networks (GNNs) is an architecture for structural data, and has been adopted in a mass of tasks and achieved fabulous results, such as link prediction, node classification, graph classification and so on. Generally, for a…

Machine Learning · Computer Science 2022-05-12 Ye Tang , Xuesong Yang , Xinrui Liu , Xiwei Zhao , Zhangang Lin , Changping Peng

Graph neural networks (GNNs) have achieved remarkable success in processing graph-structured data across various applications. A critical aspect of real-world graphs is their dynamic nature, where new nodes are continually added and…

Machine Learning · Computer Science 2025-09-09 Huayi Tang , Yong Liu

Graph convolutional networks (GCNs) are widely used in graph-based applications such as graph classification and segmentation. However, current GCNs have limitations on implementation such as network architectures due to their irregular…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yecheng Lyu , Xinming Huang , Ziming Zhang

The rapid progress in image classification has been largely driven by the adoption of Graph Convolutional Networks (GCNs), which offer a robust framework for handling complex data structures. This study introduces a novel approach that…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Mustafa Mohammadi Gharasuie , Luis Rueda

Graph neural networks (GNNs) are known to operate with high accuracy on learning from graph-structured data, but they suffer from high computational and resource costs. Neural network compression methods are used to reduce the model size…

Machine Learning · Computer Science 2025-10-28 Khatoon Khedri , Reza Rawassizadeh , Qifu Wen , Mehdi Hosseinzadeh

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

Machine Learning · Computer Science 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu