English
Related papers

Related papers: SpanGNN: Towards Memory-Efficient Graph Neural Net…

200 papers

Graph Neural Networks (GNNs) have shown success in many real-world applications that involve graph-structured data. Most of the existing single-node GNN training systems are capable of training medium-scale graphs with tens of millions of…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-02 Yi-Chien Lin , Viktor Prasanna

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

In recent years, Graph Neural Networks (GNNs) have been popular in the graph classification task. Currently, shallow GNNs are more common due to the well-known over-smoothing problem facing deeper GNNs. However, they are sub-optimal without…

Machine Learning · Computer Science 2023-02-20 Lanning Wei , Zhiqiang He , Huan Zhao , Quanming Yao

Graph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data. However, training GNNs usually requires abundant task-specific labeled data, which is often arduously expensive to obtain. One effective…

Machine Learning · Computer Science 2020-06-30 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Kai-Wei Chang , Yizhou Sun

Graph Neural Networks (GNNs) rely on graph convolutions to exploit meaningful patterns in networked data. Based on matrix multiplications, convolutions incur in high computational costs leading to scalability limitations in practice. To…

Machine Learning · Computer Science 2022-10-28 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Graph Neural Networks (GNNs) excel in various graph learning tasks but face computational challenges when applied to large-scale graphs. A promising solution is to remove non-essential edges to reduce the computational overheads in GNN.…

Machine Learning · Computer Science 2024-02-05 Guibin Zhang , Yanwei Yue , Kun Wang , Junfeng Fang , Yongduo Sui , Kai Wang , Yuxuan Liang , Dawei Cheng , Shirui Pan , Tianlong Chen

Graph neural networks (GNN) have recently emerged as a vehicle for applying deep network architectures to graph and relational data. However, given the increasing size of industrial datasets, in many practical situations the message passing…

Machine Learning · Computer Science 2021-11-16 Qingru Zhang , David Wipf , Quan Gan , Le Song

Graph neural networks (GNNs) have been used to tackle the few-shot learning (FSL) problem and shown great potentials under the transductive setting. However under the inductive setting, existing GNN based methods are less competitive. This…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Tianyuan Yu , Sen He , Yi-Zhe Song , Tao Xiang

Many applications of machine learning require a model to make accurate pre-dictions on test examples that are distributionally different from training ones, while task-specific labels are scarce during training. An effective approach to…

Machine Learning · Computer Science 2020-02-20 Weihua Hu , Bowen Liu , Joseph Gomes , Marinka Zitnik , Percy Liang , Vijay Pande , Jure Leskovec

Graph neural network (GNN) has shown convincing performance in learning powerful node representations that preserve both node attributes and graph structural information. However, many GNNs encounter problems in effectiveness and efficiency…

Machine Learning · Computer Science 2022-01-03 Jiyang Bai , Yuxiang Ren , Jiawei Zhang

Distributed training of graph neural networks (GNNs) has become a crucial technique for processing large graphs. Prevalent GNN frameworks are model-centric, necessitating the transfer of massive graph vertex features to GNN models, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-10 Weijian Chen , Shuibing He , Haoyang Qu , Xuechen Zhang

Graph Neural Networks (GNNs) have demonstrated a great potential in a variety of graph-based applications, such as recommender systems, drug discovery, and object recognition. Nevertheless, resource-efficient GNN learning is a rarely…

Machine Learning · Computer Science 2022-02-18 Zihui Xue , Yuedong Yang , Mengtian Yang , Radu Marculescu

Graph neural networks (GNNs) work remarkably well in semi-supervised node regression, yet a rigorous theory explaining when and why they succeed remains lacking. To address this gap, we study an aggregate-and-readout model that encompasses…

Machine Learning · Statistics 2026-02-20 Juntong Chen , Claire Donnat , Olga Klopp , Johannes Schmidt-Hieber

Many deep learning tasks have to deal with graphs (e.g., protein structures, social networks, source code abstract syntax trees). Due to the importance of these tasks, people turned to Graph Neural Networks (GNNs) as the de facto method for…

Machine Learning · Computer Science 2021-12-07 Shunhua Jiang , Yunze Man , Zhao Song , Zheng Yu , Danyang Zhuo

Memory-based Dynamic Graph Neural Networks (MDGNNs) are a family of dynamic graph neural networks that leverage a memory module to extract, distill, and memorize long-term temporal dependencies, leading to superior performance compared to…

Machine Learning · Computer Science 2024-02-27 Junwei Su , Difan Zou , Chuan Wu

Graph neural networks (GNNs) are a type of neural network capable of learning on graph-structured data. However, training GNNs on large-scale graphs is challenging due to iterative aggregations of high-dimensional features from neighboring…

Machine Learning · Computer Science 2024-09-18 Nikolai Merkel , Pierre Toussing , Ruben Mayer , Hans-Arno Jacobsen

Graph Neural Networks (GNNs) have been widely adopted for their ability to compute expressive node representations in graph datasets. However, serving GNNs on large graphs is challenging due to the high communication, computation, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-16 Geon-Woo Kim , Donghyun Kim , Jeongyoon Moon , Henry Liu , Tarannum Khan , Anand Iyer , Daehyeok Kim , Aditya Akella

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Training large scale Graph Neural Networks (GNNs) requires significant computational resources, and the process is highly data-intensive. One of the most effective ways to reduce resource requirements is minibatch training coupled with…

Machine Learning · Computer Science 2024-09-10 Muhammed Fatih Balin , Dominique LaSalle , Ümit V. Çatalyürek

Graph Neural Networks (GNNs) have greatly advanced the semi-supervised node classification task on graphs. The majority of existing GNNs are trained in an end-to-end manner that can be viewed as tackling a bi-level optimization problem.…

Machine Learning · Computer Science 2023-07-20 Haoyu Han , Xiaorui Liu , Haitao Mao , MohamadAli Torkamani , Feng Shi , Victor Lee , Jiliang Tang