English
Related papers

Related papers: GIST: Distributed Training for Large-Scale Graph C…

200 papers

Graph Neural Networks(GNNs) are a family of neural models tailored for graph-structure data and have shown superior performance in learning representations for graph-structured data. However, training GNNs on large graphs remains…

Machine Learning · Computer Science 2022-12-13 Junwei Su

Graph Neural Networks (GNNs) are versatile, powerful machine learning methods that enable graph structure and feature representation learning, and have applications across many domains. For applications critically requiring interpretation,…

Machine Learning · Computer Science 2020-07-02 Chris Lin , Gerald J. Sun , Krishna C. Bulusu , Jonathan R. Dry , Marylens Hernandez

Graph neural networks (GNNs), which have emerged as an effective method for handling machine learning tasks on graphs, bring a new approach to building recommender systems, where the task of recommendation can be formulated as the link…

Information Retrieval · Computer Science 2022-11-03 Yuwei Hu , Jiajie Li , Zhongming Yu , Zhiru Zhang

We propose a framework that automatically transforms non-scalable GNNs into precomputation-based GNNs which are efficient and scalable for large-scale graphs. The advantages of our framework are two-fold; 1) it transforms various…

Machine Learning · Computer Science 2022-07-26 Seiji Maekawa , Yuya Sasaki , George Fletcher , Makoto Onizuka

Recently, graph convolutional networks (GCNs) have shown great potential for the task of graph matching. It can integrate graph node feature embedding, node-wise affinity learning and matching optimization together in a unified end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Bo Jiang , Pengfei Sun , Jin Tang , Bin Luo

Human motion prediction is still an open problem extremely important for autonomous driving and safety applications. Due to the complex spatiotemporal relation of motion sequences, this remains a challenging problem not only for movement…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Edgar Medina , Leyong Loh , Namrata Gurung , Kyung Hun Oh , Niels Heller

In many real-world network datasets such as co-authorship, co-citation, email communication, etc., relationships are complex and go beyond pairwise. Hypergraphs provide a flexible and natural modeling tool to model such complex…

Machine Learning · Computer Science 2019-05-23 Naganand Yadati , Madhav Nimishakavi , Prateek Yadav , Vikram Nitin , Anand Louis , Partha Talukdar

Graph Convolutional Networks (GCNs) have shown very powerful for graph data representation and learning tasks. Existing GCNs usually conduct feature aggregation on a fixed neighborhood graph in which each node computes its representation by…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Bo Jiang , Beibei Wang , Jin Tang , Bin Luo

Graph Convolutional Networks (GCNs) are known to suffer from performance degradation as the number of layers increases, which is usually attributed to over-smoothing. Despite the apparent consensus, we observe that there exists a…

Machine Learning · Computer Science 2021-10-29 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi

Graph Neural Networks (GNNs) have achieved tremendous success in graph representation learning. Unfortunately, current GNNs usually rely on loading the entire attributed graph into network for processing. This implicit assumption may not be…

Machine Learning · Computer Science 2022-02-15 Junfu Wang , Yunhong Wang , Zhen Yang , Liang Yang , Yuanfang Guo

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

Machine Learning · Computer Science 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

The graph neural network (GNN) has demonstrated its superior performance in various applications. The working mechanism behind it, however, remains mysterious. GNN models are designed to learn effective representations for graph-structured…

Machine Learning · Computer Science 2022-06-10 Zepeng Zhang , Ziping Zhao

Graph Neural Networks (GNNs) have emerged as the leading paradigm for solving graph analytical problems in various real-world applications. Nevertheless, GNNs could potentially render biased predictions towards certain demographic…

Machine Learning · Computer Science 2022-11-29 Yushun Dong , Song Wang , Jing Ma , Ninghao Liu , Jundong Li

Traditional clustering algorithms often struggle to capture the complex relationships within graphs and generalise to arbitrary clustering criteria. The emergence of graph neural networks (GNNs) as a powerful framework for learning…

Biological Physics · Physics 2024-09-06 Sam Alexander Martino , João Morado , Chenghao Li , Zhenghao Lu , Edina Rosta

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Deep convolutional neural network (CNN) training via iterative optimization has had incredible success in finding optimal parameters. However, modern CNN architectures often contain millions of parameters. Thus, any given model for a single…

Machine Learning · Computer Science 2023-08-21 Stone Yun , Alexander Wong

This work develops a distributed graph neural network (GNN) methodology for mesh-based modeling applications using a consistent neural message passing layer. As the name implies, the focus is on enabling scalable operations that satisfy…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-03 Shivam Barwey , Riccardo Balin , Bethany Lusch , Saumil Patel , Ramesh Balakrishnan , Pinaki Pal , Romit Maulik , Venkatram Vishwanath

Graph Neural Networks (GNNs) have gained significant attention in recent years due to their ability to learn representations of graph-structured data. Two common methods for training GNNs are mini-batch training and full-graph training.…

Machine Learning · Computer Science 2024-12-24 Saurabh Bajaj , Hojae Son , Juelin Liu , Hui Guan , Marco Serafini

Given the prevalence of large-scale graphs in real-world applications, the storage and time for training neural models have raised increasing concerns. To alleviate the concerns, we propose and study the problem of graph condensation for…

Machine Learning · Computer Science 2022-09-29 Wei Jin , Lingxiao Zhao , Shichang Zhang , Yozen Liu , Jiliang Tang , Neil Shah

Graph convolutional neural networks~(GCNs) have recently demonstrated promising results on graph-based semi-supervised classification, but little work has been done to explore their theoretical properties. Recently, several deep neural…

Machine Learning · Computer Science 2020-02-28 Jilin Hu , Jianbing Shen , Bin Yang , Ling Shao