English
Related papers

Related papers: Learning Large Graph Property Prediction via Graph…

200 papers

Graph Neural Networks (GNNs) rely on graph convolutions to exploit meaningful patterns in networked data. Based on matrix multiplications, convolutions incur in high computational costs leading to scalability limitations in practice. To…

Machine Learning · Computer Science 2022-10-28 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Spatio-temporal (ST) prediction is an important and widely used technique in data mining and analytics, especially for ST data in urban systems such as transportation data. In practice, the ST data generation is usually influenced by…

Machine Learning · Computer Science 2024-03-08 Jiahao Ji , Jingyuan Wang , Yu Mou , Cheng Long

Full-batch training on Graph Neural Networks (GNN) to learn the structure of large graphs is a critical problem that needs to scale to hundreds of compute nodes to be feasible. It is challenging due to large memory capacity and bandwidth…

We present the Graph Forward-Forward (GFF) algorithm, an extension of the Forward-Forward procedure to graphs, able to handle features distributed over a graph's nodes. This allows training graph neural networks with forward passes only,…

Machine Learning · Computer Science 2023-02-13 Daniele Paliotta , Mathieu Alain , Bálint Máté , François Fleuret

As graphs grow larger, full-batch GNN training becomes hard for single GPU memory. Therefore, to enhance the scalability of GNN training, some studies have proposed sampling-based mini-batch training and distributed graph learning. However,…

Machine Learning · Computer Science 2024-08-22 Zhengjia Xu , Dingyang Lyu , Jinghui Zhang

Automatic building extraction from optical imagery remains a challenge due to, for example, the complexity of building shapes. Semantic segmentation is an efficient approach for this task. The latest development in deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Yilei Shi , Qingyu Li , Xiao Xiang Zhu

In smart mobility, large networks of geographically distributed sensors produce vast amounts of high-frequency spatio-temporal data that must be processed in real time to avoid major disruptions. Traditional centralized approaches are…

Machine Learning · Computer Science 2025-05-23 Ivan Kralj , Lodovico Giaretta , Gordan Ježić , Ivana Podnar Žarko , Šarūnas Girdzijauskas

A significant portion of the data today, e.g, social networks, web connections, etc., can be modeled by graphs. A proper analysis of graphs with Machine Learning (ML) algorithms has the potential to yield far-reaching insights into many…

Social and Information Networks · Computer Science 2020-09-11 Taha Atahan Akyildiz , Amro Alabsi Aljundi , Kamer Kaya

Graph convolutional networks (GCNs) have been employed as a kind of significant tool on many graph-based applications recently. Inspired by convolutional neural networks (CNNs), GCNs generate the embeddings of nodes by aggregating the…

Machine Learning · Computer Science 2020-11-20 Tao Huang , Yihan Zhang , Jiajing Wu , Junyuan Fang , Zibin Zheng

We propose a new method for embedding graphs while preserving directed edge information. Learning such continuous-space vector representations (or embeddings) of nodes in a graph is an important first step for using network information…

Machine Learning · Computer Science 2017-09-15 Sami Abu-El-Haija , Bryan Perozzi , Rami Al-Rfou

Advanced graph neural networks have shown great potentials in graph classification tasks recently. Different from node classification where node embeddings aggregated from local neighbors can be directly used to learn node labels, graph…

Machine Learning · Computer Science 2022-03-16 Hao Jia , Junzhong Ji , Minglong Lei

Node embedding learns a low-dimensional representation for each node in the graph. Recent progress on node embedding shows that proximity matrix factorization methods gain superb performance and scale to large graphs with millions of nodes.…

Machine Learning · Computer Science 2021-08-13 Xingyi Zhang , Kun Xie , Sibo Wang , Zengfeng Huang

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and…

Machine Learning · Computer Science 2021-09-22 Wenzheng Feng , Jie Zhang , Yuxiao Dong , Yu Han , Huanbo Luan , Qian Xu , Qiang Yang , Evgeny Kharlamov , Jie Tang

Graph neural networks (GNNs) have achieved success in various inference tasks on graph-structured data. However, common challenges faced by many GNNs in the literature include the problem of graph node embedding under various geometries and…

Machine Learning · Computer Science 2023-03-03 Qiyu Kang , Kai Zhao , Yang Song , Sijie Wang , Rui She , Wee Peng Tay

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

Machine Learning · Computer Science 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin

In recent years, graph neural networks (GNNs) have been widely applied in tackling combinatorial optimization problems. However, existing methods still suffer from limited accuracy when addressing that on complex graphs and exhibit poor…

Machine Learning · Computer Science 2025-11-13 Yuyao Long

Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to…

Machine Learning · Computer Science 2024-06-26 Juan Cervino , Md Asadullah Turja , Hesham Mostafa , Nageen Himayat , Alejandro Ribeiro

Feature extraction and dimension reduction for networks is critical in a wide variety of domains. Efficiently and accurately learning features for multiple graphs has important applications in statistical inference on graphs. We propose a…

Applications · Statistics 2021-06-23 Shangsi Wang , Jesús Arroyo , Joshua T. Vogelstein , Carey E. Priebe

Graph neural networks (GNNs) are deep learning models designed specifically for graph data, and they typically rely on node features as the input to the first layer. When applying such a type of network on the graph without node features,…