English
Related papers

Related papers: Distributed Edge Partitioning for Trillion-edge Gr…

200 papers

Distributed systems can be found in various applications, e.g., in robotics or autonomous driving, to achieve higher flexibility and robustness. Thereby, data flow centric applications such as Deep Neural Network (DNN) inference benefit…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-14 Fabian Kreß , El Mahdi El Annabi , Tim Hotfilter , Julian Hoefer , Tanja Harbaum , Juergen Becker

Partitioning a graph into blocks of "roughly equal" weight while cutting only few edges is a fundamental problem in computer science with a wide range of applications. In particular, the problem is a building block in applications that…

Data Structures and Algorithms · Computer Science 2021-05-06 Lars Gottesbüren , Tobias Heuer , Peter Sanders , Christian Schulz , Daniel Seemaier

Graph partitioning is an important preprocessing step to distributed graph processing. In edge partitioning, the edge set of a given graph is split into $k$ equally-sized partitions, such that the replication of vertices across partitions…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-22 Ruben Mayer , Kamil Orujzade , Hans-Arno Jacobsen

Small distributed systems are limited by their main memory to generate massively large graphs. Trivial extension to current graph generators to utilize external memory leads to large amount of random I/O hence do not scale with size. In…

Databases · Computer Science 2012-10-02 Sandeep Gupta

Graph Neural Networks (GNNs) are widely used for learning on graph-structured data, but scaling GNN training to massive graphs remains challenging. To enable scalable distributed training, graphs are divided into smaller partitions that are…

Machine Learning · Computer Science 2026-04-02 Nikolai Merkel , Ruben Mayer , Volker Markl , Hans-Arno Jacobsen

The in-memory graph layout or organization has a considerable impact on the time and energy efficiency of distributed memory graph computations. It affects memory locality, inter-task load balance, communication time, and overall memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-04 George M Slota , Sivasankaran Rajamanickam , Kamesh Madduri

We present distributed algorithms for training dynamic Graph Neural Networks (GNN) on large scale graphs spanning multi-node, multi-GPU systems. To the best of our knowledge, this is the first scaling study on dynamic GNN. We devise…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-17 Venkatesan T. Chakaravarthy , Shivmaran S. Pandian , Saurabh Raje , Yogish Sabharwal , Toyotaro Suzumura , Shashanka Ubaru

We develop an algorithm to solve tridiagonal systems of linear equations, which appear in implicit finite-difference schemes of partial differential equations (PDEs), being the time-dependent Schr\"{o}dinger equation (TDSE) an ideal…

Computational Physics · Physics 2023-03-14 Yaroslav Lutsyshyn , Francisco Navarrete , Dieter Bauer

Partitioning a graph into balanced blocks such that few edges run between blocks is a key problem for large-scale distributed processing. A current trend for partitioning huge graphs are streaming algorithms, which use low computational…

Data Structures and Algorithms · Computer Science 2022-02-02 Marcelo Fonseca Faraj , Christian Schulz

Network embedding, which learns low-dimensional vector representation for nodes in the network, has attracted considerable research attention recently. However, the existing methods are incapable of handling billion-scale networks, because…

Social and Information Networks · Computer Science 2018-09-11 Ziwei Zhang , Peng Cui , Haoyang Li , Xiao Wang , Wenwu Zhu

Hypergraph partitioning is a pervasive NP-hard problem, and accelerating its computation on GPU can both slice time-to-solution and raise quality of results. In this work, we implement a multi-level hypergraph partitioning algorithm on GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-17 Marco Ronzani , Cristina Silvano

In the realm of generative models for graphs, extensive research has been conducted. However, most existing methods struggle with large graphs due to the complexity of representing the entire joint distribution across all node pairs and…

Social and Information Networks · Computer Science 2024-05-15 Andreas Bergmeister , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

Graph Neural Networks (GNNs) have emerged as powerful tools for various graph mining tasks, yet existing scalable solutions often struggle to balance execution efficiency with prediction accuracy. These difficulties stem from iterative…

Machine Learning · Computer Science 2026-04-02 Xu Cheng , Liang Yao , Feng He , Yukuo Cen , Yufei He , Chenhui Zhang , Wenzheng Feng , Hongyun Cai , Jie Tang

Analyzing large graph data is an essential part of many modern applications, such as social networks. Due to its large computational complexity, distributed processing is frequently employed. This requires graph data to be divided across…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-12 YoungJoon Park , DongKyu Lee , Tien-Cuong Bui

We present graph partition neural networks (GPNN), an extension of graph neural networks (GNNs) able to handle extremely large graphs. GPNNs alternate between locally propagating information between nodes in small subgraphs and globally…

Machine Learning · Computer Science 2018-03-19 Renjie Liao , Marc Brockschmidt , Daniel Tarlow , Alexander L. Gaunt , Raquel Urtasun , Richard Zemel

Dynamic Graph Neural Network (DGNN) has shown a strong capability of learning dynamic graphs by exploiting both spatial and temporal features. Although DGNN has recently received considerable attention by AI community and various DGNN…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-08 Fahao Chen , Peng Li , Celimuge Wu

Partitioning graphs into blocks of roughly equal size such that few edges run between blocks is a frequently needed operation when processing graphs on a parallel computer. When a topology of a distributed system is known an important task…

Data Structures and Algorithms · Computer Science 2020-01-23 Marcelo Fonseca Faraj , Alexander van der Grinten , Henning Meyerhenke , Jesper Larsson Träff , Christian Schulz

Graph Partitioning is widely used in many real-world applications such as fraud detection and social network analysis, in order to enable the distributed graph computing on large graphs. However, existing works fail to balance the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-07 Li Zeng , Haohan Huang , Binfan Zheng , Kang Yang , Shengcheng Shao , Jinhua Zhou , Jun Xie , Rongqian Zhao , Xin Chen

The current landscape of balanced graph partitioning is divided into high-quality but expensive multilevel algorithms and cheaper approaches with linear running time, such as single-level algorithms and streaming algorithms. We demonstrate…

Data Structures and Algorithms · Computer Science 2025-04-25 Lars Gottesbüren , Nikolai Maas , Dominik Rosch , Peter Sanders , Daniel Seemaier

Large-scale parallel numerical simulations are essential for a wide range of engineering problems that involve complex, coupled physical processes interacting across a broad range of spatial and temporal scales. The data structures involved…

Mathematical Software · Computer Science 2018-10-11 Fande Kong , Roy H. Stogner , Derek R. Gaston , John W. Peterson , Cody J. Permann , Andrew E. Slaughter , Richard C. Martineau