English
Related papers

Related papers: Distributed Edge Partitioning for Trillion-edge Gr…

200 papers

In the realm of distributed systems tasked with managing and processing large-scale graph-structured data, optimizing graph partitioning stands as a pivotal challenge. The primary goal is to minimize communication overhead and runtime cost.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-29 Zezhong Ding , Yongan Xiang , Shangyou Wang , Xike Xie , S. Kevin Zhou

We present a multi-level graph partitioning algorithm using novel local improvement algorithms and global search strategies transferred from the multi-grid community. Local improvement algorithms are based max-flow min-cut computations and…

Data Structures and Algorithms · Computer Science 2011-04-05 Peter Sanders , Christian Schulz

Efficient layout of large-scale graphs remains a challenging problem: the force-directed and dimensionality reduction-based methods suffer from high overhead for graph distance and gradient computation. In this paper, we present a new graph…

Social and Information Networks · Computer Science 2020-08-19 Minfeng Zhu , Wei Chen , Yuanzhe Hu , Yuxuan Hou , Liangjun Liu , Kaiyuan Zhang

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

Data Structures and Algorithms · Computer Science 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee

Many state-of-the-art Deep Neural Networks (DNNs) have substantial memory requirements. Limited device memory becomes a bottleneck when training those models. We propose ParDNN, an automatic, generic, and non-intrusive partitioning strategy…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-06 Fareed Qararyah , Mohamed Wahib , Doğa Dikbayır , Mehmet Esat Belviranli , Didem Unat

We present a graph bisection and partitioning algorithm based on graph neural networks. For each node in the graph, the network outputs probabilities for each of the partitions. The graph neural network consists of two modules: an embedding…

Machine Learning · Computer Science 2021-12-09 Alice Gatti , Zhixiong Hu , Tess Smidt , Esmond G. Ng , Pieter Ghysels

We describe a computationally efficient, stochastic graph-regularization technique that can be utilized for the semi-supervised training of deep neural networks in a parallel or distributed setting. We utilize a technique, first described…

Machine Learning · Statistics 2018-05-31 Sunil Thulasidasan , Jeffrey Bilmes , Garrett Kenyon

For time-critical IoT applications using deep learning, inference acceleration through distributed computing is a promising approach to meet a stringent deadline. In this paper, we implement a working prototype of a new distributed…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhongtian Dong , Nan Li , Alexandros Iosifidis , Qi Zhang

Graph neural networks (GNNs) have been demonstrated as a powerful tool for analyzing non-Euclidean graph data. However, the lack of efficient distributed graph learning systems severely hinders applications of GNNs, especially when graphs…

Machine Learning · Computer Science 2023-01-18 Yongchao Liu , Houyi Li , Guowei Zhang , Xintan Zeng , Yongyong Li , Bin Huang , Peng Zhang , Zhao Li , Xiaowei Zhu , Changhua He , Wenguang Chen

Given an edge-weighted graph and a set of known seed vertices, a network scientist often desires to understand the graph relationships to explain connections between the seed vertices. When the seed set is 3 or larger Steiner minimal tree -…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-31 Tahsin Reza , Geoffrey Sanders , Roger Pearce

The degree splitting problem requires coloring the edges of a graph red or blue such that each node has almost the same number of edges in each color, up to a small additive discrepancy. The directed variant of the problem requires…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-24 Mohsen Ghaffari , Juho Hirvonen , Fabian Kuhn , Yannic Maus , Jukka Suomela , Jara Uitto

We present shared-memory parallel methods for Maximal Clique Enumeration (MCE) from a graph. MCE is a fundamental and well-studied graph analytics task, and is a widely used primitive for identifying dense structures in a graph. Due to its…

Data Structures and Algorithms · Computer Science 2020-01-30 Apurba Das , Seyed-Vahid Sanei-Mehri , Srikanta Tirthapura

Graph processing systems are important in the big data domain. However, processing graphs in parallel often introduces redundant computations in existing algorithms and models. Prior work has proposed techniques to optimize redundancies for…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-01 Shuang Song , Xu Liu , Qinzhe Wu , Andreas Gerstlauer , Tao Li , Lizy K. John

In recent years, Graph Convolutional Networks (GCNs) have achieved great success in learning from graph-structured data. With the growing tendency of graph nodes and edges, GCN training by single processor cannot meet the demand for time…

Machine Learning · Computer Science 2021-10-08 Taige Zhao , Xiangyu Song , Jianxin Li , Wei Luo , Imran Razzak

Two kinds of approximation algorithms exist for the k-BALANCED PARTITIONING problem: those that are fast but compute unsatisfying approximation ratios, and those that guarantee high quality ratios but are slow. In this paper we prove that…

Computational Complexity · Computer Science 2019-04-29 Andreas Emil Feldmann

Deep neural network (DNN) partition is a research problem that involves splitting a DNN into multiple parts and offloading them to specific locations. Because of the recent advancement in multi-access edge computing and edge intelligence,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-21 Di Xu , Xiang He , Tonghua Su , Zhongjie Wang

We study distributed training of Graph Neural Networks (GNNs) on billion-scale graphs that are partitioned across machines. Efficient training in this setting relies on min-edge-cut partitioning algorithms, which minimize cross-machine…

The multilevel heuristic is the dominant strategy for high-quality sequential and parallel graph partitioning. Partition refinement is a key step of multilevel graph partitioning. In this work, we present Jet, a new parallel algorithm for…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-09 Michael S. Gilbert , Kamesh Madduri , Erik G. Boman , Sivasankaran Rajamanickam

We study stochastic graph optimization problems in a novel distributed setting. As in the standard centralized setting, a random subgraph $G^*$ of a known base graph $G$ is realized by including each edge $e$ independently with a known…

Data Structures and Algorithms · Computer Science 2026-05-21 Keren Censor-Hillel , Aditi Dudeja , George Giakkoupis

A topological graph is a graph drawn in the plane. A topological graph is $k$-plane, $k>0$, if each edge is crossed at most $k$ times. We study the problem of partitioning the edges of a $k$-plane graph such that each partite set forms a…