English
Related papers

Related papers: Tera-Scale Multilevel Graph Partitioning

200 papers

Hypergraphs have gained increasing attention in the machine learning community lately due to their superiority over graphs in capturing super-dyadic interactions among entities. In this work, we propose a novel approach for the partitioning…

Machine Learning · Computer Science 2020-11-17 Deepak Maurya , Balaraman Ravindran

Graph partition is a key component to achieve workload balance and reduce job completion time in parallel graph processing systems. Among the various partition strategies, edge partition has demonstrated more promising performance in…

Data Structures and Algorithms · Computer Science 2020-12-18 Zhenyu Guo , Mingyu Xiao , Yi Zhou , Dongxiang Zhang , Kian-Lee Tan

Hypergraph partitioning is an important preprocessing step for optimizing data placement and minimizing communication volumes in high-performance computing applications. To cope with ever growing problem sizes, it has become increasingly…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-15 Lars Gottesbüren , Tobias Heuer , Peter Sanders , Sebastian Schlag

In this paper, we develop semi-external and external memory algorithms for graph partitioning and clustering problems. Graph partitioning and clustering are key tools for processing and analyzing large complex networks. We address both…

Data Structures and Algorithms · Computer Science 2014-09-24 Yaroslav Akhremtsev , Peter Sanders , Christian Schulz

Distributed systems that manage and process graph-structured data internally solve a graph partitioning problem to minimize their communication overhead and query run-time. Besides computational complexity -- optimal graph partitioning is…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-24 Ruben Mayer , Hans-Arno Jacobsen

We develop a multilevel algorithm for hypergraph partitioning that contracts the vertices one at a time. Using several caching and lazy-evaluation techniques during coarsening and refinement, we reduce the running time by up to two-orders…

Data Structures and Algorithms · Computer Science 2015-11-11 Sebastian Schlag , Vitali Henne , Tobias Heuer , Henning Meyerhenke , Peter Sanders , Christian Schulz

Distributed computing excels at processing large scale data, but the communication cost for synchronizing the shared parameters may slow down the overall performance. Fortunately, the interactions between parameter and data in many problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-19 Mu Li , Dave G. Andersen , Alexander J. Smola

Motivated by performance optimization of large-scale graph processing systems that distribute the graph across multiple machines, we consider the balanced graph partitioning problem. Compared to the previous work, we study the…

Data Structures and Algorithms · Computer Science 2019-02-19 Dmitrii Avdiukhin , Sergey Pupyrev , Grigory Yaroslavtsev

We present a multi-level graph partitioning algorithm based on the extreme idea to contract only a single edge on each level of the hierarchy. This obviates the need for a matching algorithm and promises very good partitioning quality since…

Data Structures and Algorithms · Computer Science 2010-04-26 Vitaly Osipov , Peter Sanders

Hypergraph partitioning is used in many problem domains including VLSI design, linear algebra, Boolean satisfiability, and data mining. Most versions of this problem are NP-complete or NP-hard, so practical hypergraph partitioners generate…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-29 Sepideh Maleki , Udit Agarwal , Martin Burtscher , Keshav Pingali

Graph partitioning aims to divide a graph into disjoint subsets while optimizing a specific partitioning objective. The majority of formulations related to graph partitioning exhibit NP-hardness due to their combinatorial nature.…

Machine Learning · Computer Science 2024-06-24 Rishi Shah , Krishnanshu Jain , Sahil Manchanda , Sourav Medya , Sayan Ranu

Large-scale parallel numerical simulations are essential for a wide range of engineering problems that involve complex, coupled physical processes interacting across a broad range of spatial and temporal scales. The data structures involved…

Mathematical Software · Computer Science 2018-10-11 Fande Kong , Roy H. Stogner , Derek R. Gaston , John W. Peterson , Cody J. Permann , Andrew E. Slaughter , Richard C. Martineau

Graph edge partitioning is an important preprocessing step to optimize distributed computing jobs on graph-structured data. The edge set of a given graph is split into $k$ equally-sized partitions, such that the replication of vertices…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-25 Ruben Mayer , Kamil Orujzade , Hans-Arno Jacobsen

This paper presents a novel meta algorithm, Partition-Merge (PM), which takes existing centralized algorithms for graph computation and makes them distributed and faster. In a nutshell, PM divides the graph into small subgraphs using our…

Data Structures and Algorithms · Computer Science 2013-09-25 Vincent Blondel , Kyomin Jung , Pushmeet Kohli , Devavrat Shah

The current landscape of balanced graph partitioning is divided into high-quality but expensive multilevel algorithms and cheaper approaches with linear running time, such as single-level algorithms and streaming algorithms. We demonstrate…

Data Structures and Algorithms · Computer Science 2025-04-25 Lars Gottesbüren , Nikolai Maas , Dominik Rosch , Peter Sanders , Daniel Seemaier

Graph Neural Networks (GNNs) are widely used for learning on graph-structured data, but scaling GNN training to massive graphs remains challenging. To enable scalable distributed training, graphs are divided into smaller partitions that are…

Machine Learning · Computer Science 2026-04-02 Nikolai Merkel , Ruben Mayer , Volker Markl , Hans-Arno Jacobsen

We describe an approach to parallel graph partitioning that scales to hundreds of processors and produces a high solution quality. For example, for many instances from Walshaw's benchmark collection we improve the best known partitioning.…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-04-08 Manuel Holtgrewe , Peter Sanders , Christian Schulz

The bipartite graph structure has shown its promising ability in facilitating the subspace clustering and spectral clustering algorithms for large-scale datasets. To avoid the post-processing via k-means during the bipartite graph…

Machine Learning · Computer Science 2023-05-15 Si-Guo Fang , Dong Huang , Chang-Dong Wang , Jian-Huang Lai

We present a multi-level graph partitioning algorithm using novel local improvement algorithms and global search strategies transferred from the multi-grid community. Local improvement algorithms are based max-flow min-cut computations and…

Data Structures and Algorithms · Computer Science 2011-04-05 Peter Sanders , Christian Schulz

Multi-FPGA systems (MFS) are widely adopted for VLSI emulation and rapid prototyping. In an MFS, FPGAs connect only to a limited number of neighbors through bandwidth-constrained links, so inter-FPGA communication cost depends on network…

Hardware Architecture · Computer Science 2026-04-02 Zizhuo Fu , Yifan Zhou , Zhaoxin Lu , Guangyu Sun , Runsheng Wang , Meng Li , Yibo Lin