English
Related papers

Related papers: Partitioning Trillion-edge Graphs in Minutes

200 papers

We propose a novel perspective on varied-density clustering for high-dimensional data by framing it as a label propagation process in neighborhood graphs that adapt to local density variations. Our method formally connects density-based…

Machine Learning · Computer Science 2025-08-06 Ninh Pham , Yingtao Zheng , Hugo Phibbs

The current landscape of balanced graph partitioning is divided into high-quality but expensive multilevel algorithms and cheaper approaches with linear running time, such as single-level algorithms and streaming algorithms. We demonstrate…

Data Structures and Algorithms · Computer Science 2025-04-25 Lars Gottesbüren , Nikolai Maas , Dominik Rosch , Peter Sanders , Daniel Seemaier

We introduce TeraHAC, a $(1+\epsilon)$-approximate hierarchical agglomerative clustering (HAC) algorithm which scales to trillion-edge graphs. Our algorithm is based on a new approach to computing $(1+\epsilon)$-approximate HAC, which is a…

Data Structures and Algorithms · Computer Science 2024-06-12 Laxman Dhulipala , Jason Lee , Jakub Łącki , Vahab Mirrokni

In the realm of distributed systems tasked with managing and processing large-scale graph-structured data, optimizing graph partitioning stands as a pivotal challenge. The primary goal is to minimize communication overhead and runtime cost.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-29 Zezhong Ding , Yongan Xiang , Shangyou Wang , Xike Xie , S. Kevin Zhou

The benefits of a recently proposed method to approximate hard optimization problems are demonstrated on the graph partitioning problem. The performance of this new method, called Extremal Optimization, is compared to Simulated Annealing in…

Statistical Mechanics · Physics 2009-10-31 S. Boettcher

Distributed computing excels at processing large scale data, but the communication cost for synchronizing the shared parameters may slow down the overall performance. Fortunately, the interactions between parameter and data in many problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-19 Mu Li , Dave G. Andersen , Alexander J. Smola

Natural Language Processing (NLP) provides highly effective tools for interpreting and handling human language, offering a broad spectrum of applications. In this paper, we address a classic combinatorial problem -- finding graph partitions…

Social and Information Networks · Computer Science 2026-03-02 Marco D'Elia , Irene Finocchi , Maurizio Patrignani

Graph partitioning is an important preprocessing step to distributed graph processing. In edge partitioning, the edge set of a given graph is split into $k$ equally-sized partitions, such that the replication of vertices across partitions…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-22 Ruben Mayer , Kamil Orujzade , Hans-Arno Jacobsen

Inspired by the success of Google's Pregel, many systems have been developed recently for iterative computation over big graphs. These systems provide a user-friendly vertex-centric programming interface, where a programmer only needs to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-22 Da Yan , Yuzhen Huang , James Cheng , Huanhuan Wu

Graph signal processing benefits significantly from the direct and highly adaptable supplementary techniques offered by partition of unity methods (PUMs) on graphs. In our approach, we demonstrate the generation of a partition of unity…

Numerical Analysis · Mathematics 2023-11-10 Roberto Cavoretto , Alessandra De Rossi , Sandro Lancellotti , Federico Romaniello

Motivated by performance optimization of large-scale graph processing systems that distribute the graph across multiple machines, we consider the balanced graph partitioning problem. Compared to the previous work, we study the…

Data Structures and Algorithms · Computer Science 2019-02-19 Dmitrii Avdiukhin , Sergey Pupyrev , Grigory Yaroslavtsev

The ability to handle large scale graph data is crucial to an increasing number of applications. Much work has been dedicated to supporting basic graph operations such as subgraph matching, reachability, regular expression matching, etc. In…

Databases · Computer Science 2012-05-31 Zhao Sun , Hongzhi Wang , Haixun Wang , Bin Shao , Jianzhong Li

In GPU graph analytics, the use of external memory such as the host DRAM and solid-state drives is a cost-effective approach to processing large graphs beyond the capacity of the GPU onboard memory. This paper studies the use of Compute…

The in-memory graph layout or organization has a considerable impact on the time and energy efficiency of distributed memory graph computations. It affects memory locality, inter-task load balance, communication time, and overall memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-04 George M Slota , Sivasankaran Rajamanickam , Kamesh Madduri

Interactive image segmentation is a topic of many studies in image processing. In a conventional approach, a user marks some pixels of the object(s) of interest and background, and an algorithm propagates these labels to the rest of the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Fabricio Aparecido Breve

From social networks to language modeling, the growing scale and importance of graph data has driven the development of numerous new graph-parallel systems (e.g., Pregel, GraphLab). By restricting the computation that can be expressed and…

Databases · Computer Science 2014-02-12 Reynold S. Xin , Daniel Crankshaw , Ankur Dave , Joseph E. Gonzalez , Michael J. Franklin , Ion Stoica

We are developing an interactive graph exploration system called Graph Playground for making sense of large graphs. Graph Playground offers a fast and scalable edge decomposition algorithm, based on iterative vertex-edge peeling, to…

Human-Computer Interaction · Computer Science 2018-08-15 James Abello , Fred Hohman , Varun Bezzam , Duen Horng Chau

Finding maximum-weight independent sets in graphs is an important NP-hard optimization problem. Given a vertex-weighted graph $G$, the task is to find a subset of pairwise non-adjacent vertices of $G$ with maximum weight. Most recently…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-16 Jannick Borowitz , Ernestine Großmann , Mattthias Schimek

In this work, we study the problem of partitioning a set of graphs into different groups such that the graphs in the same group are similar while the graphs in different groups are dissimilar. This problem was rarely studied previously,…

Machine Learning · Computer Science 2023-02-07 Jinyu Cai , Yi Han , Wenzhong Guo , Jicong Fan

Analyzing large graph data is an essential part of many modern applications, such as social networks. Due to its large computational complexity, distributed processing is frequently employed. This requires graph data to be divided across…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-12 YoungJoon Park , DongKyu Lee , Tien-Cuong Bui