中文
相关论文

相关论文: ADWISE: Adaptive Window-based Streaming Edge Parti…

200 篇论文

Processing large-scale graphs, containing billions of entities, is critical across fields like bioinformatics, high-performance computing, navigation and route planning, among others. Efficient graph partitioning, which divides a graph into…

数据结构与算法 · 计算机科学 2024-10-11 Adil Chhabra , Florian Kurpicz , Christian Schulz , Dominik Schweisgut , Daniel Seemaier

As with general graph processing systems, partitioning data over a cluster of machines improves the scalability of graph database management systems. However, these systems will incur additional network cost during the execution of a query…

数据库 · 计算机科学 2017-11-20 Hugo Firth , Paolo Missier , Jack Aiston

Time-evolving large graph has received attention due to their participation in real-world applications such as social networks and PageRank calculation. It is necessary to partition a large-scale dynamic graph in a streaming manner to…

分布式、并行与集群计算 · 计算机科学 2021-11-01 Md Anwarul Kaium Patwary , Saurabh Garg , Sudheer Kumar Battula , Byeong Kang

Partitioning the vertices of a (hyper)graph into k roughly balanced blocks such that few (hyper)edges run between blocks is a key problem for large-scale distributed processing. A current trend for partitioning huge (hyper)graphs using low…

数据结构与算法 · 计算机科学 2023-02-14 Kamal Eyubov , Marcelo Fonseca Faraj , Christian Schulz

The most commonly used method to tackle the graph partitioning problem in practice is the multilevel approach. During a coarsening phase, a multilevel graph partitioning algorithm reduces the graph size by iteratively contracting nodes and…

分布式、并行与集群计算 · 计算机科学 2014-03-26 Henning Meyerhenke , Peter Sanders , Christian Schulz

In the realm of distributed systems tasked with managing and processing large-scale graph-structured data, optimizing graph partitioning stands as a pivotal challenge. The primary goal is to minimize communication overhead and runtime cost.…

分布式、并行与集群计算 · 计算机科学 2024-02-29 Zezhong Ding , Yongan Xiang , Shangyou Wang , Xike Xie , S. Kevin Zhou

Processing large complex networks like social networks or web graphs has recently attracted considerable interest. In order to do this in parallel, we need to partition them into pieces of about equal size. Unfortunately, previous parallel…

分布式、并行与集群计算 · 计算机科学 2015-01-27 Henning Meyerhenke , Peter Sanders , Christian Schulz

Graph partitioning plays a pivotal role in various distributed graph processing applications, including graph analytics, graph neural network training, and distributed graph databases. Graphs that require distributed settings are often too…

数据库 · 计算机科学 2024-12-11 Milad Rezaei Hajidehi , Sraavan Sridhar , Margo Seltzer

An important objective for analyzing real-world graphs is to achieve scalable performance on large, streaming graphs. A challenging and relevant example is the graph partition problem. As a combinatorial problem, graph partition is NP-hard,…

Partitioning an input graph over a set of workers is a complex operation. Objectives are twofold: split the work evenly, so that every worker gets an equal share, and minimize edge cut to achieve a good work locality (i.e. workers can work…

分布式、并行与集群计算 · 计算机科学 2013-11-28 Le Merrer Erwan , Liang Yizhong , Trédan Gilles

Graph partitioning plays a vital role in distributedlarge-scale web graph analytics, such as pagerank and labelpropagation. The quality and scalability of partitioning strategyhave a strong impact on such communication- and…

分布式、并行与集群计算 · 计算机科学 2022-01-04 Deyu Kong , Xike Xie , Zhuoxu Zhang

Balanced partitioning is often a crucial first step in solving large-scale graph optimization problems, e.g., in some cases, a big graph can be chopped into pieces that fit on one machine to be processed independently before stitching the…

分布式、并行与集群计算 · 计算机科学 2015-12-10 Kevin Aydin , MohammadHossein Bateni , Vahab Mirrokni

We propose Distributed Neighbor Expansion (Distributed NE), a parallel and distributed graph partitioning method that can scale to trillion-edge graphs while providing high partitioning quality. Distributed NE is based on a new heuristic,…

分布式、并行与集群计算 · 计算机科学 2019-09-24 Masatoshi Hanai , Toyotaro Suzumura , Wen Jun Tan , Elvis Liu , Georgios Theodoropoulos , Wentong Cai

We introduce a novel algorithm to perform graph clustering in the edge streaming setting. In this model, the graph is presented as a sequence of edges that can be processed strictly once. Our streaming algorithm has an extremely low memory…

机器学习 · 计算机科学 2017-12-13 Alexandre Hollocou , Julien Maudet , Thomas Bonald , Marc Lelarge

Graph partitioning has long been seen as a viable approach to address Graph DBMS scalability. A partitioning, however, may introduce extra query processing latency unless it is sensitive to a specific query workload, and optimised to…

数据库 · 计算机科学 2016-06-24 Hugo Firth , Paolo Missier

Partitioning a graph into blocks of "roughly equal" weight while cutting only few edges is a fundamental problem in computer science with a wide range of applications. In particular, the problem is a building block in applications that…

数据结构与算法 · 计算机科学 2021-05-06 Lars Gottesbüren , Tobias Heuer , Peter Sanders , Christian Schulz , Daniel Seemaier

We study index-based processing for connectivity queries within sliding windows on streaming graphs. These queries, which determine whether two vertices belong to the same connected component, are fundamental operations in real-time graph…

数据库 · 计算机科学 2024-06-14 Chao Zhang , Angela Bonifati , M. Tamer Özsu

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

数据结构与算法 · 计算机科学 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee

The current landscape of balanced graph partitioning is divided into high-quality but expensive multilevel algorithms and cheaper approaches with linear running time, such as single-level algorithms and streaming algorithms. We demonstrate…

数据结构与算法 · 计算机科学 2025-04-25 Lars Gottesbüren , Nikolai Maas , Dominik Rosch , Peter Sanders , Daniel Seemaier

Balanced graph partitioning is a critical step for many large-scale distributed computations with relational data. As graph datasets have grown in size and density, a range of highly-scalable balanced partitioning algorithms have appeared…

社会与信息网络 · 计算机科学 2020-07-08 Amel Awadelkarim , Johan Ugander