English
Related papers

Related papers: xDGP: A Dynamic Graph Processing System with Adapt…

200 papers

In recent years, the graph partitioning problem gained importance as a mandatory preprocessing step for distributed graph processing on very large graphs. Existing graph partitioning algorithms minimize partitioning latency by assigning…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-31 Christian Mayer , Ruben Mayer , Muhammad Adnan Tariq , Heiko Geppert , Larissa Laich , Lukas Rieger , Kurt Rothermel

One standard solution for analyzing large natural graphs is to adopt distributed computation on clusters. In distributed computation, graph partitioning (GP) methods assign the vertices or edges of a graph to different machines in a…

Social and Information Networks · Computer Science 2015-11-10 Cong Xie , Wu-Jun Li , Zhihua Zhang

Partitioning a graph into blocks of "roughly equal" weight while cutting only few edges is a fundamental problem in computer science with a wide range of applications. In particular, the problem is a building block in applications that…

Data Structures and Algorithms · Computer Science 2021-05-06 Lars Gottesbüren , Tobias Heuer , Peter Sanders , Christian Schulz , Daniel Seemaier

Recently we create so much data (2.5 quintillion bytes every day) that 90% of the data in the world today has been created in the last two years alone [1]. This data comes from sensors used to gather traffic or climate information, posts to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-20 Afsin Akdogan , Hien To

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

Data Structures and Algorithms · Computer Science 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee

Many well-known, real-world problems involve dynamic data which describe the relationship among the entities. Hypergraphs are powerful combinatorial structures that are frequently used to model such data. For many of today's data-centric…

Data Structures and Algorithms · Computer Science 2021-03-10 Fatih Taşyaran , Berkay Demireller , Kamer Kaya , Bora Uçar

Recently, graph neural networks (GNNs) have gained much attention as a growing area of deep learning capable of learning on graph-structured data. However, the computational and memory requirements for training GNNs on large-scale graphs…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-13 Nikolai Merkel , Daniel Stoll , Ruben Mayer , Hans-Arno Jacobsen

Partitioning graphs into blocks of roughly equal size such that few edges run between blocks is a frequently needed operation in processing graphs. Recently, size, variety, and structural complexity of these networks has grown dramatically.…

Data Structures and Algorithms · Computer Science 2018-10-16 Yaroslav Akhremtsev , Peter Sanders , Christian Schulz

Social Graph Analytics applications are very often built using off-the-shelf analytics frameworks. These, however, are profiled and optimized for the general case and have to perform for all kinds of graphs. This paper investigates how…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-23 Iacovos Kolokasis , Polyvios Pratikakis

With the advent of the big data, graph are processed in an iterative manner, which incrementally described in the form of graph in big data applications. Most currently, graph processing methods treat the underlying map data as black boxes.…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-05 Beibei Si

The in-memory graph layout or organization has a considerable impact on the time and energy efficiency of distributed memory graph computations. It affects memory locality, inter-task load balance, communication time, and overall memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-04 George M Slota , Sivasankaran Rajamanickam , Kamesh Madduri

Current graph systems can easily process billions of data, however when increased to exceed hundred billions, the performance decreases dramatically, time series data always be very huge, consequently computation on time series graphs still…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-25 Derong Tang

Graph is a ubiquitous structure in many domains. The rapidly increasing data volume calls for efficient and scalable graph data processing. In recent years, designing distributed graph processing systems has been an increasingly important…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-03 Xubo Wang , Lu Qin , Lijun Chang , Ying Zhang , Dong Wen , Xuemin Lin

With the advent of social networks and the web, the graph sizes have grown too large to fit in main memory precipitating the need for alternative approaches for an efficient, scalable evaluation of queries on graphs of any size. Here, we…

Databases · Computer Science 2019-05-15 Soumyava Das , Abhishek Santra , Jay Bodra , Sharma Chakravarthy

The increasing scale and wealth of inter-connected data, such as those accrued by social network applications, demand the design of new techniques and platforms to efficiently derive actionable knowledge from large-scale graphs. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-08 Abdullah Gharaibeh , Tahsin Reza , Elizeu Santos-Neto , Lauro Beltrao Costa , Scott Sallinen , Matei Ripeanu

Graph partitioning has long been seen as a viable approach to address Graph DBMS scalability. A partitioning, however, may introduce extra query processing latency unless it is sensitive to a specific query workload, and optimised to…

Databases · Computer Science 2016-06-24 Hugo Firth , Paolo Missier

Directed graphs are widely used to model data flow and execution dependencies in streaming applications. This enables the utilization of graph partitioning algorithms for the problem of parallelizing computation for multiprocessor…

Data Structures and Algorithms · Computer Science 2017-09-26 Orlando Moreira , Merten Popp , Christian Schulz

In the realm of distributed systems tasked with managing and processing large-scale graph-structured data, optimizing graph partitioning stands as a pivotal challenge. The primary goal is to minimize communication overhead and runtime cost.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-29 Zezhong Ding , Yongan Xiang , Shangyou Wang , Xike Xie , S. Kevin Zhou

Partitioning a graph into balanced blocks such that few edges run between blocks is a key problem for large-scale distributed processing. A current trend for partitioning huge graphs are streaming algorithms, which use low computational…

Data Structures and Algorithms · Computer Science 2022-02-02 Marcelo Fonseca Faraj , Christian Schulz

Partitioning an input graph over a set of workers is a complex operation. Objectives are twofold: split the work evenly, so that every worker gets an equal share, and minimize edge cut to achieve a good work locality (i.e. workers can work…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-28 Le Merrer Erwan , Liang Yizhong , Trédan Gilles