English
Related papers

Related papers: Partitioning Graphs for the Cloud using Reinforcem…

200 papers

Graph partitioning plays a vital role in distributedlarge-scale web graph analytics, such as pagerank and labelpropagation. The quality and scalability of partitioning strategyhave a strong impact on such communication- and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-04 Deyu Kong , Xike Xie , Zhuoxu Zhang

Many real-world systems, such as social networks, rely on mining efficiently large graphs, with hundreds of millions of vertices and edges. This volume of information requires partitioning the graph across multiple nodes in a distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-09-11 Luis Vaquero , Felix Cuadrado , Dionysios Logothetis , Claudio Martella

The availability of larger and larger graph datasets, growing exponentially over the years, has created several new algorithmic challenges to be addressed. Sequential approaches have become unfeasible, while interest on parallel and…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-26 Alessio Guerrieri , Alberto Montresor

Time-evolving large graph has received attention due to their participation in real-world applications such as social networks and PageRank calculation. It is necessary to partition a large-scale dynamic graph in a streaming manner to…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-01 Md Anwarul Kaium Patwary , Saurabh Garg , Sudheer Kumar Battula , Byeong Kang

In the realm of distributed systems tasked with managing and processing large-scale graph-structured data, optimizing graph partitioning stands as a pivotal challenge. The primary goal is to minimize communication overhead and runtime cost.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-29 Zezhong Ding , Yongan Xiang , Shangyou Wang , Xike Xie , S. Kevin Zhou

Graph embedding aims at learning a vector-based representation of vertices that incorporates the structure of the graph. This representation then enables inference of graph properties. Existing graph embedding techniques, however, do not…

The most commonly used method to tackle the graph partitioning problem in practice is the multilevel approach. During a coarsening phase, a multilevel graph partitioning algorithm reduces the graph size by iteratively contracting nodes and…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-26 Henning Meyerhenke , Peter Sanders , Christian Schulz

We propose a new algorithm for finding the center of a graph, as well as the rank of each node in the hierarchy of distances to the center. In other words, our algorithm allows to partition the graph according to nodes distance to the…

Data Structures and Algorithms · Computer Science 2019-10-08 Frédéric Protin

Graph partitioning is the problem of dividing the nodes of a graph into balanced partitions while minimizing the edge cut across the partitions. Due to its combinatorial nature, many approximate solutions have been developed, including…

Machine Learning · Computer Science 2019-03-05 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

Balanced partitioning is often a crucial first step in solving large-scale graph optimization problems, e.g., in some cases, a big graph can be chopped into pieces that fit on one machine to be processed independently before stitching the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-10 Kevin Aydin , MohammadHossein Bateni , Vahab Mirrokni

Graph Partitioning is widely used in many real-world applications such as fraud detection and social network analysis, in order to enable the distributed graph computing on large graphs. However, existing works fail to balance the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-07 Li Zeng , Haohan Huang , Binfan Zheng , Kang Yang , Shengcheng Shao , Jinhua Zhou , Jun Xie , Rongqian Zhao , Xin Chen

Partitioning a graph into blocks of roughly equal weight while cutting only few edges is a fundamental problem in computer science with numerous practical applications. While shared-memory parallel partitioners have recently matured to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-06 Peter Sanders , Daniel Seemaier

Convolutional graph networks are used in particle physics for effective event reconstructions and classifications. However, their performances can be limited by the considerable amount of sensors used in modern particle detectors if applied…

High Energy Physics - Experiment · Physics 2022-10-10 M. Bachlechner , T. Birkenfeld , P. Soldin , A. Stahl , C. Wiebusch

This paper considers the problem of resource allocation in stream processing, where continuous data flows must be processed in real time in a large distributed system. To maximize system throughput, the resource allocation strategy that…

Machine Learning · Computer Science 2019-11-21 Xiang Ni , Jing Li , Mo Yu , Wang Zhou , Kun-Lung Wu

Graph partitioning has long been seen as a viable approach to address Graph DBMS scalability. A partitioning, however, may introduce extra query processing latency unless it is sensitive to a specific query workload, and optimised to…

Databases · Computer Science 2016-06-24 Hugo Firth , Paolo Missier

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

Data Structures and Algorithms · Computer Science 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee

The modeling flexibility provided by hypergraphs has drawn a lot of interest from the combinatorial scientific community, leading to novel models and algorithms, their applications, and development of associated tools. Hypergraphs are now a…

Data Structures and Algorithms · Computer Science 2015-03-19 Enver Kayaaslan , Ali Pinar , Umit V. Catalyurek , Cevdet Aykanat

The multilevel heuristic is the dominant strategy for high-quality sequential and parallel graph partitioning. Partition refinement is a key step of multilevel graph partitioning. In this work, we present Jet, a new parallel algorithm for…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-09 Michael S. Gilbert , Kamesh Madduri , Erik G. Boman , Sivasankaran Rajamanickam

This paper presents a novel meta algorithm, Partition-Merge (PM), which takes existing centralized algorithms for graph computation and makes them distributed and faster. In a nutshell, PM divides the graph into small subgraphs using our…

Data Structures and Algorithms · Computer Science 2013-09-25 Vincent Blondel , Kyomin Jung , Pushmeet Kohli , Devavrat Shah

Balanced graph partitioning is a critical step for many large-scale distributed computations with relational data. As graph datasets have grown in size and density, a range of highly-scalable balanced partitioning algorithms have appeared…

Social and Information Networks · Computer Science 2020-07-08 Amel Awadelkarim , Johan Ugander