中文
相关论文

相关论文: S-PowerGraph: Streaming Graph Partitioning for Nat…

200 篇论文

Graph partitioning (GP) is a classic problem that divides the node set of a graph into densely-connected blocks. Following the IEEE HPEC Graph Challenge and recent advances in pre-training techniques (e.g., large-language models), we…

机器学习 · 计算机科学 2024-09-04 Meng Qin , Chaorui Zhang , Yu Gao , Yibin Ding , Weipeng Jiang , Weixi Zhang , Wei Han , Bo Bai

Graph partition is a key component to achieve workload balance and reduce job completion time in parallel graph processing systems. Among the various partition strategies, edge partition has demonstrated more promising performance in…

数据结构与算法 · 计算机科学 2020-12-18 Zhenyu Guo , Mingyu Xiao , Yi Zhou , Dongxiang Zhang , Kian-Lee Tan

Analyzing large graph data is an essential part of many modern applications, such as social networks. Due to its large computational complexity, distributed processing is frequently employed. This requires graph data to be divided across…

分布式、并行与集群计算 · 计算机科学 2022-09-12 YoungJoon Park , DongKyu Lee , Tien-Cuong Bui

We present a novel method for graph partitioning, based on reinforcement learning and graph convolutional neural networks. Our approach is to recursively partition coarser representations of a given graph. The neural network is implemented…

机器学习 · 计算机科学 2021-06-30 Alice Gatti , Zhixiong Hu , Tess Smidt , Esmond G. Ng , Pieter Ghysels

In this paper we study the problem of designing a distributed graph visualization algorithm for large graphs. The algorithm must be simple to implement and the computing infrastructure must not require major hardware or software…

数据结构与算法 · 计算机科学 2016-06-08 Alessio Arleo , Walter Didimo , Giuseppe Liotta , Fabrizio Montecchiani

Many well-known, real-world problems involve dynamic data which describe the relationship among the entities. Hypergraphs are powerful combinatorial structures that are frequently used to model such data. For many of today's data-centric…

数据结构与算法 · 计算机科学 2021-03-10 Fatih Taşyaran , Berkay Demireller , Kamer Kaya , Bora Uçar

Graph partitioning (GP) and vertex connectivity have traditionally been two distinct fields of study. This paper introduces the highly connected graph partitioning (HCGP) problem, which partitions a graph into compact, size balanced, and…

离散数学 · 计算机科学 2024-06-13 Rahul Swamy , Douglas M. King , Sheldon H. Jacobson

We propose Distributed Neighbor Expansion (Distributed NE), a parallel and distributed graph partitioning method that can scale to trillion-edge graphs while providing high partitioning quality. Distributed NE is based on a new heuristic,…

分布式、并行与集群计算 · 计算机科学 2019-09-24 Masatoshi Hanai , Toyotaro Suzumura , Wen Jun Tan , Elvis Liu , Georgios Theodoropoulos , Wentong Cai

Graph partitioning (GP), a.k.a. community detection, is a classic problem that divides the node set of a graph into densely-connected blocks. Following prior work on the IEEE HPEC Graph Challenge benchmark and recent advances in graph…

社会与信息网络 · 计算机科学 2023-12-05 Yu Gao , Meng Qin , Yibin Ding , Li Zeng , Chaorui Zhang , Weixi Zhang , Wei Han , Rongqian Zhao , Bo Bai

Partitioning graphs into blocks of roughly equal size is widely used when processing large graphs. Currently there is a gap in the space of available partitioning algorithms. On the one hand, there are streaming algorithms that have been…

数据结构与算法 · 计算机科学 2021-12-23 Marcelo Fonseca Faraj , Christian Schulz

A popular method of force-directed graph drawing is multidimensional scaling using graph-theoretic distances as input. We present an algorithm to minimize its energy function, known as stress, by using stochastic gradient descent (SGD) to…

计算几何 · 计算机科学 2018-06-29 Jonathan X. Zheng , Samraat Pawar , Dan F. M. Goodman

(Hyper)Graph decomposition is a family of problems that aim to break down large (hyper)graphs into smaller sub(hyper)graphs for easier analysis. The importance of this lies in its ability to enable efficient computation on large and complex…

数据结构与算法 · 计算机科学 2023-08-31 Marcelo Fonseca Faraj

Graph edge partitioning is an important preprocessing step to optimize distributed computing jobs on graph-structured data. The edge set of a given graph is split into $k$ equally-sized partitions, such that the replication of vertices…

分布式、并行与集群计算 · 计算机科学 2022-03-25 Ruben Mayer , Kamil Orujzade , Hans-Arno Jacobsen

Partitioning graphs into blocks of roughly equal size such that few edges run between blocks is a frequently needed operation in processing graphs. Recently, size, variety, and structural complexity of these networks has grown dramatically.…

数据结构与算法 · 计算机科学 2018-10-16 Yaroslav Akhremtsev , Peter Sanders , Christian Schulz

Graph-cuts are widely used in computer vision. In order to speed up the optimization process and improve the scalability for large graphs, Strandmark and Kahl introduced a splitting method to split a graph into multiple subgraphs for…

数据结构与算法 · 计算机科学 2016-11-03 Miao Yu , Shuhan Shen , Zhanyi Hu

There has been a recent explosion in the size of stored data, partially due to advances in storage technology, and partially due to the growing popularity of cloud-computing and the vast quantities of data generated. This motivates the need…

数据结构与算法 · 计算机科学 2012-12-06 Isabelle Stanton

Processing large complex networks like social networks or web graphs has recently attracted considerable interest. In order to do this in parallel, we need to partition them into pieces of about equal size. Unfortunately, previous parallel…

分布式、并行与集群计算 · 计算机科学 2015-01-27 Henning Meyerhenke , Peter Sanders , Christian Schulz

Graph partitioning aims to divide a graph into disjoint subsets while optimizing a specific partitioning objective. The majority of formulations related to graph partitioning exhibit NP-hardness due to their combinatorial nature.…

机器学习 · 计算机科学 2024-06-24 Rishi Shah , Krishnanshu Jain , Sahil Manchanda , Sourav Medya , Sayan Ranu

Distributed systems that manage and process graph-structured data internally solve a graph partitioning problem to minimize their communication overhead and query run-time. Besides computational complexity -- optimal graph partitioning is…

分布式、并行与集群计算 · 计算机科学 2021-03-24 Ruben Mayer , Hans-Arno Jacobsen

Large-scale distributed graph-parallel computing is challenging. On one hand, due to the irregular computation pattern and lack of locality, it is hard to express parallelism efficiently. On the other hand, due to the scale-free nature,…

分布式、并行与集群计算 · 计算机科学 2013-10-22 Jie Yan , Guangming Tan , Ninghui Sun