中文
相关论文

相关论文: PartitionedVC: Partitioned External Memory Graph A…

200 篇论文

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

机器学习 · 计算机科学 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

For distributed graph processing on massive graphs, a graph is partitioned into multiple equally-sized parts which are distributed among machines in a compute cluster. In the last decade, many partitioning algorithms have been developed…

分布式、并行与集群计算 · 计算机科学 2023-04-12 Nikolai Merkel , Ruben Mayer , Tawkir Ahmed Fakir , Hans-Arno Jacobsen

Graph edge partitioning is an important preprocessing step to optimize distributed computing jobs on graph-structured data. The edge set of a given graph is split into $k$ equally-sized partitions, such that the replication of vertices…

分布式、并行与集群计算 · 计算机科学 2022-03-25 Ruben Mayer , Kamil Orujzade , Hans-Arno Jacobsen

Many real-world systems, such as social networks, rely on mining efficiently large graphs, with hundreds of millions of vertices and edges. This volume of information requires partitioning the graph across multiple nodes in a distributed…

分布式、并行与集群计算 · 计算机科学 2013-09-11 Luis Vaquero , Felix Cuadrado , Dionysios Logothetis , Claudio Martella

Distributed graph platforms like Pregel have used vertex- centric programming models to process the growing corpus of graph datasets using commodity clusters. The irregular structure of graphs cause load imbalances across machines operating…

分布式、并行与集群计算 · 计算机科学 2019-05-13 Ravikant Dindokar , Yogesh Simmhan

Processing large-scale graphs, containing billions of entities, is critical across fields like bioinformatics, high-performance computing, navigation and route planning, among others. Efficient graph partitioning, which divides a graph into…

数据结构与算法 · 计算机科学 2024-10-11 Adil Chhabra , Florian Kurpicz , Christian Schulz , Dominik Schweisgut , Daniel Seemaier

Partitioning graphs into blocks of roughly equal size is widely used when processing large graphs. Currently there is a gap in the space of available partitioning algorithms. On the one hand, there are streaming algorithms that have been…

数据结构与算法 · 计算机科学 2021-12-23 Marcelo Fonseca Faraj , Christian Schulz

Motivated by performance optimization of large-scale graph processing systems that distribute the graph across multiple machines, we consider the balanced graph partitioning problem. Compared to the previous work, we study the…

数据结构与算法 · 计算机科学 2019-02-19 Dmitrii Avdiukhin , Sergey Pupyrev , Grigory Yaroslavtsev

Analyzing large graph data is an essential part of many modern applications, such as social networks. Due to its large computational complexity, distributed processing is frequently employed. This requires graph data to be divided across…

分布式、并行与集群计算 · 计算机科学 2022-09-12 YoungJoon Park , DongKyu Lee , Tien-Cuong Bui

Runtime characteristics of sparse matrix computations and related processes may be often improved by reducing memory footprints of involved matrices. Such a reduction can be usually achieved when matrices are processed in a block-wise…

数值分析 · 计算机科学 2018-01-01 Daniel Langr

Graph neural networks (GNNs) have emerged as a powerful tool to process graph-based data in fields like communication networks, molecular interactions, chemistry, social networks, and neuroscience. GNNs are characterized by the ultra-sparse…

硬件体系结构 · 计算机科学 2023-07-14 Nanda K. Unnikrishnan , Joe Gould , Keshab K. Parhi

Graph processing systems are essential for analyzing large-scale data with complex relationships, yet most existing frameworks rely on statically provisioned clusters, resulting in poor elasticity and inefficient resource utilization under…

分布式、并行与集群计算 · 计算机科学 2026-05-13 Chen Zhao , Parsa Poorsistani , Mohammad Goudarzi , Tawfiq Islam , Adel N. Toosi

With the advent of social networks and the web, the graph sizes have grown too large to fit in main memory precipitating the need for alternative approaches for an efficient, scalable evaluation of queries on graphs of any size. Here, we…

数据库 · 计算机科学 2019-05-15 Soumyava Das , Abhishek Santra , Jay Bodra , Sharma Chakravarthy

Inspired by the success of Google's Pregel, many systems have been developed recently for iterative computation over big graphs. These systems provide a user-friendly vertex-centric programming interface, where a programmer only needs to…

分布式、并行与集群计算 · 计算机科学 2016-01-22 Da Yan , Yuzhen Huang , James Cheng , Huanhuan Wu

Vectorization and GPUs will profoundly change graph processing. Traditional graph algorithms tuned for 32- or 64-bit based memory accesses will be inefficient on architectures with 512-bit wide (or larger) instruction units that are already…

分布式、并行与集群计算 · 计算机科学 2020-10-23 Maciej Besta , Florian Marending , Edgar Solomonik , Torsten Hoefler

Graph construction from a given set of edges is a data-intensive operator that appears in social network analysis, ontology enabled databases, and, other analytics processing. The operator represents an edge list to compressed sparse row…

数据库 · 计算机科学 2012-11-01 Sandeep Gupta

The subgraph-centric programming model is a promising approach and has been applied in many state-of-the-art distributed graph computing frameworks. However, traditional graph partition algorithms have significant difficulties in processing…

分布式、并行与集群计算 · 计算机科学 2021-07-08 Shuai Zhang , Zite Jiang , Xingzhong Hou , Zhen Guan , Mengting Yuan , Haihang You

The dynamic scaling of distributed computations plays an important role in the utilization of elastic computational resources, such as the cloud. It enables the provisioning and de-provisioning of resources to match dynamic resource…

分布式、并行与集群计算 · 计算机科学 2021-01-19 Masatoshi Hanai , Nikos Tziritas , Toyotaro Suzumura , Wentong Cai , Georgios Theodoropoulos

Iterative graph algorithms often compute intermediate values and update them as computation progresses. Updated output values are used as inputs for computations in current or subsequent iterations; hence the number of iterations required…

分布式、并行与集群计算 · 计算机科学 2021-10-05 Mark P. Blanco , Scott McMillan , Tze Meng Low

How can we analyze enormous networks including the Web and social networks which have hundreds of billions of nodes and edges? Network analyses have been conducted by various graph mining methods including shortest path computation,…

分布式、并行与集群计算 · 计算机科学 2017-09-27 Chiwan Park , Ha-Myung Park , Minji Yoon , U Kang