中文
相关论文

相关论文: TAPER: query-aware, partition-enhancement for larg…

200 篇论文

The increasing scale and wealth of inter-connected data, such as those accrued by social network applications, demand the design of new techniques and platforms to efficiently derive actionable knowledge from large-scale graphs. However,…

分布式、并行与集群计算 · 计算机科学 2014-12-08 Abdullah Gharaibeh , Tahsin Reza , Elizeu Santos-Neto , Lauro Beltrao Costa , Scott Sallinen , Matei Ripeanu

An important objective for analyzing real-world graphs is to achieve scalable performance on large, streaming graphs. A challenging and relevant example is the graph partition problem. As a combinatorial problem, graph partition is NP-hard,…

Graph is a ubiquitous structure in many domains. The rapidly increasing data volume calls for efficient and scalable graph data processing. In recent years, designing distributed graph processing systems has been an increasingly important…

分布式、并行与集群计算 · 计算机科学 2020-03-03 Xubo Wang , Lu Qin , Lijun Chang , Ying Zhang , Dong Wen , Xuemin Lin

The availability of larger and larger graph datasets, growing exponentially over the years, has created several new algorithmic challenges to be addressed. Sequential approaches have become unfeasible, while interest on parallel and…

分布式、并行与集群计算 · 计算机科学 2014-03-26 Alessio Guerrieri , Alberto Montresor

With the advent of the big data, graph are processed in an iterative manner, which incrementally described in the form of graph in big data applications. Most currently, graph processing methods treat the underlying map data as black boxes.…

分布式、并行与集群计算 · 计算机科学 2018-06-05 Beibei Si

The Steiner tree problem aims to determine a minimum edge-weighted tree that spans a given set of terminal vertices from a given graph. In the past decade, a considerable number of algorithms have been developed to solve this…

数据结构与算法 · 计算机科学 2024-08-23 Ming Sun , Xinyu Wu , Yi Zhou , Jin-Kao Hao , Zhang-Hua Fu

Modeling data sharing in GPU programs is a challenging task because of the massive parallelism and complex data sharing patterns provided by GPU architectures. Better GPU caching efficiency can be achieved through careful task scheduling…

分布式、并行与集群计算 · 计算机科学 2016-10-04 Lingda Li , Ari B. Hayes , Stephen A. Hackler , Eddy Z. Zhang , Mario Szegedy , Shuaiwen Leon Song

Hypergraph partitioning is an important preprocessing step for optimizing data placement and minimizing communication volumes in high-performance computing applications. To cope with ever growing problem sizes, it has become increasingly…

分布式、并行与集群计算 · 计算机科学 2020-12-15 Lars Gottesbüren , Tobias Heuer , Peter Sanders , Sebastian Schlag

The current landscape of balanced graph partitioning is divided into high-quality but expensive multilevel algorithms and cheaper approaches with linear running time, such as single-level algorithms and streaming algorithms. We demonstrate…

数据结构与算法 · 计算机科学 2025-04-25 Lars Gottesbüren , Nikolai Maas , Dominik Rosch , Peter Sanders , Daniel Seemaier

This paper considers the problem of resource allocation in stream processing, where continuous data flows must be processed in real time in a large distributed system. To maximize system throughput, the resource allocation strategy that…

机器学习 · 计算机科学 2019-11-21 Xiang Ni , Jing Li , Mo Yu , Wang Zhou , Kun-Lung Wu

We develop a multilevel algorithm for hypergraph partitioning that contracts the vertices one at a time. Using several caching and lazy-evaluation techniques during coarsening and refinement, we reduce the running time by up to two-orders…

数据结构与算法 · 计算机科学 2015-11-11 Sebastian Schlag , Vitali Henne , Tobias Heuer , Henning Meyerhenke , Peter Sanders , Christian Schulz

In recent years, the graph partitioning problem gained importance as a mandatory preprocessing step for distributed graph processing on very large graphs. Existing graph partitioning algorithms minimize partitioning latency by assigning…

分布式、并行与集群计算 · 计算机科学 2018-05-31 Christian Mayer , Ruben Mayer , Muhammad Adnan Tariq , Heiko Geppert , Larissa Laich , Lukas Rieger , Kurt Rothermel

TAPS is a Topology-Aware intra-operator Parallelism strategy Searching algorithm that generates intra-operator parallelism strategies by considering both intra-node and inter-node bandwidth. Most of the existing auto-parallelism works use…

分布式、并行与集群计算 · 计算机科学 2023-01-12 Peng Liang , Hao Zheng , Teng Su , Linbo Qiao , Dongsheng Li

Many well-known, real-world problems involve dynamic data which describe the relationship among the entities. Hypergraphs are powerful combinatorial structures that are frequently used to model such data. For many of today's data-centric…

数据结构与算法 · 计算机科学 2021-03-10 Fatih Taşyaran , Berkay Demireller , Kamer Kaya , Bora Uçar

Balanced graph partitioning is a critical step for many large-scale distributed computations with relational data. As graph datasets have grown in size and density, a range of highly-scalable balanced partitioning algorithms have appeared…

社会与信息网络 · 计算机科学 2020-07-08 Amel Awadelkarim , Johan Ugander

Myriad of graph-based algorithms in machine learning and data mining require parsing relational data iteratively. These algorithms are implemented in a large-scale distributed environment in order to scale to massive data sets. To…

分布式、并行与集群计算 · 计算机科学 2017-10-17 Yanfeng Zhang , Qixin Gao , Lixin Gao , Cuirong Wang

Large-scale parallel numerical simulations are essential for a wide range of engineering problems that involve complex, coupled physical processes interacting across a broad range of spatial and temporal scales. The data structures involved…

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

数据结构与算法 · 计算机科学 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee

State-of-the-art data flow systems such as TensorFlow impose iterative calculations on large graphs that need to be partitioned on heterogeneous devices such as CPUs, GPUs, and TPUs. However, partitioning can not be viewed in isolation.…

分布式、并行与集群计算 · 计算机科学 2017-11-07 Ruben Mayer , Christian Mayer , Larissa Laich

Graph partitioning is an important preprocessing step to distributed graph processing. In edge partitioning, the edge set of a given graph is split into $k$ equally-sized partitions, such that the replication of vertices across partitions…

分布式、并行与集群计算 · 计算机科学 2020-01-22 Ruben Mayer , Kamil Orujzade , Hans-Arno Jacobsen