English
Related papers

Related papers: BuffCut: Prioritized Buffered Streaming Graph Part…

200 papers

We explore the use of local algorithms in the design of streaming algorithms for the Maximum Directed Cut problem. Specifically, building on the local algorithm of Buchbinder et al. (FOCS'12) and Censor-Hillel et al. (ALGOSENSORS'17), we…

Data Structures and Algorithms · Computer Science 2024-12-02 Raghuvansh R. Saxena , Noah G. Singer , Madhu Sudan , Santhoshini Velusamy

Graph partitioning aims to divide a graph into disjoint subsets while optimizing a specific partitioning objective. The majority of formulations related to graph partitioning exhibit NP-hardness due to their combinatorial nature.…

Machine Learning · Computer Science 2024-06-24 Rishi Shah , Krishnanshu Jain , Sahil Manchanda , Sourav Medya , Sayan Ranu

An important objective for analyzing real-world graphs is to achieve scalable performance on large, streaming graphs. A challenging and relevant example is the graph partition problem. As a combinatorial problem, graph partition is NP-hard,…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-10 Edward Kao , Vijay Gadepally , Michael Hurley , Michael Jones , Jeremy Kepner , Sanjeev Mohindra , Paul Monticciolo , Albert Reuther , Siddharth Samsi , William Song , Diane Staheli , Steven Smith

We present CluStRE, a novel streaming graph clustering algorithm that balances computational efficiency with high-quality clustering using multi-stage refinement. Unlike traditional in-memory clustering approaches, CluStRE processes graphs…

Machine Learning · Computer Science 2025-02-12 Adil Chhabra , Shai Dorian Peretz , Christian Schulz

Given a stream of heterogeneous graphs containing different types of nodes and edges, how can we spot anomalous ones in real-time while consuming bounded memory? This problem is motivated by and generalizes from its application in security…

Social and Information Networks · Computer Science 2016-02-23 Emaad A. Manzoor , Sadegh Momeni , Venkat N. Venkatakrishnan , Leman Akoglu

Graph edge partitioning is an important preprocessing step to optimize distributed computing jobs on graph-structured data. The edge set of a given graph is split into $k$ equally-sized partitions, such that the replication of vertices…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-25 Ruben Mayer , Kamil Orujzade , Hans-Arno Jacobsen

Packet classification is a vital and complicated task as the processing of packets should be done at a specified line speed. In order to classify a packet as belonging to a particular flow or set of flows, network nodes must perform a…

Networking and Internet Architecture · Computer Science 2014-04-08 Pallavi. V. S , Dr. Rukmani Devi. D

Partitioning graphs into blocks of roughly equal size such that few edges run between blocks is a frequently needed operation in processing graphs. Recently, size, variety, and structural complexity of these networks has grown dramatically.…

Data Structures and Algorithms · Computer Science 2018-10-16 Yaroslav Akhremtsev , Peter Sanders , Christian Schulz

Balanced partitioning is often a crucial first step in solving large-scale graph optimization problems, e.g., in some cases, a big graph can be chopped into pieces that fit on one machine to be processed independently before stitching the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-10 Kevin Aydin , MohammadHossein Bateni , Vahab Mirrokni

Partitioning an input graph over a set of workers is a complex operation. Objectives are twofold: split the work evenly, so that every worker gets an equal share, and minimize edge cut to achieve a good work locality (i.e. workers can work…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-28 Le Merrer Erwan , Liang Yizhong , Trédan Gilles

The balanced hypergraph partitioning problem is to partition a hypergraph into $k$ disjoint blocks of bounded size such that the sum of the number of blocks connected by each hyperedge is minimized. We present an improvement to the…

Data Structures and Algorithms · Computer Science 2020-03-30 Lars Gottesbüren , Michael Hamann , Sebastian Schlag , Dorothea Wagner

In the realm of distributed systems tasked with managing and processing large-scale graph-structured data, optimizing graph partitioning stands as a pivotal challenge. The primary goal is to minimize communication overhead and runtime cost.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-29 Zezhong Ding , Yongan Xiang , Shangyou Wang , Xike Xie , S. Kevin Zhou

Analyzing large graph data is an essential part of many modern applications, such as social networks. Due to its large computational complexity, distributed processing is frequently employed. This requires graph data to be divided across…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-12 YoungJoon Park , DongKyu Lee , Tien-Cuong Bui

In this paper we improve the approximation ratio for the problem of scheduling packets on line networks with bounded buffers, where the aim is that of maximizing the throughput. Each node in the network has a local buffer of bounded size…

Data Structures and Algorithms · Computer Science 2020-09-30 Guy Even , Moti Medina , Adi Rosén

Motivated by emerging big streaming data processing paradigms (e.g., Twitter Storm, Streaming MapReduce), we investigate the problem of scheduling graphs over a large cluster of servers. Each graph is a job, where nodes represent compute…

Networking and Internet Architecture · Computer Science 2015-02-23 Javad Ghaderi , Sanjay Shakkottai , R Srikant

The most commonly used method to tackle the graph partitioning problem in practice is the multilevel approach. During a coarsening phase, a multilevel graph partitioning algorithm reduces the graph size by iteratively contracting nodes and…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-26 Henning Meyerhenke , Peter Sanders , Christian Schulz

In the semi-streaming model, an algorithm receives a stream of edges of a graph in arbitrary order and uses a memory of size $O(n \mbox{ polylog } n)$, where $n$ is the number of vertices of a graph. In this work, we present semi-streaming…

Data Structures and Algorithms · Computer Science 2014-04-11 Christian Konrad , Frédéric Magniez , Claire Mathieu

We consider the online buffer minimization in multiprocessor systems with conflicts problem (in short, the buffer minimization problem) in the recently introduced flow model. In an online fashion, workloads arrive on some of the $n$…

Data Structures and Algorithms · Computer Science 2025-11-26 Niklas Haas , Sören Schmitt , Rob van Stee

Point clouds are increasingly important in intelligent applications, but frequent off-chip memory traffic in accelerators causes pipeline stalls and leads to high energy consumption. While conventional line buffer techniques can eliminate…

Hardware Architecture · Computer Science 2025-07-01 Yu Feng , Zheng Liu , Weikai Lin , Zihan Liu , Jingwen Leng , Minyi Guo , Zhezhi He , Jieru Zhao , Yuhao Zhu

Graph partition is a key component to achieve workload balance and reduce job completion time in parallel graph processing systems. Among the various partition strategies, edge partition has demonstrated more promising performance in…

Data Structures and Algorithms · Computer Science 2020-12-18 Zhenyu Guo , Mingyu Xiao , Yi Zhou , Dongxiang Zhang , Kian-Lee Tan