English
Related papers

Related papers: Partitioning Trillion Edge Graphs on Edge Devices

200 papers

Large-scale graph processing has drawn great attention in recent years. Most of the modern-day datacenter workloads can be represented in the form of Graph Processing such as MapReduce etc. Consequently, a lot of designs for Domain-Specific…

Hardware Architecture · Computer Science 2022-09-07 Khushal Sethi

For a deep learning model, efficient execution of its computation graph is key to achieving high performance. Previous work has focused on improving the performance for individual nodes of the computation graph, while ignoring the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-26 Linpeng Tang , Yida Wang , Theodore L. Willke , Kai Li

Analyzing massive data sets has been one of the key motivations for studying streaming algorithms. In recent years, there has been significant progress in analysing distributions in a streaming setting, but the progress on graph problems…

Data Structures and Algorithms · Computer Science 2009-05-05 Kook Jin Ahn , Sudipto Guha

Graph partitioning has long been seen as a viable approach to address Graph DBMS scalability. A partitioning, however, may introduce extra query processing latency unless it is sensitive to a specific query workload, and optimised to…

Databases · Computer Science 2016-06-24 Hugo Firth , Paolo Missier

We introduce XtraPuLP, a new distributed-memory graph partitioner designed to process trillion-edge graphs. XtraPuLP is based on the scalable label propagation community detection technique, which has been demonstrated as a viable means to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-25 George M Slota , Sivasankaran Rajamanickam , Karen Devine , Kamesh Madduri

Graph processing has become an important part of various areas of computing, including machine learning, medical applications, social network analysis, computational sciences, and others. A growing amount of the associated graph processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-01 Maciej Besta , Marc Fischer , Vasiliki Kalavri , Michael Kapralov , Torsten Hoefler

As with general graph processing systems, partitioning data over a cluster of machines improves the scalability of graph database management systems. However, these systems will incur additional network cost during the execution of a query…

Databases · Computer Science 2017-11-20 Hugo Firth , Paolo Missier , Jack Aiston

Point clouds are increasingly important in intelligent applications, but frequent off-chip memory traffic in accelerators causes pipeline stalls and leads to high energy consumption. While conventional line buffer techniques can eliminate…

Hardware Architecture · Computer Science 2025-07-01 Yu Feng , Zheng Liu , Weikai Lin , Zihan Liu , Jingwen Leng , Minyi Guo , Zhezhi He , Jieru Zhao , Yuhao Zhu

Processing very large graphs like social networks, biological and chemical compounds is a challenging task. Distributed graph processing systems process the billion-scale graphs efficiently but incur overheads of efficient partitioning and…

Data Structures and Algorithms · Computer Science 2014-01-13 Kamran Najeebullah , Kifayat Ullah Khan , Waqas Nawaz , Young-Koo Lee

The number of triangles in a graph is a fundamental metric, used in social network analysis, link classification and recommendation, and more. Driven by these applications and the trend that modern graph datasets are both large and dynamic,…

Databases · Computer Science 2013-08-12 Kanat Tangwongsan , A. Pavan , Srikanta Tirthapura

Given a stream of heterogeneous graphs containing different types of nodes and edges, how can we spot anomalous ones in real-time while consuming bounded memory? This problem is motivated by and generalizes from its application in security…

Social and Information Networks · Computer Science 2016-02-23 Emaad A. Manzoor , Sadegh Momeni , Venkat N. Venkatakrishnan , Leman Akoglu

Graph analytics are at the heart of a broad range of applications such as drug discovery, page ranking, and recommendation systems. When graph size exceeds memory size, out-of-core graph processing is needed. For the widely used external…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-12 Kiran Kumar Matam , Hanieh Hashemi , Murali Annavaram

This paper proposes a scalable algorithmic framework for spectral reduction of large undirected graphs. The proposed method allows computing much smaller graphs while preserving the key spectral (structural) properties of the original…

Data Structures and Algorithms · Computer Science 2018-12-24 Zhiqiang Zhao , Yongyu Wang , Zhuo Feng

Finding the connected components of a graph is a fundamental problem with uses throughout computer science and engineering. The task of computing connected components becomes more difficult when graphs are very large, or when they are…

Data Structures and Algorithms · Computer Science 2022-03-29 David Tench , Evan West , Victor Zhang , Michael A. Bender , Abiyaz Chowdhury , J. Ahmed Dellas , Martin Farach-Colton , Tyler Seip , Kenny Zhang

(Hyper)Graph decomposition is a family of problems that aim to break down large (hyper)graphs into smaller sub(hyper)graphs for easier analysis. The importance of this lies in its ability to enable efficient computation on large and complex…

Data Structures and Algorithms · Computer Science 2023-08-31 Marcelo Fonseca Faraj

Electronic data is growing at increasing rates, in both size and connectivity: the increasing presence of, and interest in, relationships between data. An example is the Twitter social network graph. Due to this growth demand is increasing…

Databases · Computer Science 2013-01-23 Alex Averbuch , Martin Neumann

Due to the dynamic nature of real-world graphs, there has been a growing interest in the graph-streaming setting where a continuous stream of graph updates is mixed with arbitrary graph queries. In principle, purely-functional trees are an…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-18 Laxman Dhulipala , Julian Shun , Guy Blelloch

Graph partitioning has been an important tool to partition the work among several processors to minimize the communication cost and balance the workload. While accelerator-based supercomputers are emerging to be the standard, the use of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-04 Seher Acer , Erik G Boman , Christian A Glusa , Sivasankaran Rajamanickam

Graph Partitioning is widely used in many real-world applications such as fraud detection and social network analysis, in order to enable the distributed graph computing on large graphs. However, existing works fail to balance the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-07 Li Zeng , Haohan Huang , Binfan Zheng , Kang Yang , Shengcheng Shao , Jinhua Zhou , Jun Xie , Rongqian Zhao , Xin Chen

Inspired by the success of Google's Pregel, many systems have been developed recently for iterative computation over big graphs. These systems provide a user-friendly vertex-centric programming interface, where a programmer only needs to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-22 Da Yan , Yuzhen Huang , James Cheng , Huanhuan Wu