English
Related papers

Related papers: FREIGHT: Fast Streaming Hypergraph Partitioning

200 papers

State-of-the-art data flow systems such as TensorFlow impose iterative calculations on large graphs that need to be partitioned on heterogeneous devices such as CPUs, GPUs, and TPUs. However, partitioning can not be viewed in isolation.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Ruben Mayer , Christian Mayer , Larissa Laich

The increasing scale and wealth of inter-connected data, such as those accrued by social network applications, demand the design of new techniques and platforms to efficiently derive actionable knowledge from large-scale graphs. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-08 Abdullah Gharaibeh , Tahsin Reza , Elizeu Santos-Neto , Lauro Beltrao Costa , Scott Sallinen , Matei Ripeanu

We present a novel method for graph partitioning, based on reinforcement learning and graph convolutional neural networks. Our approach is to recursively partition coarser representations of a given graph. The neural network is implemented…

Machine Learning · Computer Science 2021-06-30 Alice Gatti , Zhixiong Hu , Tess Smidt , Esmond G. Ng , Pieter Ghysels

The degree distribution is one of the most fundamental graph properties of interest for real-world graphs. It has been widely observed in numerous domains that graphs typically have a tailed or scale-free degree distribution. While the…

Data Structures and Algorithms · Computer Science 2015-11-30 Olivia Simpson , C. Seshadhri , Andrew McGregor

Graph processing at scale presents many challenges, including the irregular structure of graphs, the latency-bound nature of graph algorithms, and the overhead associated with distributed execution. While existing frameworks such as Spark…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-06 Karame Mohammadiporshokooh , Panagiotis Syskakis , Andrew Lumsdaine , Hartmut Kaiser

Graph embedding is a popular algorithmic approach for creating vector representations for individual vertices in networks. Training these algorithms at scale is important for creating embeddings that can be used for classification, ranking,…

Machine Learning · Computer Science 2019-07-04 C. Bayan Bruss , Anish Khazane , Jonathan Rider , Richard Serpe , Saurabh Nagrecha , Keegan E. Hines

Graph clustering is a fundamental computational problem with a number of applications in algorithm design, machine learning, data mining, and analysis of social networks. Over the past decades, researchers have proposed a number of…

Data Structures and Algorithms · Computer Science 2019-04-12 He Sun , Luca Zanetti

The number of triangles in a graph is a fundamental metric, used in social network analysis, link classification and recommendation, and more. Driven by these applications and the trend that modern graph datasets are both large and dynamic,…

Databases · Computer Science 2013-08-12 Kanat Tangwongsan , A. Pavan , Srikanta Tirthapura

As the volume of the RDF data becomes increasingly large, it is essential for us to design a distributed database system to manage it. For distributed RDF data design, it is quite common to partition the RDF data into some parts, called…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-23 Peng Peng , Lei Zou , Lei Chen , Dongyan Zhao

Partitioning is a known problem in computer science and is critical in chip design workflows, as advancements in this area can significantly influence design quality and efficiency. Deep Learning (DL) techniques, particularly those…

Hardware Architecture · Computer Science 2024-09-04 Muhammad Hadir Khan , Bugra Onal , Eren Dogan , Matthew R. Guthaus

Graph partitioning is the problem of dividing the nodes of a graph into balanced partitions while minimizing the edge cut across the partitions. Due to its combinatorial nature, many approximate solutions have been developed, including…

Machine Learning · Computer Science 2019-03-05 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

Recent advances in dynamic graph processing have enabled the analysis of highly dynamic graphs with change at rates as high as millions of edge changes per second. Solutions in this domain, however, have been demonstrated only for…

Data Structures and Algorithms · Computer Science 2023-11-14 Juntong Luo , Scott Sallinen , Matei Ripeanu

Graph partitioning is a key fundamental problem in the area of big graph computation. Previous works do not consider the practical requirements when optimizing the big data analysis in real applications. In this paper, motivated by…

Databases · Computer Science 2024-04-10 Baoling Ning , Jianzhong Li

In this paper, we develop semi-external and external memory algorithms for graph partitioning and clustering problems. Graph partitioning and clustering are key tools for processing and analyzing large complex networks. We address both…

Data Structures and Algorithms · Computer Science 2014-09-24 Yaroslav Akhremtsev , Peter Sanders , Christian Schulz

Graph partition is a fundamental problem of parallel computing for big graph data. Many graph partition algorithms have been proposed to solve the problem in various applications, such as matrix computations and PageRank, etc., but none has…

Social and Information Networks · Computer Science 2015-01-05 Xiaoming Liu , Yadong Zhou , Xiaohong Guan

This work presents a novel protocol for fast secure inference of neural networks applied to computer vision applications. It focuses on improving the overall performance of the online execution by deploying a subset of the model weights in…

Cryptography and Security · Computer Science 2022-03-01 George-Liviu Pereteanu , Amir Alansary , Jonathan Passerat-Palmbach

Subgraph enumeration is a fundamental problem in graph analytics, which aims to find all instances of a given query graph on a large data graph. In this paper, we propose a system called HUGE to efficiently process subgraph enumeration at…

Databases · Computer Science 2021-03-30 Zhengyi Yang , Longbin Lai , Xuemin Lin , Kongzhang Hao , Wenjie Zhang

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

Machine Learning · Computer Science 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

This paper introduces a scalable algorithmic framework (HyperEF) for spectral coarsening (decomposition) of large-scale hypergraphs by exploiting hyperedge effective resistances. Motivated by the latest theoretical framework for…

Machine Learning · Computer Science 2022-12-06 Ali Aghdaei , Zhuo Feng

This work consists of a study of a set of techniques and strategies related with algorithm's design, whose purpose is the resolution of problems on massive data sets, in an efficient way. This field is known as Algorithms for Big Data. In…

Data Structures and Algorithms · Computer Science 2017-08-29 Sergio García Prado