English
Related papers

Related papers: Distributed Edge Partitioning for Trillion-edge Gr…

200 papers

We introduce a novel algorithm to perform graph clustering in the edge streaming setting. In this model, the graph is presented as a sequence of edges that can be processed strictly once. Our streaming algorithm has an extremely low memory…

Machine Learning · Computer Science 2017-12-13 Alexandre Hollocou , Julien Maudet , Thomas Bonald , Marc Lelarge

Many important real-world applications-such as social networks or distributed data bases-can be modeled as hypergraphs. In such a model, vertices represent entities-such as users or data records-whereas hyperedges model a group membership…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-15 Christian Mayer , Ruben Mayer , Sukanya Bhowmik , Lukas Epple , Kurt Rothermel

Diffusion-based generative graph models have been proven effective in generating high-quality small graphs. However, they need to be more scalable for generating large graphs containing thousands of nodes desiring graph statistics. In this…

Machine Learning · Computer Science 2023-06-01 Xiaohui Chen , Jiaxing He , Xu Han , Li-Ping Liu

With the growing adoption of graph neural networks (GNNs), explaining their predictions has become increasingly important. However, attributing predictions to specific edges or features remains computationally expensive. For example,…

Machine Learning · Computer Science 2025-07-01 Selahattin Akkas , Aditya Devarakonda , Ariful Azad

In this paper, we develop semi-external and external memory algorithms for graph partitioning and clustering problems. Graph partitioning and clustering are key tools for processing and analyzing large complex networks. We address both…

Data Structures and Algorithms · Computer Science 2014-09-24 Yaroslav Akhremtsev , Peter Sanders , Christian Schulz

In this paper we propose an online approximate k-nn graph building algorithm, which is able to quickly update a k-nn graph using a flow of data points. One very important step of the algorithm consists in using the current distributed graph…

Data Structures and Algorithms · Computer Science 2016-02-23 Thibault Debatty , Pietro Michiardi , Wim Mees

We study the problem of edge partitioning, where the goal is to partition the edge set of a graph into several parts. The replication factor of a vertex $v$ is the number of parts that contain edges incident to $v$. The goal is to minimize…

Discrete Mathematics · Computer Science 2026-05-08 Alexander Yakunin , Andrey Kupavskii , Alexander Sushin , Stanislav Moiseev

Edge inference has become more widespread, as its diverse applications range from retail to wearable technology. Clusters of networked resource-constrained edge devices are becoming common, yet no system exists to split a DNN across these…

Networking and Internet Architecture · Computer Science 2022-10-25 Arjun Parthasarathy , Bhaskar Krishnamachari

Partitioning an input graph over a set of workers is a complex operation. Objectives are twofold: split the work evenly, so that every worker gets an equal share, and minimize edge cut to achieve a good work locality (i.e. workers can work…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-28 Le Merrer Erwan , Liang Yizhong , Trédan Gilles

Hypergraph partitioning is a recurring NP-hard problem in engineering; its efficient solution at scale hinges on parallelism. This work proposes a GPU-centric algorithm for multi-level hypergraph partitioning aimed at a specific set of…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-21 Marco Ronzani , Cristina Silvano

Most existing graph visualization methods based on dimension reduction are limited to relatively small graphs due to performance issues. In this work, we propose a novel dimension reduction method for graph visualization, called…

Machine Learning · Computer Science 2023-10-18 Xinyu Li , Yao Xiao , Yuchen Zhou

Processing large-scale graphs, containing billions of entities, is critical across fields like bioinformatics, high-performance computing, navigation and route planning, among others. Efficient graph partitioning, which divides a graph into…

Data Structures and Algorithms · Computer Science 2024-10-11 Adil Chhabra , Florian Kurpicz , Christian Schulz , Dominik Schweisgut , Daniel Seemaier

Many real-world systems, such as social networks, rely on mining efficiently large graphs, with hundreds of millions of vertices and edges. This volume of information requires partitioning the graph across multiple nodes in a distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-09-11 Luis Vaquero , Felix Cuadrado , Dionysios Logothetis , Claudio Martella

Despite the recent success of Graph Neural Networks, it remains challenging to train a GNN on large graphs with millions of nodes and billions of edges, which are prevalent in many graph-based applications. Traditional sampling-based…

Machine Learning · Computer Science 2022-10-04 Zheng Chai , Guangji Bai , Liang Zhao , Yue Cheng

We propose neighborhood-based core decomposition: a novel way of decomposing hypergraphs into hierarchical neighborhood-cohesive subhypergraphs. Alternative approaches to decomposing hypergraphs, e.g., reduction to clique or bipartite…

Social and Information Networks · Computer Science 2023-04-11 Naheed Anjum Arafat , Arijit Khan , Arpit Kumar Rai , Bishwamittra Ghosh

We study large-scale, distributed graph clustering. Given an undirected graph, our objective is to partition the nodes into disjoint sets called clusters. A cluster should contain many internal edges while being sparsely connected to other…

Data Structures and Algorithms · Computer Science 2020-04-28 Michael Hamann , Ben Strasser , Dorothea Wagner , Tim Zeitz

Training Graph Neural Networks (GNNs) on real-world graphs consisting of billions of nodes and edges is quite challenging, primarily due to the substantial memory needed to store the graph and its intermediate node and edge features, and…

Machine Learning · Computer Science 2023-08-08 Kaidi Cao , Rui Deng , Shirley Wu , Edward W Huang , Karthik Subbian , Jure Leskovec

In recent years, the graph partitioning problem gained importance as a mandatory preprocessing step for distributed graph processing on very large graphs. Existing graph partitioning algorithms minimize partitioning latency by assigning…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-31 Christian Mayer , Ruben Mayer , Muhammad Adnan Tariq , Heiko Geppert , Larissa Laich , Lukas Rieger , Kurt Rothermel

In this paper, we consider networks with topologies described by some connected undirected graph ${\mathcal{G}}=(V, E)$ and with some agents (fusion centers) equipped with processing power and local peer-to-peer communication, and…

Optimization and Control · Mathematics 2021-12-07 Nazar Emirov , Guohui Song , Qiyu Sun

We present a novel method for graph partitioning, based on reinforcement learning and graph convolutional neural networks. Our approach is to recursively partition coarser representations of a given graph. The neural network is implemented…

Machine Learning · Computer Science 2021-06-30 Alice Gatti , Zhixiong Hu , Tess Smidt , Esmond G. Ng , Pieter Ghysels