English
Related papers

Related papers: AWAPart: Adaptive Workload-Aware Partitioning of K…

200 papers

Partitioning graphs into blocks of roughly equal size is widely used when processing large graphs. Currently there is a gap in the space of available partitioning algorithms. On the one hand, there are streaming algorithms that have been…

Data Structures and Algorithms · Computer Science 2021-12-23 Marcelo Fonseca Faraj , Christian Schulz

In order to manage massive graphs in practice, it is often necessary to resort to graph compression, which aims at reducing the memory used when storing and processing the graph. Efficient compression methods have been proposed in the…

Social and Information Networks · Computer Science 2023-01-12 Maximilien Danisch , Ioannis Panagiotas , Lionel Tabourier

Modern machine learning techniques are successfully being adapted to data modeled as graphs. However, many real-world graphs are typically very large and do not fit in memory, often making the problem of training machine learning models on…

Machine Learning · Computer Science 2020-12-10 Alexandra Angerd , Keshav Balasubramanian , Murali Annavaram

With the explosive growth of artificial intelligence (AI) and big data, it has become vitally important to organize and represent the enormous volume of knowledge appropriately. As graph data, knowledge graphs accumulate and convey…

Artificial Intelligence · Computer Science 2023-03-27 Ciyuan Peng , Feng Xia , Mehdi Naseriparsa , Francesco Osborne

The efficient parallel execution of complex computations requires balancing the workload across processors while minimizing the communication between them. This inherent trade-off is often captured by graph partitioning or DAG scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-04 Pál András Papp , Toni Böhnlein , A. N. Yzelman

We study the problem of semi-supervised learning with Graph Neural Networks (GNNs) in an active learning setup. We propose GraphPart, a novel partition-based active learning approach for GNNs. GraphPart first splits the graph into disjoint…

Machine Learning · Computer Science 2023-03-20 Jiaqi Ma , Ziqiao Ma , Joyce Chai , Qiaozhu Mei

We study the problem of finding and monitoring fixed-size subgraphs in a continually changing large-scale graph. We present the first approach that (i) performs worst-case optimal computation and communication, (ii) maintains a total memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-13 Khaled Ammar , Frank McSherry , Semih Salihoglu , Manas Joglekar

Many well-known, real-world problems involve dynamic data which describe the relationship among the entities. Hypergraphs are powerful combinatorial structures that are frequently used to model such data. For many of today's data-centric…

Data Structures and Algorithms · Computer Science 2021-03-10 Fatih Taşyaran , Berkay Demireller , Kamer Kaya , Bora Uçar

Knowledge graph question answering (KGQA) based on information retrieval aims to answer a question by retrieving answer from a large-scale knowledge graph. Most existing methods first roughly retrieve the knowledge subgraphs (KSG) that may…

Computation and Language · Computer Science 2022-10-06 Hanning Gao , Lingfei Wu , Po Hu , Zhihua Wei , Fangli Xu , Bo Long

We present a novel distributed evolutionary algorithm, KaFFPaE, to solve the Graph Partitioning Problem, which makes use of KaFFPa (Karlsruhe Fast Flow Partitioner). The use of our multilevel graph partitioner KaFFPa provides new effective…

Neural and Evolutionary Computing · Computer Science 2011-10-05 Peter Sanders , Christian Schulz

We propose an adaptive graph coarsening method to jointly learn graph neural network (GNN) parameters and merge nodes via K-means clustering during training. As real-world graphs grow larger, processing them directly becomes increasingly…

Machine Learning · Computer Science 2025-10-01 Rostyslav Olshevskyi , Madeline Navarro , Santiago Segarra

It is common for real-world applications to analyze big graphs using distributed graph processing systems. Popular in-memory systems require an enormous amount of resources to handle big graphs. While several out-of-core approaches have…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-08 Peng Sun , Yonggang Wen , Ta Nguyen Binh Duong , Xiaokui Xiao

Large organizations have seamlessly incorporated data-driven decision making in their operations. However, as data volumes increase, expensive big data infrastructures are called to rescue. In this setting, analytics tasks become very…

Databases · Computer Science 2020-03-17 Fotis Savva , Christos Anagnostopoulos , Peter Triantafillou

Graph partitioning is the problem of dividing the nodes of a graph into balanced partitions while minimizing the edge cut across the partitions. Due to its combinatorial nature, many approximate solutions have been developed, including…

Machine Learning · Computer Science 2019-03-05 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

Graphs may be used to represent many different problem domains -- a concrete example is that of detecting communities in social networks, which are represented as graphs. With big data and more sophisticated applications becoming widespread…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-03 Miguel E. Coimbra , Alexandre P. Francisco , Luis Veiga

Balanced partitioning is often a crucial first step in solving large-scale graph optimization problems, e.g., in some cases, a big graph can be chopped into pieces that fit on one machine to be processed independently before stitching the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-10 Kevin Aydin , MohammadHossein Bateni , Vahab Mirrokni

Edge-labeled graphs are widely used to describe relationships between entities in a database. Given a query subgraph that represents an example of what the user is searching for, we study the problem of efficiently searching for similar…

Databases · Computer Science 2020-05-12 Zhaoyang Shao , Davood Rafiei , Themis Palpanas

In this paper, we develop semi-external and external memory algorithms for graph partitioning and clustering problems. Graph partitioning and clustering are key tools for processing and analyzing large complex networks. We address both…

Data Structures and Algorithms · Computer Science 2014-09-24 Yaroslav Akhremtsev , Peter Sanders , Christian Schulz

In this paper, we propose the DN-tree that is a data structure to build lossy summaries of the frequent data access patterns of the queries in a distributed graph data management system. These compact representations allow us an efficient…

Contextual Partitioning introduces an innovative approach to enhancing the architectural design of large-scale computational models through the dynamic segmentation of parameters into context-aware regions. This methodology emphasizes the…

Computation and Language · Computer Science 2025-08-11 Offa Kingsleigh , Alfred Abercrombie , David Woolstencroft , Beorhtric Meadowcroft , Marcus Irvin