English
Related papers

Related papers: Machine Learning-based Selection of Graph Partitio…

200 papers

Problems in scientific computing, such as distributing large sparse matrix operations, have analogous formulations as hypergraph partitioning problems. A hypergraph is a generalization of a traditional graph wherein "hyperedges" may connect…

Data Structures and Algorithms · Computer Science 2022-06-16 Justin Sybrandt , Ruslan Shaydulin , Ilya Safro

Graph Neural Networks (GNNs) have emerged as powerful tools for supervised machine learning over graph-structured data, while sampling-based node representation learning is widely utilized in unsupervised learning. However, scalability…

Machine Learning · Computer Science 2024-07-23 Vipul Gupta , Xin Chen , Ruoyun Huang , Fanlong Meng , Jianjun Chen , Yujun Yan

In this paper, we propose a graph classification approach for automatically determining whether to use a monolithic or a decomposition-based solution method. In this approach, an optimization problem is represented as a graph that captures…

Optimization and Control · Mathematics 2023-10-12 Ilias Mitrai , Prodromos Daoutidis

Motivated by the need to extract knowledge and value from interconnected data, graph analytics on big data is a very active area of research in both industry and academia. To support graph analytics efficiently a large number of in memory…

Recently we create so much data (2.5 quintillion bytes every day) that 90% of the data in the world today has been created in the last two years alone [1]. This data comes from sensors used to gather traffic or climate information, posts to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-20 Afsin Akdogan , Hien To

Attributed graphs model real networks by enriching their nodes with attributes accounting for properties. Several techniques have been proposed for partitioning these graphs into clusters that are homogeneous with respect to both semantic…

Social and Information Networks · Computer Science 2017-08-29 Alessandro Baroni , Alessio Conte , Maurizio Patrignani , Salvatore Ruggieri

Graph partitioning plays a pivotal role in various distributed graph processing applications, including graph analytics, graph neural network training, and distributed graph databases. Graphs that require distributed settings are often too…

Databases · Computer Science 2024-12-11 Milad Rezaei Hajidehi , Sraavan Sridhar , Margo Seltzer

Graph edge partitioning is an important preprocessing step to optimize distributed computing jobs on graph-structured data. The edge set of a given graph is split into $k$ equally-sized partitions, such that the replication of vertices…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-25 Ruben Mayer , Kamil Orujzade , Hans-Arno Jacobsen

With the widespread use of shared-nothing clusters of servers, there has been a proliferation of distributed object stores that offer high availability, reliability and enhanced performance for MapReduce-style workloads. However, relational…

Databases · Computer Science 2013-12-03 Lukasz Golab , Marios Hadjieleftheriou , Howard Karloff , Barna Saha

We study the problem of generating graphs with prescribed degree sequences for bipartite, directed, and undirected networks. We first propose a sequential method for bipartite graph generation and establish a necessary and sufficient…

Methodology · Statistics 2026-03-13 Tong Sun , Jianshu Hao , Michael C. Fu , Guangxin Jiang

Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures,…

Machine Learning · Computer Science 2024-08-21 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Eigenvalues of a graph are of high interest in graph analytics for Big Data due to their relevance to many important properties of the graph including network resilience, community detection and the speed of viral propagation. Accurate…

Social and Information Networks · Computer Science 2018-05-22 Guyue Han , Harish Sethu

Graphs are widely used to model execution dependencies in applications. In particular, the NP-complete problem of partitioning a graph under constraints receives enormous attention by researchers because of its applicability in…

Data Structures and Algorithms · Computer Science 2017-04-04 Orlando Moreira , Merten Popp , Christian Schulz

Graph Neural Networks (GNNs) have shown success in learning from graph-structured data, with applications to fraud detection, recommendation, and knowledge graph reasoning. However, training GNN efficiently is challenging because: 1) GPU…

Machine Learning · Computer Science 2021-11-12 Seung Won Min , Kun Wu , Mert Hidayetoğlu , Jinjun Xiong , Xiang Song , Wen-mei Hwu

Graph clustering involves the task of dividing nodes into clusters, so that the edge density is higher within clusters as opposed to across clusters. A natural, classic and popular statistical setting for evaluating solutions to this…

Machine Learning · Statistics 2016-11-17 Yudong Chen , Sujay Sanghavi , Huan Xu

This work concerns the analysis and design of distributed first-order optimization algorithms over time-varying graphs. The goal of such algorithms is to optimize a global function that is the average of local functions using only local…

Optimization and Control · Mathematics 2020-02-17 Akhil Sundararajan , Bryan Van Scoy , Laurent Lessard

Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to…

Machine Learning · Computer Science 2024-06-26 Juan Cervino , Md Asadullah Turja , Hesham Mostafa , Nageen Himayat , Alejandro Ribeiro

Graph partitioning is an important preprocessing step to distributed graph processing. In edge partitioning, the edge set of a given graph is split into $k$ equally-sized partitions, such that the replication of vertices across partitions…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-22 Ruben Mayer , Kamil Orujzade , Hans-Arno Jacobsen

The excessively increased volume of data in modern data management systems demands an improved system performance, frequently provided by data distribution, system scalability and performance optimization techniques. Optimized horizontal…

Machine Learning · Computer Science 2019-11-27 Nino Arsov , Goran Velinov , Aleksandar S. Dimovski , Bojana Koteska , Dragan Sahpaski , Margina Kon-Popovska

Processing large complex networks recently attracted considerable interest. Complex graphs are useful in a wide range of applications from technological networks to biological systems like the human brain. Sometimes these networks are…

Data Structures and Algorithms · Computer Science 2019-12-03 Christian Schulz