English
Related papers

Related papers: Spinner: Scalable Graph Partitioning in the Cloud

200 papers

Graph partitioning, a well studied problem of parallel computing has many applications in diversified fields such as distributed computing, social network analysis, data mining and many other domains. In this paper, we introduce FGPGA, an…

Neural and Evolutionary Computing · Computer Science 2014-11-18 Md. Lisul Islam , Novia Nurain , Swakkhar Shatabda , M Sohel Rahman

As a powerful tool for modeling graph data, Graph Neural Networks (GNNs) have received increasing attention in both academia and industry. Nevertheless, it is notoriously difficult to deploy GNNs on industrial scale graphs, due to their…

Machine Learning · Computer Science 2024-01-09 Zhongshu Zhu , Bin Jing , Xiaopei Wan , Zhizhen Liu , Lei Liang , Jun zhou

The Steiner tree problem aims to determine a minimum edge-weighted tree that spans a given set of terminal vertices from a given graph. In the past decade, a considerable number of algorithms have been developed to solve this…

Data Structures and Algorithms · Computer Science 2024-08-23 Ming Sun , Xinyu Wu , Yi Zhou , Jin-Kao Hao , Zhang-Hua Fu

Attributed graphs model real networks by enriching their nodes with attributes accounting for properties. Several techniques have been proposed for partitioning these graphs into clusters that are homogeneous with respect to both semantic…

Social and Information Networks · Computer Science 2017-08-29 Alessandro Baroni , Alessio Conte , Maurizio Patrignani , Salvatore Ruggieri

A spin system is a framework in which the vertices of a graph are assigned spins from a finite set. The interactions between neighbouring spins give rise to weights, so a spin assignment can also be viewed as a weighted graph homomorphism.…

Data Structures and Algorithms · Computer Science 2021-04-15 Andreas Galanis , Leslie Ann Goldberg , James Stewart

Partitioning the vertices of a (hyper)graph into k roughly balanced blocks such that few (hyper)edges run between blocks is a key problem for large-scale distributed processing. A current trend for partitioning huge (hyper)graphs using low…

Data Structures and Algorithms · Computer Science 2023-02-14 Kamal Eyubov , Marcelo Fonseca Faraj , Christian Schulz

Inspired by the success of Google's Pregel, many systems have been developed recently for iterative computation over big graphs. These systems provide a user-friendly vertex-centric programming interface, where a programmer only needs to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-22 Da Yan , Yuzhen Huang , James Cheng , Huanhuan Wu

Computing maximum independent sets in graphs is an important problem in computer science. In this paper, we develop an evolutionary algorithm to tackle the problem. The core innovations of the algorithm are very natural combine operations…

Data Structures and Algorithms · Computer Science 2015-02-06 Sebastian Lamm , Peter Sanders , Christian Schulz

This paper presents a novel meta algorithm, Partition-Merge (PM), which takes existing centralized algorithms for graph computation and makes them distributed and faster. In a nutshell, PM divides the graph into small subgraphs using our…

Data Structures and Algorithms · Computer Science 2013-09-25 Vincent Blondel , Kyomin Jung , Pushmeet Kohli , Devavrat Shah

Graph partitioning has been an important tool to partition the work among several processors to minimize the communication cost and balance the workload. While accelerator-based supercomputers are emerging to be the standard, the use of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-04 Seher Acer , Erik G Boman , Christian A Glusa , Sivasankaran Rajamanickam

In the recent years, the scale of graph datasets has increased to such a degree that a single machine is not capable of efficiently processing large graphs. Thereby, efficient graph partitioning is necessary for those large graph…

Data Structures and Algorithms · Computer Science 2019-02-06 Md Anwarul kaium Patwary , Saurabh Garg , Byeong Kang

Graph representation learning has recently been applied to a broad spectrum of problems ranging from computer graphics and chemistry to high energy physics and social media. The popularity of graph neural networks has sparked interest, both…

Machine Learning · Computer Science 2020-11-05 Fabrizio Frasca , Emanuele Rossi , Davide Eynard , Ben Chamberlain , Michael Bronstein , Federico Monti

Pioneered by Google's Pregel, many distributed systems have been developed for large-scale graph analytics. These systems expose the user-friendly "think like a vertex" programming interface to users, and exhibit good horizontal…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-26 Da Yan , James Cheng , M. Tamer Özsu , Fan Yang , Yi Lu , John C. S. Lui , Qizhen Zhang , Wilfred Ng

Recent advances in data processing have stimulated the demand for learning graphs of very large scales. Graph Neural Networks (GNNs), being an emerging and powerful approach in solving graph learning tasks, are known to be difficult to…

Machine Learning · Computer Science 2023-06-02 Ningyi Liao , Dingheng Mo , Siqiang Luo , Xiang Li , Pengcheng Yin

Graph partitioning is the problem of dividing the nodes of a graph into balanced partitions while minimizing the edge cut across the partitions. Due to its combinatorial nature, many approximate solutions have been developed, including…

Machine Learning · Computer Science 2019-03-05 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

We describe an approach to parallel graph partitioning that scales to hundreds of processors and produces a high solution quality. For example, for many instances from Walshaw's benchmark collection we improve the best known partitioning.…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-04-08 Manuel Holtgrewe , Peter Sanders , Christian Schulz

We propose Slim Graph: the first programming model and framework for practical lossy graph compression that facilitates high-performance approximate graph processing, storage, and analytics. Slim Graph enables the developer to express…

Data Structures and Algorithms · Computer Science 2021-08-04 Maciej Besta , Simon Weber , Lukas Gianinazzi , Robert Gerstenberger , Andrey Ivanov , Yishai Oltchik , Torsten Hoefler

We present graph partition neural networks (GPNN), an extension of graph neural networks (GNNs) able to handle extremely large graphs. GPNNs alternate between locally propagating information between nodes in small subgraphs and globally…

Machine Learning · Computer Science 2018-03-19 Renjie Liao , Marc Brockschmidt , Daniel Tarlow , Alexander L. Gaunt , Raquel Urtasun , Richard Zemel

With the advent of social networks and the web, the graph sizes have grown too large to fit in main memory precipitating the need for alternative approaches for an efficient, scalable evaluation of queries on graphs of any size. Here, we…

Databases · Computer Science 2019-05-15 Soumyava Das , Abhishek Santra , Jay Bodra , Sharma Chakravarthy

Graph-based computations are crucial in a wide range of applications, where graphs can scale to trillions of edges. To enable efficient training on such large graphs, mini-batch subgraph sampling is commonly used, which allows training…

Machine Learning · Computer Science 2025-04-04 Yue Jin , Yongchao Liu , Chuntao Hong