English
Related papers

Related papers: Spinner: Scalable Graph Partitioning in the Cloud

200 papers

In the realm of generative models for graphs, extensive research has been conducted. However, most existing methods struggle with large graphs due to the complexity of representing the entire joint distribution across all node pairs and…

Social and Information Networks · Computer Science 2024-05-15 Andreas Bergmeister , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

Statistical analysis of large and sparse graphs is a challenging problem in data science due to the high dimensionality and nonlinearity of the problem. This paper presents a fast and scalable algorithm for partitioning such graphs into…

Data Structures and Algorithms · Computer Science 2018-12-24 Hannu Reittu , Lasse Leskelä , Tomi Räty , Marco Fiorucci

We propose Distributed Neighbor Expansion (Distributed NE), a parallel and distributed graph partitioning method that can scale to trillion-edge graphs while providing high partitioning quality. Distributed NE is based on a new heuristic,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-24 Masatoshi Hanai , Toyotaro Suzumura , Wen Jun Tan , Elvis Liu , Georgios Theodoropoulos , Wentong Cai

One of the most useful measures of cluster quality is the modularity of a partition, which measures the difference between the number of the edges joining vertices from the same cluster and the expected number of such edges in a random…

Data Analysis, Statistics and Probability · Physics 2009-09-29 Hristo Djidjev

Graph-based clustering has shown promising performance in many tasks. A key step of graph-based approach is the similarity graph construction. In general, learning graph in kernel space can enhance clustering accuracy due to the…

Machine Learning · Computer Science 2019-05-22 Zhao Kang , Honghui Xu , Boyu Wang , Hongyuan Zhu , Zenglin Xu

We study online graph queries that retrieve nearby nodes of a query node from a large network. To answer such queries with high throughput and low latency, we partition the graph and process the data in parallel across a cluster of servers.…

Databases · Computer Science 2017-10-17 Arijit Khan , Gustavo Segovia , Donald Kossmann

Expander decompositions of graphs have significantly advanced the understanding of many classical graph problems and led to numerous fundamental theoretical results. However, their adoption in practice has been hindered due to their…

Data Structures and Algorithms · Computer Science 2026-04-27 Kathrin Hanauer , Monika Henzinger , Robin Münk , Harald Räcke , Maximilian Vötsch

Semi-supervised clustering is a basic problem in various applications. Most existing methods require knowledge of the ideal cluster number, which is often difficult to obtain in practice. Besides, satisfying the must-link constraints is…

Optimization and Control · Mathematics 2025-03-07 Wei Liu , Xin Liu , Michael K. Ng , Zaikun Zhang

Graph clustering or community detection constitutes an important task for investigating the internal structure of graphs, with a plethora of applications in several domains. Traditional techniques for graph clustering, such as spectral…

We continue the line of research on graph compression started with WebGraph, but we move our focus to the compression of social networks in a proper sense (e.g., LiveJournal): the approaches that have been used for a long time to compress…

Data Structures and Algorithms · Computer Science 2011-10-17 Paolo Boldi , Marco Rosa , Massimo Santini , Sebastiano Vigna

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

Data Structures and Algorithms · Computer Science 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee

The modeling flexibility provided by hypergraphs has drawn a lot of interest from the combinatorial scientific community, leading to novel models and algorithms, their applications, and development of associated tools. Hypergraphs are now a…

Data Structures and Algorithms · Computer Science 2015-03-19 Enver Kayaaslan , Ali Pinar , Umit V. Catalyurek , Cevdet Aykanat

A major hurdle in machine learning is scalability to massive datasets. Approaches to overcome this hurdle include compression of the data matrix and distributing the computations. \textit{Leverage score sampling} provides a compressed…

Information Theory · Computer Science 2020-09-16 Neophytos Charalambides , Mert Pilanci , Alfred O. Hero

Collaborative filtering (CF) is widely searched in recommendation with various types of solutions. Recent success of Graph Convolution Networks (GCN) in CF demonstrates the effectiveness of modeling high-order relationships through graphs,…

Information Retrieval · Computer Science 2023-02-13 Tianjun Wei , Jianghong Ma , Tommy W. S. Chow

We address the problem of predicting the labeling of a graph in an online setting when the labeling is changing over time. We present an algorithm based on a specialist approach; we develop the machinery of cluster specialists which…

Machine Learning · Computer Science 2019-06-18 Mark Herbster , James Robinson

Graph Neural Networks (GNNs) are the first choice methods for graph machine learning problems thanks to their ability to learn state-of-the-art level representations from graph-structured data. However, centralizing a massive amount of…

Machine Learning · Computer Science 2021-06-08 Chaoyang He , Emir Ceyani , Keshav Balasubramanian , Murali Annavaram , Salman Avestimehr

The graph partitioning problem is widely used and studied in many practical and theoretical applications. The multilevel strategies represent today one of the most effective and efficient generic frameworks for solving this problem on…

Data Structures and Algorithms · Computer Science 2012-04-04 Ilya Safro , Peter Sanders , Christian Schulz

A scalable graphical method is presented for selecting, and partitioning datasets for the training phase of a classification task. For the heuristic, a clustering algorithm is required to get its computation cost in a reasonable proportion…

Machine Learning · Computer Science 2019-07-25 Sumedh Yadav , Mathis Bode

Small distributed systems are limited by their main memory to generate massively large graphs. Trivial extension to current graph generators to utilize external memory leads to large amount of random I/O hence do not scale with size. In…

Databases · Computer Science 2012-10-02 Sandeep Gupta

Given a graph $G = (V,E)$ with vertex weights $w(v)$ and a desired number of parts $k$, the goal in graph partitioning problems is to partition the vertex set V into parts $V_1,\ldots,V_k$. Metrics for compactness, contiguity, and balance…

Data Structures and Algorithms · Computer Science 2021-02-10 Cyrus Hettle , Shixiang Zhu , Swati Gupta , Yao Xie