中文
相关论文

相关论文: Spinner: Scalable Graph Partitioning in the Cloud

200 篇论文

In the realm of generative models for graphs, extensive research has been conducted. However, most existing methods struggle with large graphs due to the complexity of representing the entire joint distribution across all node pairs and…

社会与信息网络 · 计算机科学 2024-05-15 Andreas Bergmeister , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

Statistical analysis of large and sparse graphs is a challenging problem in data science due to the high dimensionality and nonlinearity of the problem. This paper presents a fast and scalable algorithm for partitioning such graphs into…

数据结构与算法 · 计算机科学 2018-12-24 Hannu Reittu , Lasse Leskelä , Tomi Räty , Marco Fiorucci

We propose Distributed Neighbor Expansion (Distributed NE), a parallel and distributed graph partitioning method that can scale to trillion-edge graphs while providing high partitioning quality. Distributed NE is based on a new heuristic,…

分布式、并行与集群计算 · 计算机科学 2019-09-24 Masatoshi Hanai , Toyotaro Suzumura , Wen Jun Tan , Elvis Liu , Georgios Theodoropoulos , Wentong Cai

One of the most useful measures of cluster quality is the modularity of a partition, which measures the difference between the number of the edges joining vertices from the same cluster and the expected number of such edges in a random…

数据分析、统计与概率 · 物理学 2009-09-29 Hristo Djidjev

Graph-based clustering has shown promising performance in many tasks. A key step of graph-based approach is the similarity graph construction. In general, learning graph in kernel space can enhance clustering accuracy due to the…

机器学习 · 计算机科学 2019-05-22 Zhao Kang , Honghui Xu , Boyu Wang , Hongyuan Zhu , Zenglin Xu

We study online graph queries that retrieve nearby nodes of a query node from a large network. To answer such queries with high throughput and low latency, we partition the graph and process the data in parallel across a cluster of servers.…

数据库 · 计算机科学 2017-10-17 Arijit Khan , Gustavo Segovia , Donald Kossmann

Expander decompositions of graphs have significantly advanced the understanding of many classical graph problems and led to numerous fundamental theoretical results. However, their adoption in practice has been hindered due to their…

数据结构与算法 · 计算机科学 2026-04-27 Kathrin Hanauer , Monika Henzinger , Robin Münk , Harald Räcke , Maximilian Vötsch

Semi-supervised clustering is a basic problem in various applications. Most existing methods require knowledge of the ideal cluster number, which is often difficult to obtain in practice. Besides, satisfying the must-link constraints is…

最优化与控制 · 数学 2025-03-07 Wei Liu , Xin Liu , Michael K. Ng , Zaikun Zhang

Graph clustering or community detection constitutes an important task for investigating the internal structure of graphs, with a plethora of applications in several domains. Traditional techniques for graph clustering, such as spectral…

We continue the line of research on graph compression started with WebGraph, but we move our focus to the compression of social networks in a proper sense (e.g., LiveJournal): the approaches that have been used for a long time to compress…

数据结构与算法 · 计算机科学 2011-10-17 Paolo Boldi , Marco Rosa , Massimo Santini , Sebastiano Vigna

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

数据结构与算法 · 计算机科学 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee

The modeling flexibility provided by hypergraphs has drawn a lot of interest from the combinatorial scientific community, leading to novel models and algorithms, their applications, and development of associated tools. Hypergraphs are now a…

数据结构与算法 · 计算机科学 2015-03-19 Enver Kayaaslan , Ali Pinar , Umit V. Catalyurek , Cevdet Aykanat

A major hurdle in machine learning is scalability to massive datasets. Approaches to overcome this hurdle include compression of the data matrix and distributing the computations. \textit{Leverage score sampling} provides a compressed…

信息论 · 计算机科学 2020-09-16 Neophytos Charalambides , Mert Pilanci , Alfred O. Hero

Collaborative filtering (CF) is widely searched in recommendation with various types of solutions. Recent success of Graph Convolution Networks (GCN) in CF demonstrates the effectiveness of modeling high-order relationships through graphs,…

信息检索 · 计算机科学 2023-02-13 Tianjun Wei , Jianghong Ma , Tommy W. S. Chow

We address the problem of predicting the labeling of a graph in an online setting when the labeling is changing over time. We present an algorithm based on a specialist approach; we develop the machinery of cluster specialists which…

机器学习 · 计算机科学 2019-06-18 Mark Herbster , James Robinson

Graph Neural Networks (GNNs) are the first choice methods for graph machine learning problems thanks to their ability to learn state-of-the-art level representations from graph-structured data. However, centralizing a massive amount of…

机器学习 · 计算机科学 2021-06-08 Chaoyang He , Emir Ceyani , Keshav Balasubramanian , Murali Annavaram , Salman Avestimehr

The graph partitioning problem is widely used and studied in many practical and theoretical applications. The multilevel strategies represent today one of the most effective and efficient generic frameworks for solving this problem on…

数据结构与算法 · 计算机科学 2012-04-04 Ilya Safro , Peter Sanders , Christian Schulz

A scalable graphical method is presented for selecting, and partitioning datasets for the training phase of a classification task. For the heuristic, a clustering algorithm is required to get its computation cost in a reasonable proportion…

机器学习 · 计算机科学 2019-07-25 Sumedh Yadav , Mathis Bode

Small distributed systems are limited by their main memory to generate massively large graphs. Trivial extension to current graph generators to utilize external memory leads to large amount of random I/O hence do not scale with size. In…

数据库 · 计算机科学 2012-10-02 Sandeep Gupta

Given a graph $G = (V,E)$ with vertex weights $w(v)$ and a desired number of parts $k$, the goal in graph partitioning problems is to partition the vertex set V into parts $V_1,\ldots,V_k$. Metrics for compactness, contiguity, and balance…

数据结构与算法 · 计算机科学 2021-02-10 Cyrus Hettle , Shixiang Zhu , Swati Gupta , Yao Xie