中文
相关论文

相关论文: Spinner: Scalable Graph Partitioning in the Cloud

200 篇论文

We design and implement a distributed algorithm for balanced $k$-way hypergraph partitioning that minimizes fanout, a fundamental hypergraph quantity also known as the communication volume and ($k-1$)-cut metric, by optimizing a novel…

数据结构与算法 · 计算机科学 2017-07-24 Igor Kabiljo , Brian Karrer , Mayank Pundir , Sergey Pupyrev , Alon Shalita , Alessandro Presta , Yaroslav Akhremtsev

We propose a novel perspective on varied-density clustering for high-dimensional data by framing it as a label propagation process in neighborhood graphs that adapt to local density variations. Our method formally connects density-based…

机器学习 · 计算机科学 2025-08-06 Ninh Pham , Yingtao Zheng , Hugo Phibbs

Graph analysis is a critical component of applications such as online social networks, protein interactions in biological networks, and Internet traffic analysis. The arrival of massive graphs with hundreds of millions of nodes, e.g. social…

社会与信息网络 · 计算机科学 2015-03-19 Xiaohan Zhao , Alessandra Sala , Haitao Zheng , Ben Y. Zhao

Large scale graph processing is a major research area for Big Data exploration. Vertex centric programming models like Pregel are gaining traction due to their simple abstraction that allows for scalable execution on distributed systems…

分布式、并行与集群计算 · 计算机科学 2019-05-10 Yogesh Simmhan , Alok Kumbhare , Charith Wickramaarachchi , Soonil Nagarkar , Santosh Ravi , Cauligi Raghavendra , Viktor Prasanna

Graph partition is a key component to achieve workload balance and reduce job completion time in parallel graph processing systems. Among the various partition strategies, edge partition has demonstrated more promising performance in…

数据结构与算法 · 计算机科学 2020-12-18 Zhenyu Guo , Mingyu Xiao , Yi Zhou , Dongxiang Zhang , Kian-Lee Tan

A common approach to scaling transactional databases in practice is horizontal partitioning, which increases system scalability, high availability and self-manageability. Usu- ally it is very challenging to choose or design an optimal…

数据库 · 计算机科学 2013-09-09 Yu cao , Xiaoyan Guo , Stephen Todd

We study the design of local algorithms for massive graphs. A local algorithm is one that finds a solution containing or near a given vertex without looking at the whole graph. We present a local clustering algorithm. Our algorithm finds a…

数据结构与算法 · 计算机科学 2008-09-19 Daniel A. Spielman , Shang-Hua Teng

Large-scale distributed graph-parallel computing is challenging. On one hand, due to the irregular computation pattern and lack of locality, it is hard to express parallelism efficiently. On the other hand, due to the scale-free nature,…

分布式、并行与集群计算 · 计算机科学 2013-10-22 Jie Yan , Guangming Tan , Ninghui Sun

Graph clustering has many important applications in computing, but due to the increasing sizes of graphs, even traditionally fast clustering methods can be computationally expensive for real-world graphs of interest. Scalability problems…

社会与信息网络 · 计算机科学 2018-10-18 Kimon Fountoulakis , David F. Gleich , Michael W. Mahoney

Massive graphs, such as online social networks and communication networks, have become common today. To efficiently analyze such large graphs, many distributed graph computing systems have been developed. These systems employ the "think…

分布式、并行与集群计算 · 计算机科学 2015-03-03 Da Yan , James Cheng , Yi Lu , Wilfred Ng

Modeling data sharing in GPU programs is a challenging task because of the massive parallelism and complex data sharing patterns provided by GPU architectures. Better GPU caching efficiency can be achieved through careful task scheduling…

分布式、并行与集群计算 · 计算机科学 2016-10-04 Lingda Li , Ari B. Hayes , Stephen A. Hackler , Eddy Z. Zhang , Mario Szegedy , Shuaiwen Leon Song

There has been a recent explosion in the size of stored data, partially due to advances in storage technology, and partially due to the growing popularity of cloud-computing and the vast quantities of data generated. This motivates the need…

数据结构与算法 · 计算机科学 2012-12-06 Isabelle Stanton

Partitioning graphs into blocks of roughly equal size such that few edges run between blocks is a frequently needed operation when processing graphs on a parallel computer. When a topology of a distributed system is known an important task…

Graph similarity computation aims to predict a similarity score between one pair of graphs to facilitate downstream applications, such as finding the most similar chemical compounds similar to a query compound or Fewshot 3D Action…

机器学习 · 计算机科学 2021-01-06 Haoyan Xu , Ziheng Duan , Jie Feng , Runjian Chen , Qianru Zhang , Zhongbin Xu , Yueyang Wang

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

机器学习 · 计算机科学 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

Graph is a ubiquitous structure in many domains. The rapidly increasing data volume calls for efficient and scalable graph data processing. In recent years, designing distributed graph processing systems has been an increasingly important…

分布式、并行与集群计算 · 计算机科学 2020-03-03 Xubo Wang , Lu Qin , Lijun Chang , Ying Zhang , Dong Wen , Xuemin Lin

In the context of multi-domain network slices, multiple domains need to work together to provide a service. The problem of determining which part of the service fits within which domain is referred to as slice partitioning. The partitioning…

网络与互联网体系结构 · 计算机科学 2024-08-29 Zhouxiang Wu , Genya Ishigaki , Riti Gour , Congzhou Li , Divya Khanure , Jason P. Jue

As with general graph processing systems, partitioning data over a cluster of machines improves the scalability of graph database management systems. However, these systems will incur additional network cost during the execution of a query…

数据库 · 计算机科学 2017-11-20 Hugo Firth , Paolo Missier , Jack Aiston

We present a structural clustering algorithm for large-scale datasets of small labeled graphs, utilizing a frequent subgraph sampling strategy. A set of representatives provides an intuitive description of each cluster, supports the…

数据库 · 计算机科学 2016-10-03 Till Schäfer , Petra Mutzel

Distributed algorithms are often beset by the straggler effect, where the slowest compute nodes in the system dictate the overall running time. Coding-theoretic techniques have been recently proposed to mitigate stragglers via algorithmic…

机器学习 · 统计学 2017-11-21 Zachary Charles , Dimitris Papailiopoulos , Jordan Ellenberg