English
Related papers

Related papers: Sparse Allreduce: Efficient Scalable Communication…

200 papers

We study the realizability of scale free-networks with a given degree sequence, showing that the fraction of realizable sequences undergoes two first-order transitions at the values 0 and 2 of the power-law exponent. We substantiate this…

Physics and Society · Physics 2011-11-04 Charo I. Del Genio , Thilo Gross , Kevin E. Bassler

Optimal paths connecting randomly selected network nodes and fixed routers are studied analytically in the presence of non-linear overlap cost that penalizes congestion. Routing becomes increasingly more difficult as the number of selected…

Disordered Systems and Neural Networks · Physics 2012-05-15 Chi Ho Yeung , David Saad

In an era of unprecedented deluge of (mostly unstructured) data, graphs are proving more and more useful, across the sciences, as a flexible abstraction to capture complex relationships between complex objects. One of the main challenges…

Disordered Systems and Neural Networks · Physics 2016-10-17 Alaa Saade

An All-to-All Comparison problem is where every element of a data set is compared with every other element. This is analogous to projective planes and affine planes where every pair of points share a common line. For large data sets, the…

Combinatorics · Mathematics 2023-08-30 Joanne L. Hall , Wayne Kelly , Yu-Chu Tian

A common approach for designing scalable algorithms for massive data sets is to distribute the computation across, say $k$, machines and process the data using limited communication between them. A particularly appealing framework here is…

Data Structures and Algorithms · Computer Science 2017-05-24 Sepehr Assadi , Sanjeev Khanna

It has been observed that many complex real-world networks have certain properties, such as a high clustering coefficient, a low diameter, and a power-law degree distribution. A network with a power-law degree distribution is known as…

Data Structures and Algorithms · Computer Science 2018-11-27 Ankit Chauhan , Tobias Friedrich , Francesco Quinzan

We propose new mathematical optimization models for generating sparse dynamical graphs, or networks, that can achieve synchronization. The synchronization phenomenon is studied using the Kuramoto model, defined in terms of the adjacency…

Optimization and Control · Mathematics 2020-06-23 Regina S. Burachik , Alexander C. Kalloniatis , C. Yalçın Kaya

We propose a novel, efficient approach for distributed sparse learning in high-dimensions, where observations are randomly partitioned across machines. Computationally, at each round our method only requires the master machine to solve a…

Machine Learning · Statistics 2016-05-26 Jialei Wang , Mladen Kolar , Nathan Srebro , Tong Zhang

Motivated by the increasing need to understand the algorithmic foundations of distributed large-scale graph computations, we study a number of fundamental graph problems in a message-passing model for distributed computing where $k \geq 2$…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-07-07 Gopal Pandurangan , Peter Robinson , Michele Scquizzato

The large size of multiscale, distribution and transmission, power grids hinder fast system-wide estimation and real-time control and optimization of operations. This paper studies graph reduction methods of power grids that are favorable…

Systems and Control · Computer Science 2018-10-05 Colin Grudzien , Deepjyoti Deka , Michael Chertkov , Scott N Backhaus

Spectral sparsification is a technique that is used to reduce the number of non-zero entries in a positive semidefinite matrix with little changes to its spectrum. In particular, the main application of spectral sparsification is to…

Data Structures and Algorithms · Computer Science 2021-04-13 Fabricio Mendoza-Granada , Marcos Villagra

We study the compressive diffusion strategies over distributed networks based on the diffusion implementation and adaptive extraction of the information from the compressed diffusion data. We demonstrate that one can achieve a comparable…

Systems and Control · Computer Science 2015-06-18 Muhammed O. Sayin , Suleyman S. Kozat

Sampling technique has become one of the recent research focuses in the graph-related fields. Most of the existing graph sampling algorithms tend to sample the high degree or low degree nodes in the complex networks because of the…

Social and Information Networks · Computer Science 2018-02-02 Junpeng Zhu , Hui Li , Mei Chen , Zhenyu Dai , Ming Zhu

In this paper we propose a mixture model, SparseMix, for clustering of sparse high dimensional binary data, which connects model-based with centroid-based clustering. Every group is described by a representative and a probability…

Machine Learning · Computer Science 2017-07-12 Marek Śmieja , Krzysztof Hajto , Jacek Tabor

Graph sparsification is a powerful tool to approximate an arbitrary graph and has been used in machine learning over homogeneous graphs. In heterogeneous graphs such as knowledge graphs, however, sparsification has not been systematically…

Machine Learning · Computer Science 2022-11-15 Chandan Chunduru , Chun Jiang Zhu , Blake Gains , Jinbo Bi

Graphical data arises naturally in several modern applications, including but not limited to internet graphs, social networks, genomics and proteomics. The typically large size of graphical data argues for the importance of designing…

Information Theory · Computer Science 2021-07-20 Payam Delgosha , Venkat Anantharam

In distributed optimization for large-scale learning, a major performance limitation comes from the communications between the different entities. When computations are performed by workers on local data while a coordinator machine…

Optimization and Control · Mathematics 2020-06-26 Dmitry Grishchenko , Franck Iutzeler , Jérôme Malick , Massih-Reza Amini

Graph search and sparse data-structure traversal workloads contain challenging irregular memory patterns on global data structures that need to be modified atomically. Distributed processing of these workloads has relied on server threads…

Hardware Architecture · Computer Science 2024-04-23 Marcelo Orenes-Vera , Esin Tureci , David Wentzlaff , Margaret Martonosi

Top-k sparsification has recently been widely used to reduce the communication volume in distributed deep learning. However, due to the Sparse Gradient Accumulation (SGA) dilemma, the performance of top-k sparsification still has…

Machine Learning · Computer Science 2024-02-26 Minjun Zhao , Yichen Yin , Yuren Mao , Qing Liu , Lu Chen , Yunjun Gao

Algorithms for node clustering typically focus on finding homophilous structure in graphs. That is, they find sets of similar nodes with many edges within, rather than across, the clusters. However, graphs often also exhibit heterophilous…

Machine Learning · Computer Science 2023-08-15 Sudhanshu Chanpuriya , Cameron Musco