English
Related papers

Related papers: On Sparsity Awareness in Distributed Computations

200 papers

In this paper, we study distributed stochastic optimization to minimize a sum of smooth and strongly-convex local cost functions over a network of agents, communicating over a strongly-connected graph. Assuming that each agent has access to…

Machine Learning · Computer Science 2019-04-11 Ran Xin , Anit Kumar Sahu , Usman A. Khan , Soummya Kar

We present the first super-linear lower bounds for natural graph problems in the CONGEST model, answering a long-standing open question. Specifically, we show that any exact computation of a minimum vertex cover or a maximum independent set…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-17 Keren Censor-Hillel , Seri Khoury , Ami Paz

Fast training of large machine learning models requires distributed training on AI clusters consisting of thousands of GPUs. The efficiency of distributed training crucially depends on the efficiency of the network interconnecting GPUs in…

Networking and Internet Architecture · Computer Science 2025-06-11 Erfan Nosrati , Majid Ghaderi

We present near-optimal algorithms for detecting small vertex cuts in the CONGEST model of distributed computing. Despite extensive research in this area, our understanding of the vertex connectivity of a graph is still incomplete,…

Data Structures and Algorithms · Computer Science 2023-06-21 Merav Parter , Asaf Petruschka

In this paper we present distributed testing algorithms of graph properties in the CONGEST-model [Censor-Hillel et al. 2016]. We present one-sided error testing algorithms in the general graph model. We first describe a general procedure…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-16 Guy Even , Reut Levi , Moti Medina

We initiate a thorough study of \emph{distributed property testing} -- producing algorithms for the approximation problems of property testing in the CONGEST model. In particular, for the so-called \emph{dense} testing model we emulate…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-03 Keren Censor-Hillel , Eldar Fischer , Gregory Schwartzman , Yadu Vasudev

In this paper, we revisit a well-known distributed projected subgradient algorithm which aims to minimize a sum of cost functions with a common set constraint. In contrast to most of existing results, weight matrices of the time-varying…

Optimization and Control · Mathematics 2021-04-29 Weijian Li , Zihan Chen , Youcheng Lou , Yiguang Hong

Parallel aggregation is a ubiquitous operation in data analytics that is expressed as GROUP BY in SQL, reduce in Hadoop, or segment in TensorFlow. Parallel aggregation starts with an optional local pre-aggregation step and then repartitions…

Databases · Computer Science 2018-11-30 Feilong Liu , Ario Salmasi , Spyros Blanas , Anastasios Sidiropoulos

Motivated by a wide variety of applications, this paper introduces a general class of networks of stochastic loss systems in which congestion renders lost revenue due to customers or jobs being permanently removed from the system. We seek…

Networking and Internet Architecture · Computer Science 2022-05-12 Brendan Patch , Mark S. Squillante , Peter M. Van de Ven

We present improved distributed algorithms for triangle detection and its variants in the CONGEST model. We show that Triangle Detection, Counting, and Enumeration can be solved in $\tilde{O}(n^{1/2})$ rounds. In contrast, the previous…

Data Structures and Algorithms · Computer Science 2018-07-19 Yi-Jun Chang , Seth Pettie , Hengjie Zhang

We develop techniques to prove lower bounds for the BCAST(log n) Broadcast Congested Clique model (a distributed message passing model where in each round, each processor can broadcast an O(log n)-sized message to all other processors). Our…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-21 Lijie Chen , Ofer Grossman

Iterative graph algorithms often compute intermediate values and update them as computation progresses. Updated output values are used as inputs for computations in current or subsequent iterations; hence the number of iterations required…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-05 Mark P. Blanco , Scott McMillan , Tze Meng Low

We present a time-optimal deterministic distributed algorithm for approximating a minimum weight vertex cover in hypergraphs of rank $f$. This problem is equivalent to the Minimum Weight Set Cover problem in which the frequency of every…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-31 Ran Ben-Basat , Guy Even , Ken-ichi Kawarabayashi , Gregory Schwartzman

This paper presents a novel meta algorithm, Partition-Merge (PM), which takes existing centralized algorithms for graph computation and makes them distributed and faster. In a nutshell, PM divides the graph into small subgraphs using our…

Data Structures and Algorithms · Computer Science 2013-09-25 Vincent Blondel , Kyomin Jung , Pushmeet Kohli , Devavrat Shah

The congested clique is a synchronous, message-passing model of distributed computing in which each computational unit (node) in each round can send message of O(log n) bits to each other node of the network, where n is the number of nodes.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-28 Tomasz Jurdzinski , Krzysztof Nowicki

We present a comparative study of the application of a recently introduced heuristic algorithm to the optimization of transport on three major types of complex networks. The algorithm balances network traffic iteratively by minimizing the…

Disordered Systems and Neural Networks · Physics 2007-07-12 Bogdan Danila , Yong Yu , John A. Marsh , Kevin E. Bassler

The distributed subgraph detection asks, for a fixed graph $H$, whether the $n$-node input graph contains $H$ as a subgraph or not. In the standard CONGEST model of distributed computing, the complexity of clique/cycle detection and listing…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-05 François Le Gall , Masayuki Miyamoto

We propose a simple and time-optimal algorithm for property testing a graph for its conductance in the CONGEST model. Our algorithm takes only $O(\log n)$ rounds of communication (which is known to be optimal), and consists of simply…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-12 Tugkan Batu , Amitabh Trehan , Chhaya Trehan

We consider the corner-stone broadcast task with an adaptive adversary that controls a fixed number of $t$ edges in the input communication graph. In this model, the adversary sees the entire communication in the network and the random…

Data Structures and Algorithms · Computer Science 2022-03-29 Yael Hitron , Merav Parter

We study distributed optimization problems over a network when the communication between the nodes is constrained, and so information that is exchanged between the nodes must be quantized. This imperfect communication poses a fundamental…

Optimization and Control · Mathematics 2018-10-30 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg