English
Related papers

Related papers: Time-Message Trade-Offs in Distributed Algorithms

200 papers

We consider the distributed and parallel construction of low-diameter decompositions with strong diameter for (weighted) graphs and (weighted) graphs that can be separated through $k \in \tilde{O}(1)$ shortest paths. This class of graphs…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-02 Jinfeng Dou , Thorsten Götte , Henning Hillebrandt , Christian Scheideler , Julian Werthmann

Twin nodes in a static network capture the idea of being substitutes for each other for maintaining paths of the same length anywhere in the network. In dynamic networks, we model twin nodes over a time-bounded interval, noted…

Data Structures and Algorithms · Computer Science 2024-04-29 Lina Azerouk , Binh-Minh Bui-Xuan , Camille Palisoc , Maria Potop-Butucaru , Massinissa Tighilt

We present a randomized distributed algorithm that in radio networks with collision detection broadcasts a single message in $O(D+\log^2 n)$ time slots, with high probability. In view of the lower-bound $\Omega(D+\log^2 n)$, our algorithm…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-04 Ny Aina Andriambolamalala , Vlady Ravelomanana

We study the distributed minimum spanning tree (MST) problem, a fundamental problem in distributed computing. It is well-known that distributed MST can be solved in $\tilde{O}(D+\sqrt{n})$ rounds in the standard CONGEST model (where $n$ is…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-20 John Augustine , William K. Moses , Gopal Pandurangan

We consider a class of popular distributed non-convex optimization problems, in which agents connected by a network $\mathcal{G}$ collectively optimize a sum of smooth (possibly non-convex) local objective functions. We address the…

Optimization and Control · Mathematics 2020-01-08 Haoran Sun , Mingyi Hong

The aim of this work is to develop a fully-distributed algorithmic framework for training graph convolutional networks (GCNs). The proposed method is able to exploit the meaningful relational structure of the input data, which are collected…

Machine Learning · Computer Science 2022-12-21 Simone Scardapane , Indro Spinelli , Paolo Di Lorenzo

Broadcast networks are often used in modern communication systems. A common broadcast network is a single hop shared media system, where a transmitted message is heard by all neighbors, such as some LAN networks. In this work we consider a…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Israel Cidon , Osnat Mokryn

In this paper, we study the minimum dominating set (MDS) problem and the minimum total dominating set MTDS) problem which have many applications in real world. We propose a new idea to compute approximate MDS and MTDS. Next, we give an…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-16 Sharareh Alipour , Mohammadhadi Salari

Scalable machine learning over big data is an important problem that is receiving a lot of attention in recent years. On popular distributed environments such as Hadoop running on a cluster of commodity machines, communication costs are…

Machine Learning · Computer Science 2015-03-18 Dhruv Mahajan , Nikunj Agrawal , S. Sathiya Keerthi , S. Sundararajan , Leon Bottou

Modern applied optimization problems become more and more complex every day. Due to this fact, distributed algorithms that can speed up the process of solving an optimization problem through parallelization are of great importance. The main…

Optimization and Control · Mathematics 2023-12-14 Svetlana Tkachenko , Artem Andreev , Aleksandr Beznosikov , Alexander Gasnikov

We study the tradeoff between the statistical error and communication cost of distributed statistical estimation problems in high dimensions. In the distributed sparse Gaussian mean estimation problem, each of the $m$ machines receives $n$…

Machine Learning · Computer Science 2016-05-11 Mark Braverman , Ankit Garg , Tengyu Ma , Huy L. Nguyen , David P. Woodruff

This paper considers the problem of distributed optimization over time-varying graphs. For the case of undirected graphs, we introduce a distributed algorithm, referred to as DIGing, based on a combination of a distributed inexact gradient…

Optimization and Control · Mathematics 2017-03-21 Angelia Nedich , Alex Olshevsky , Wei Shi

Inspired by distributed resource allocation problems in dynamic topology networks, we initiate the study of distributed consensus with finite messaging passing. We first find a sufficient condition on the network graph for which no…

Information Theory · Computer Science 2010-07-01 Debashis Dash , Ashutosh Sabharwal

Generalized from the concept of consensus, this paper considers a group of edge agreements, i.e. constraints defined for neighboring agents, in which each pair of neighboring agents is required to satisfy one edge agreement constraint. Edge…

Optimization and Control · Mathematics 2023-12-04 Zehui Lu , Shaoshuai Mou

Consider an n-vertex graph G = (V,E) of maximum degree Delta, and suppose that each vertex v \in V hosts a processor. The processors are allowed to communicate only with their neighbors in G. The communication is synchronous, i.e., it…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-03-09 Leonid Barenboim , Michael Elkin

In this paper, we consider distributed optimization design for resource allocation problems over weight-balanced graphs. With the help of singular perturbation analysis, we propose a simple sub-optimal continuous-time optimization…

Optimization and Control · Mathematics 2022-06-14 Shu Liang , Xianlin Zeng , Yiguang Hong

Constrained submodular set function maximization problems often appear in multi-agent decision-making problems with a discrete feasible set. A prominent example is the problem of multi-agent mobile sensor placement over a discrete domain.…

Optimization and Control · Mathematics 2021-08-02 Navid Rezazadeh , Solmaz S. Kia

The growing demands of remote detection and increasing amount of training data make distributed machine learning under communication constraints a critical issue. This work provides a communication-efficient quantum algorithm that tackles…

Quantum Physics · Physics 2023-04-26 Hao Tang , Boning Li , Guoqing Wang , Haowei Xu , Changhao Li , Ariel Barr , Paola Cappellaro , Ju Li

We observe message-efficient distributed algorithms for the Set Cover problem. Given a ground set $U$ of $n$ elements and $m$ subsets of $U$, we aim to find the minimal number of these subsets that contain all elements. In the default…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-02 Thorsten Götte , Christina Kolb , Christian Scheideler , Julian Werthmann

This paper addresses the cornerstone family of \emph{local problems} in distributed computing, and investigates the curious gap between randomized and deterministic solutions under bandwidth restrictions. Our main contribution is in…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-09 Keren Censor-Hillel , Merav Parter , Gregory Schwartzman