English
Related papers

Related papers: Locality, Not Spectral Mixing, Governs Direct Prop…

200 papers

Gossip algorithms spread information by having nodes repeatedly forward information to a few random contacts. By their very nature, gossip algorithms tend to be distributed and fault tolerant. If done right, they can also be fast and…

Data Structures and Algorithms · Computer Science 2014-02-13 Bernhard Haeupler , Dahlia Malkhi

Motivated by the increasing need to understand the distributed algorithmic foundations of large-scale graph computations, we study some fundamental graph problems in a message-passing model for distributed computing where $k \geq 2$…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-27 Gopal Pandurangan , Peter Robinson , Michele Scquizzato

In this paper we present various distributed algorithms for LP-type problems in the well-known gossip model. LP-type problems include many important classes of problems such as (integer) linear programming, geometric problems like smallest…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-25 Kristian Hinnenthal , Christian Scheideler , Martijn Struijs

Communication overhead is one of the key challenges that hinders the scalability of distributed optimization algorithms. In this paper, we study local distributed SGD, where data is partitioned among computation nodes, and the computation…

Machine Learning · Computer Science 2020-05-15 Farzin Haddadpour , Mohammad Mahdi Kamani , Mehrdad Mahdavi , Viveck R. Cadambe

This paper presents a study on data dissemination in unstructured Peer-to-Peer (P2P) network overlays. The absence of a structure in unstructured overlays eases the network management, at the cost of non-optimal mechanisms to spread…

Networking and Internet Architecture · Computer Science 2016-09-27 Gabriele D'Angelo , Stefano Ferretti

One of the central models in distributed computing is Linial's LOCAL model [SIAM J. Comp. 1992]. Over time, researchers have studied distributed graph problems in the LOCAL model under slightly different assumptions, such as whether nodes…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-14 Alkida Balliu , Sebastian Brandt , Fabian Kuhn , Dennis Olivetti , Timothé Picavet , Gustav Schmid

Broadcasting algorithms are important building blocks of distributed systems. In this work we investigate the typical performance of the classical and well-studied push model. Assume that initially one node in a given network holds some…

Combinatorics · Mathematics 2010-02-19 Nikolaos Fountoulakis , Konstantinos Panagiotou

We develop a general deterministic distributed method for locally rounding fractional solutions of graph problems for which the analysis can be broken down into analyzing pairs of vertices. Roughly speaking, the method can transform…

Data Structures and Algorithms · Computer Science 2022-09-26 Salwa Faour , Mohsen Ghaffari , Christoph Grunau , Fabian Kuhn , Václav Rozhoň

Randomized gossip is one of the most popular way of disseminating information in large scale networks. This method is appreciated for its simplicity, robustness, and efficiency. In the "push" protocol, every informed node selects, at every…

Aggregation is an important building block of modern distributed applications, allowing the determination of meaningful properties (e.g. network size, total storage capacity, average load, majorities, etc.) that are used to direct the…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-12-01 Paulo Jesus , Carlos Baquero , Paulo Sérgio Almeida

A number of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov random field. Belief propagation, an iterative message-passing algorithm, computes exactly such…

Machine Learning · Statistics 2012-10-23 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner

We study gossip algorithms for the rumor spreading problem which asks one node to deliver a rumor to all nodes in an unknown network. We present the first protocol for any expander graph $G$ with $n$ nodes such that, the protocol informs…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-14 Zeyu Guo , He Sun

We connect three distinct lines of research that have recently explored extensions of the classical LOCAL model of distributed computing: A. distributed quantum computing and non-signaling distributions [e.g. STOC 2024], B.…

In this paper, we study the problem of minimizing a sum of smooth and strongly convex functions split over the nodes of a network in a decentralized fashion. We propose the algorithm $ESDACD$, a decentralized accelerated algorithm that only…

Optimization and Control · Mathematics 2019-02-25 Hadrien Hendrikx , Francis Bach , Laurent Massoulié

A standard model in network synchronised distributed computing is the LOCAL model. In this model, the processors work in rounds and, in the classic setting, they know the number of vertices of the network, $n$. Using $n$, they can compute…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-20 Laurent Feuilloley

We focus on the well-studied problem of distributed overlay network construction. We consider a synchronous gossip-based communication model where in each round a node can send a message of small size to another node whose identifier it…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Fabien Dufoulon , Michael Moorman , William K. Moses , Gopal Pandurangan

Consider a distributed coding for computing problem with constant decoding locality, i.e., with a vanishing error probability, any single sample of the function can be approximately recovered by probing only constant number of compressed…

Information Theory · Computer Science 2024-03-01 Deheng Yuan , Tao Guo , Zhongyi Huang , Shi Jin

This paper studies distributed stochastic approximation algorithms based on broadcast gossip on communication networks represented by digraphs. Weak convergence of these algorithms is proved, and an associated ordinary differential equation…

Applications · Statistics 2016-09-05 Miloš S. Stanković , Nemanja Ilić , Srdjan S. Stanković

Gossip and in particular network coded algebraic gossip have recently attracted attention as a fast, bandwidth-efficient, reliable and distributed way to broadcast or multicast multiple messages. While the algorithms are simple, involved…

Data Structures and Algorithms · Computer Science 2012-06-01 Bernhard Haeupler

Distributed configuration management is imperative for wireless infrastructureless networks where each node adjusts locally its physical and logical configuration through information exchange with neighbors. Two issues remain open. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-09-12 Sung-eok Jeon , Chunayi Ji