English
Related papers

Related papers: The Singular Optimality of Distributed Computation…

200 papers

Local SGD is a popular optimization method in distributed learning, often outperforming other algorithms in practice, including mini-batch SGD. Despite this success, theoretically proving the dominance of local SGD in settings with…

We study the problem of computing approximate minimum edge cuts by distributed algorithms. We use a standard synchronous message passing model where in each round, $O(\log n)$ bits can be transmitted over each edge (a.k.a. the CONGEST…

Data Structures and Algorithms · Computer Science 2013-11-21 Mohsen Ghaffari , Fabian Kuhn

We present a near-optimal distributed algorithm for $(1+o(1))$-approximation of single-commodity maximum flow in undirected weighted networks that runs in $(D+ \sqrt{n})\cdot n^{o(1)}$ communication rounds in the \Congest model. Here, $n$…

Data Structures and Algorithms · Computer Science 2015-08-20 Mohsen Ghaffari , Andreas Karrenbauer , Fabian Kuhn , Christoph Lenzen , Boaz Patt-Shamir

In this work, we consider solving a distributed optimization problem in a multi-agent network with multiple clusters. In each cluster, the involved agents cooperatively optimize a separable composite function with a common decision…

Optimization and Control · Mathematics 2022-03-03 Jianzheng Wang , Guoqiang Hu

We study the problem of collective tree exploration in which a team of $k$ mobile agents must collectively visit all nodes of an unknown tree in as few moves as possible. The agents all start from the root and discover adjacent edges as…

Data Structures and Algorithms · Computer Science 2025-07-22 Romain Cosson , Laurent Massoulié

While obtaining optimal algorithms for the most important problems in the LOCAL model has been one of the central goals in the area of distributed algorithms since its infancy, tight complexity bounds are elusive for many problems even when…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-06 Sebastian Brandt , Ananth Narayanan

Distributed Pseudo-tree Optimization Procedure (DPOP) is a well-known message passing algorithm that has been used to provide optimal solutions of Distributed Constraint Optimization Problems (DCOPs) -- a framework that is designed to…

Multiagent Systems · Computer Science 2019-09-17 Mashrur Rashik , Md. Musfiqur Rahman , Md. Mamun-or-Rashid , Md. Mosaddek Khan

Load balancing is among the basic primitives in distributed computing. In this paper, we consider this problem when executed locally on a network with nodes prone to failures. We show that there exist lightweight network topologies that are…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-05 Dariusz R. Kowalski , Jan Olkowski

The minimum degree spanning tree (MDST) problem requires the construction of a spanning tree $T$ for graph $G=(V,E)$ with $n$ vertices, such that the maximum degree $d$ of $T$ is the smallest among all spanning trees of $G$. In this paper,…

Data Structures and Algorithms · Computer Science 2018-06-12 Michael Dinitz , Magnús M. Halldórsson , Calvin Newport

We study the fundamental limits to communication-efficient distributed methods for convex learning and optimization, under different assumptions on the information available to individual machines, and the types of functions considered. We…

Machine Learning · Computer Science 2015-10-29 Yossi Arjevani , Ohad Shamir

Recently, several claims have been made that certain fundamental problems of distributed computing, including Leader Election and Distributed Consensus, begin to admit feasible and efficient solutions when the model of distributed…

Quantum Physics · Physics 2009-03-09 Cyril Gavoille , Adrian Kosowski , Marcin Markiewicz

In the advent of large-scale multi-hop wireless technologies, such as MANET, VANET, iThings, it is of utmost importance to devise efficient distributed protocols to maintain network architecture and provide basic communication tools. One of…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-02-19 Tomasz Jurdzinski , Dariusz R. Kowalski , Tomasz Maciejewski , Grzegorz Stachowiak

Optimal transport (OT) defines a powerful framework to compare probability distributions in a geometrically faithful way. However, the practical impact of OT is still limited because of its computational burden. We propose a new class of…

Optimization and Control · Mathematics 2016-05-30 Genevay Aude , Marco Cuturi , Gabriel Peyré , Francis Bach

We present a deterministic $(1+o(1))$-approximation $(n^{1/2+o(1)}+D^{1+o(1)})$-time algorithm for solving the single-source shortest paths problem on distributed weighted networks (the CONGEST model); here $n$ is the number of nodes in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-20 Monika Henzinger , Sebastian Krinninger , Danupon Nanongkai

Distributed resource allocation is a central task in network systems such as smart grids, water distribution networks, and urban transportation systems. When solving such problems in practice it is often important to have nonasymptotic…

Optimization and Control · Mathematics 2021-03-30 Xuyang Wu , Sindri Magnusson , Mikael Johansson

In this work we introduce a new notion: local mechanisms. These are truthful mechanisms that have an implementation as fast distributed algorithms and non-trivial approximation guarantees. We show how monotone distributed optimisation…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-12 Juho Hirvonen , Sara Ranjbaran

This paper demonstrates the usefulness of distributed local verification of proofs, as a tool for the design of self-stabilizing algorithms.In particular, it introduces a somewhat generalized notion of distributed local proofs, and utilizes…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-25 Amos Korman , Shay Kutten , Toshimitsu Masuzawa

Distributed configuration management is imperative for wireless infrastructureless networks where each node adjusts locally its physical and logical configuration through information exchange with neighbors. Two issues remain open. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-09-12 Sung-eok Jeon , Chunayi Ji

We consider the problem of regularized regression in a network of communication-constrained devices. Each node has local data and objectives, and the goal is for the nodes to optimize a global objective. We develop a distributed…

Optimization and Control · Mathematics 2016-03-22 Neil McGlohon , Stacy Patterson

Minimum-weight cut (min-cut) is a basic measure of a network's connectivity strength. While the min-cut can be computed efficiently in the sequential setting [Karger STOC'96], there was no efficient way for a distributed network to compute…

Data Structures and Algorithms · Computer Science 2020-11-17 Michal Dory , Yuval Efron , Sagnik Mukhopadhyay , Danupon Nanongkai