English
Related papers

Related papers: Message Reduction in the Local Model is a Free Lun…

200 papers

Neighborhood graphs are gaining popularity as a concise data representation in machine learning. However, naive graph construction by pairwise distance calculation takes $O(n^2)$ runtime for $n$ data points and this is prohibitively slow…

Data Structures and Algorithms · Computer Science 2009-04-22 Takeaki Uno , Masashi Sugiyama , Koji Tsuda

We present a distributed self-adjusting algorithm for skip graphs that minimizes the average routing costs between arbitrary communication pairs by performing topological adaptation to the communication pattern. Our algorithm is fully…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-05 Sikder Huq , Sukumar Ghosh

Scalable machine learning over big data is an important problem that is receiving a lot of attention in recent years. On popular distributed environments such as Hadoop running on a cluster of commodity machines, communication costs are…

Machine Learning · Computer Science 2015-03-18 Dhruv Mahajan , Nikunj Agrawal , S. Sathiya Keerthi , S. Sundararajan , Leon Bottou

In this work we introduce the graph-theoretic notion of mendability: for each locally checkable graph problem we can define its mending radius, which captures the idea of how far one needs to modify a partial solution in order to "patch a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-15 Alkida Balliu , Juho Hirvonen , Darya Melnyk , Dennis Olivetti , Joel Rybicki , Jukka Suomela

This paper concerns {\em randomized} leader election in synchronous distributed networks. A distributed leader election algorithm is presented for complete $n$-node networks that runs in O(1) rounds and (with high probability) uses only…

Data Structures and Algorithms · Computer Science 2013-05-16 Shay Kutten , Gopal Pandurangan , David Peleg , Peter Robinson , Amitabh Trehan

Decentralized optimization methods enable on-device training of machine learning models without a central coordinator. In many scenarios communication between devices is energy demanding and time consuming and forms the bottleneck of the…

Optimization and Control · Mathematics 2020-11-04 Dmitry Kovalev , Anastasia Koloskova , Martin Jaggi , Peter Richtarik , Sebastian U. Stich

A natural requirement of many distributed structures is fault-tolerance: after some failures, whatever remains from the structure should still be effective for whatever remains from the network. In this paper we examine spanners of general…

Data Structures and Algorithms · Computer Science 2011-02-01 Michael Dinitz , Robert Krauthgamer

Probabilistic message-passing algorithms are developed for routing transmissions in multi-wavelength optical communication networks, under node and edge-disjoint routing constraints and for various objective functions. Global routing…

Physics and Society · Physics 2022-04-25 Yi-Zhi Xu , Ho Fai Po , Chi Ho Yeung , David Saad

We present the \emph{discrete beeping} communication model, which assumes nodes have minimal knowledge about their environment and severely limited communication capabilities. Specifically, nodes have no information regarding the local or…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-05-17 Alejandro Cornejo , Fabian Kuhn

In recent years the sleeping model came to the focus of researchers. In this model nodes can go into a sleep state in which they spend no energy but at the same time cannot receive or send messages, nor can they perform internal…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-13 Tzalik Maimon

We address the fundamental network design problem of constructing approximate minimum spanners. Our contributions are for the distributed setting, providing both algorithmic and hardness results. Our main hardness result shows that an…

Data Structures and Algorithms · Computer Science 2018-02-12 Keren Censor-Hillel , Michal Dory

In recent work, Ozgur, Leveque, and Tse (2007) obtained a complete scaling characterization of throughput scaling for random extended wireless networks (i.e., $n$ nodes are placed uniformly at random in a square region of area $n$). They…

Information Theory · Computer Science 2016-11-17 Urs Niesen , Piyush Gupta , Devavrat Shah

We study distributed computing of the truncated singular value decomposition problem. We develop an algorithm that we call \texttt{LocalPower} for improving communication efficiency. Specifically, we uniformly partition the dataset among…

Machine Learning · Statistics 2021-06-07 Xiang Li , Shusen Wang , Kun Chen , Zhihua Zhang

In distributed network computing, a variant of the LOCAL model has been recently introduced, referred to as the SLEEPING model. In this model, nodes have the ability to decide on which round they are awake, and on which round they are…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-17 Fabien Dufoulon , Pierre Fraigniaud , Mikaël Rabie , Hening Zheng

The $\mathsf{HYBRID}$ model, introduced in [Augustine et al., SODA '20], provides a theoretical foundation for networks that allow multiple communication modes. The model follows the principles of synchronous message passing, whereas nodes…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-05 Fabian Kuhn , Philipp Schneider

The Gap-Hamming-Distance problem arose in the context of proving space lower bounds for a number of key problems in the data stream model. In this problem, Alice and Bob have to decide whether the Hamming distance between their $n$-bit…

Computational Complexity · Computer Science 2009-02-17 Joshua Brody , Amit Chakrabarti

In the distributed setting, the only existing constructions of \textit{sparse skeletons}, (i.e., subgraphs with $O(n)$ edges) either use randomization or large messages, or require $\Omega(D)$ time, where $D$ is the hop-diameter of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-26 Michael Elkin , Shaked Matar

This paper addresses the cornerstone family of \emph{local problems} in distributed computing, and investigates the curious gap between randomized and deterministic solutions under bandwidth restrictions. Our main contribution is in…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-09 Keren Censor-Hillel , Merav Parter , Gregory Schwartzman

We consider the distributed learning problem where a network of $n$ agents seeks to minimize a global function $F$. Agents have access to $F$ through noisy gradients, and they can locally communicate with their neighbors a network. We study…

Machine Learning · Computer Science 2020-11-09 Tiancheng Qin , S. Rasoul Etesami , César A. Uribe

We give a simple algorithm for maintaining a $n^{o(1)}$-approximate spanner $H$ of a graph $G$ with $n$ vertices as $G$ receives edge updates by reduction to the dynamic All-Pairs Shortest Paths (APSP) problem. Given an initially empty…

Data Structures and Algorithms · Computer Science 2024-08-22 Rasmus Kyng , Simon Meierhans , Gernot Zöcklein