English
Related papers

Related papers: Communication Optimality Trade-offs For Distribute…

200 papers

There is growing interest in large-scale machine learning and optimization over decentralized networks, e.g. in the context of multi-agent learning and federated learning. Due to the imminent need to alleviate the communication burden, the…

Machine Learning · Statistics 2020-09-02 Boyue Li , Shicong Cen , Yuxin Chen , Yuejie Chi

In this paper, a distributed convex optimization algorithm, termed \emph{distributed coordinate dual averaging} (DCDA) algorithm, is proposed. The DCDA algorithm addresses the scenario of a large distributed optimization problem with…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-31 Milind Rao , Stefano Rini , Andrea Goldsmith

Distributed graph algorithms that separately optimize for either the number of rounds used or the total number of messages sent have been studied extensively. However, algorithms simultaneously efficient with respect to both measures have…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-18 Bernhard Haeupler , D. Ellis Hershkowitz , David Wajc

We introduce a reduced-communication distributed optimization scheme based on estimating the solution to a proximal minimization problem. Our proposed setup involves a group of agents coordinated by a central entity, altogether operating in…

Optimization and Control · Mathematics 2018-07-10 Giorgos Stathopoulos , Colin N. Jones

Gradient coding allows a master node to derive the aggregate of the partial gradients, calculated by some worker nodes over the local data sets, with minimum communication cost, and in the presence of stragglers. In this paper, for gradient…

Information Theory · Computer Science 2021-03-03 Tayyebeh Jahani-Nezhad , Mohammad Ali Maddah-Ali

We study distributed optimization algorithms for minimizing the average of convex functions. The applications include empirical risk minimization problems in statistical machine learning where the datasets are large and have to be stored on…

Optimization and Control · Mathematics 2016-01-07 Jason D. Lee , Qihang Lin , Tengyu Ma , Tianbao Yang

We study the problem of distributed mean estimation and optimization under communication constraints. We propose a correlated quantization protocol whose leading term in the error guarantee depends on the mean deviation of data points…

Machine Learning · Computer Science 2022-07-12 Ananda Theertha Suresh , Ziteng Sun , Jae Hun Ro , Felix Yu

In this paper, we study distributed stochastic optimization to minimize a sum of smooth and strongly-convex local cost functions over a network of agents, communicating over a strongly-connected graph. Assuming that each agent has access to…

Machine Learning · Computer Science 2019-04-11 Ran Xin , Anit Kumar Sahu , Usman A. Khan , Soummya Kar

We present DUAL-LOCO, a communication-efficient algorithm for distributed statistical estimation. DUAL-LOCO assumes that the data is distributed according to the features rather than the samples. It requires only a single round of…

Machine Learning · Statistics 2016-08-04 Christina Heinze , Brian McWilliams , Nicolai Meinshausen

Federated optimization, wherein several agents in a network collaborate with a central server to achieve optimal social cost over the network with no requirement for exchanging information among agents, has attracted significant interest…

Multiagent Systems · Computer Science 2023-10-23 Syed Eqbal Alam , Dhirendra Shukla , Shrisha Rao

In this work we consider the HYBRID model of distributed computing, introduced recently by Augustine, Hinnenthal, Kuhn, Scheideler, and Schneider (SODA 2020), where nodes have access to two different communication modes: high-bandwidth…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-20 Yi-Jun Chang , Oren Hecht , Dean Leitersdorf , Philipp Schneider

We consider the problem of computing compact routing tables for a (weighted) planar graph $G:= (V, E,w)$ in the PRAM, CONGEST, and the novel HYBRID communication model. We present algorithms with polylogarithmic work and communication that…

Data Structures and Algorithms · Computer Science 2023-05-15 Jinfeng Dou , Thorsten Götte , Henning Hillebrandt , Christian Scheideler , Julian Werthmann

Motivated by the increasing need to understand the algorithmic foundations of distributed large-scale graph computations, we study a number of fundamental graph problems in a message-passing model for distributed computing where $k \geq 2$…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-07-07 Gopal Pandurangan , Peter Robinson , Michele Scquizzato

Communication remains the most significant bottleneck in the performance of distributed optimization algorithms for large-scale machine learning. In this paper, we propose a communication-efficient framework, CoCoA, that uses local…

This paper addresses distributed stochastic optimization problems under non-i.i.d. data, focusing on the inherent trade-offs between communication and computational efficiency. To this end, we propose FlexGT, a flexible snapshot gradient…

Optimization and Control · Mathematics 2026-02-17 Yan Huang , Jinming Xu , Li Chai , Jiming Chen , Karl H. Johansson

This paper introduces a modeling framework for distributed regression with agents/experts observing attribute-distributed data (heterogeneous data). Under this model, a new algorithm, the iterative covariance optimization algorithm (ICOA),…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-07-30 Haipeng Zheng , Sanjeev R. Kulkarni , H. Vincent Poor

While distributed training is often viewed as a solution to optimizing linear models on increasingly large datasets, inter-machine communication costs of popular distributed approaches can dominate as data dimensionality increases. Recent…

Machine Learning · Computer Science 2024-06-05 Fred Lu , Ryan R. Curtin , Edward Raff , Francis Ferraro , James Holt

This work is concerned with the problem of distributed resource allocation in continuous-time setting but with discrete-time communication over infinitely jointly connected and balanced digraphs. We provide a passivity-based perspective for…

Multiagent Systems · Computer Science 2021-01-18 Lanlan Su , Mengmou Li , Vijay Gupta , Graziano Chesi

We consider centralized distributed optimization in the classical federated learning setup, where $n$ workers jointly find an $\varepsilon$-stationary point of an $L$-smooth, $d$-dimensional nonconvex function $f$, having access only to…

Optimization and Control · Mathematics 2026-03-31 Alexander Tyurin

In this paper, we study unconstrained distributed optimization strongly convex problems, in which the exchange of information in the network is captured by a directed graph topology over digital channels that have limited capacity (and…

Systems and Control · Electrical Eng. & Systems 2023-09-12 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson