English
Related papers

Related papers: On Communication Cost of Distributed Statistical E…

200 papers

We consider the communication complexity of a number of distributed optimization problems. We start with the problem of solving a linear system. Suppose there is a coordinator together with $s$ servers $P_1, \ldots, P_s$, the $i$-th of…

Data Structures and Algorithms · Computer Science 2019-11-01 Santosh S. Vempala , Ruosong Wang , David P. Woodruff

This paper proposes a new distributed nonconvex stochastic optimization algorithm that can achieve privacy protection, communication efficiency and convergence simultaneously. Specifically, each node adds general privacy noises to its local…

Systems and Control · Electrical Eng. & Systems 2025-08-06 Jialong Chen , Jimin Wang , Ji-Feng Zhang

In this article, we focus on the parallel communication cost of multiplying the same vector along two modes of a $3$-dimensional symmetric tensor. This is a key computation in the higher-order power method for determining eigenpairs of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-19 Hussam Al Daas , Grey Ballard , Laura Grigori , Suraj Kumar , Kathryn Rouse , Mathieu Vérité

We study distributed optimization algorithms for minimizing the average of convex functions. The applications include empirical risk minimization problems in statistical machine learning where the datasets are large and have to be stored on…

Optimization and Control · Mathematics 2016-01-07 Jason D. Lee , Qihang Lin , Tengyu Ma , Tianbao Yang

Nowadays, large and complex deep learning (DL) models are increasingly trained in a distributed manner across multiple worker machines, in which extensive communications between workers pose serious scaling problems. In this article, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-10 Shaohuai Shi , Zhenheng Tang , Xiaowen Chu , Chengjian Liu , Wei Wang , Bo Li

We consider distributed convex optimization problems originated from sample average approximation of stochastic optimization, or empirical risk minimization in machine learning. We assume that each machine in the distributed computing…

Optimization and Control · Mathematics 2015-01-05 Yuchen Zhang , Lin Xiao

Distributed online convex optimization (D-OCO) is a powerful paradigm for modeling distributed scenarios with streaming data. However, the communication cost between local learners and the central server is substantial in large-scale…

Machine Learning · Computer Science 2026-04-13 Sifan Yang , Dan-Yue Li , Lijun Zhang

In this paper we study the data exchange problem where a set of users is interested in gaining access to a common file, but where each has only partial knowledge about it as side-information. Assuming that the file is broken into packets,…

Information Theory · Computer Science 2015-02-24 Nebojsa Milosavljevic , Sameer Pawar , Salim El Rouayheb , Michael Gastpar , Kannan Ramchandran

Let $G$ be a connected graph on $n$ vertices and $C$ be an $(n,k,d)$ code with $d\ge 2$, defined on the alphabet set $\{0,1\}^m$. Suppose that for $1\le i\le n$, the $i$-th vertex of $G$ holds an input symbol $x_i\in\{0,1\}^m$ and let…

Information Theory · Computer Science 2020-04-06 Chong Shangguan , Itzhak Tamo

A communication network is a graph in which each node has only local information about the graph and nodes communicate by passing messages along its edges. Here, we consider the {\it geometric communication network} where the nodes also…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-29 Sima Hajiaghaei Shanjani , Valerie King

We study a novel setting in offline reinforcement learning (RL) where a number of distributed machines jointly cooperate to solve the problem but only one single round of communication is allowed and there is a budget constraint on the…

Machine Learning · Statistics 2022-02-11 Juliusz Krysztof Ziomek , Jun Wang , Yaodong Yang

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iteration, worker machines…

Optimization and Control · Mathematics 2020-07-15 Jineng Ren , Jarvis Haupt

The nearest lattice point problem in $\mathbb{R}^n$ is formulated in a distributed network with $n$ nodes. The objective is to minimize the probability that an incorrect lattice point is found, subject to a constraint on inter-node…

Information Theory · Computer Science 2024-09-17 V. A. Vaishampayan , M. F. Bollauf

The growing demands of remote detection and increasing amount of training data make distributed machine learning under communication constraints a critical issue. This work provides a communication-efficient quantum algorithm that tackles…

Quantum Physics · Physics 2023-04-26 Hao Tang , Boning Li , Guoqing Wang , Haowei Xu , Changhao Li , Ariel Barr , Paola Cappellaro , Ju Li

We consider the problem of PAC-learning from distributed data and analyze fundamental communication complexity questions involved. We provide general upper and lower bounds on the amount of communication needed to learn well, showing that…

Machine Learning · Computer Science 2012-05-28 Maria-Florina Balcan , Avrim Blum , Shai Fine , Yishay Mansour

Inspired by the great success of machine learning in the past decade, people have been thinking about the possibility of improving the theoretical results by exploring data distribution. In this paper, we revisit a fundamental problem…

Data Structures and Algorithms · Computer Science 2020-06-24 Hao Wu , Junhao Gan , Rui Zhang

Distributed learning and adaptation have received significant interest and found wide-ranging applications in machine learning and signal processing. While various approaches, such as shared-memory optimization, multi-task learning, and…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Pourya Behmandpoor , Marc Moonen , Panagiotis Patrinos

Distributed Mean Estimation (DME) is a central building block in federated learning, where clients send local gradients to a parameter server for averaging and updating the model. Due to communication constraints, clients often use lossy…

Machine Learning · Computer Science 2022-06-16 Shay Vargaftik , Ran Ben Basat , Amit Portnoy , Gal Mendelson , Yaniv Ben-Itzhak , Michael Mitzenmacher

Motivated by distributed statistical learning over uncertain communication networks, we study distributed stochastic optimization by networked nodes to cooperatively minimize a sum of convex cost functions. The network is modeled by a…

Systems and Control · Electrical Eng. & Systems 2025-01-03 Yan Chen , Alexander L. Fradkov , Keli Fu , Xiaozheng Fu , Tao Li

We consider the federated frequency estimation problem, where each user holds a private item $X_i$ from a size-$d$ domain and a server aims to estimate the empirical frequency (i.e., histogram) of $n$ items with $n \ll d$. Without any…

Information Theory · Computer Science 2022-11-21 Wei-Ning Chen , Ayfer Özgür , Graham Cormode , Akash Bharadwaj