English
Related papers

Related papers: Communication-Efficient Federated Hypergradient Co…

200 papers

Distributed adaptive stochastic gradient methods have been widely used for large-scale nonconvex optimization, such as training deep learning models. However, their communication complexity on finding $\varepsilon$-stationary points has…

Machine Learning · Computer Science 2023-08-25 Congliang Chen , Li Shen , Wei Liu , Zhi-Quan Luo

Federated Averaging (FedAvg) has emerged as the algorithm of choice for federated learning due to its simplicity and low communication cost. However, in spite of recent research efforts, its performance is not fully understood. We obtain…

In distributed learning settings such as federated learning, the training algorithm can be potentially biased towards different clients. Mohri et al. (2019) proposed a domain-agnostic learning algorithm, where the model is optimized for any…

Machine Learning · Computer Science 2021-06-17 Jae Ro , Mingqing Chen , Rajiv Mathews , Mehryar Mohri , Ananda Theertha Suresh

This article proposes a communication-efficient decentralized deep learning algorithm, coined layer-wise federated group ADMM (L-FGADMM). To minimize an empirical risk, every worker in L-FGADMM periodically communicates with two neighbors,…

Machine Learning · Computer Science 2020-07-07 Anis Elgabli , Jihong Park , Sabbir Ahmed , Mehdi Bennis

Distributed stochastic gradient descent (SGD) with gradient compression has become a popular communication-efficient solution for accelerating distributed learning. One commonly used method for gradient compression is Top-K sparsification,…

Machine Learning · Computer Science 2023-09-12 Mengzhe Ruan , Guangfeng Yan , Yuanzhang Xiao , Linqi Song , Weitao Xu

To lower the communication complexity of federated min-max learning, a natural approach is to utilize the idea of infrequent communications (through multiple local updates) same as in conventional federated learning. However, due to the…

Machine Learning · Computer Science 2022-12-27 Haibo Yang , Zhuqing Liu , Xin Zhang , Jia Liu

The exponential growth in model sizes has significantly increased the communication burden in Federated Learning (FL). Existing methods to alleviate this burden by transmitting compressed gradients often face high compression errors, which…

Machine Learning · Computer Science 2025-02-06 Yuhao Zhou , Yuxin Tian , Mingjia Shi , Yuanxi Li , Yanan Sun , Qing Ye , Jiancheng Lv

Edge AI systems increasingly rely on federated learning to train perception models in distributed, privacy-preserving, and resource-constrained environments. Yet, before training begins, practitioners often lack practical tools to estimate…

Machine Learning · Computer Science 2026-03-31 KMA Solaiman , Shafkat Islam , Ruy de Oliveira , Bharat Bhargava

In this paper, a gradient-free distributed algorithm is introduced to solve a set constrained optimization problem under a directed communication network. Specifically, at each time-step, the agents locally compute a so-called…

Optimization and Control · Mathematics 2021-09-06 Yipeng Pang , Guoqiang Hu

Communication-efficient variants of SGD, specifically local SGD, have received a great deal of interest in recent years. These approaches compute multiple gradient steps locally on each worker, before averaging model parameters, helping…

Machine Learning · Computer Science 2025-06-13 Charles-Étienne Joseph , Benjamin Thérien , Abhinav Moudgil , Boris Knyazev , Eugene Belilovsky

Stochastic gradient MCMC methods, such as stochastic gradient Langevin dynamics (SGLD), employ fast but noisy gradient estimates to enable large-scale posterior sampling. Although we can easily extend SGLD to distributed settings, it…

Machine Learning · Statistics 2021-06-16 Khaoula El Mekkaoui , Diego Mesquita , Paul Blomstedt , Samuel Kaski

We introduce ProxSkip -- a surprisingly simple and provably efficient method for minimizing the sum of a smooth ($f$) and an expensive nonsmooth proximable ($\psi$) function. The canonical approach to solving such problems is via the…

Machine Learning · Computer Science 2023-03-27 Konstantin Mishchenko , Grigory Malinovsky , Sebastian Stich , Peter Richtárik

We consider a multi-agent setting with agents exchanging information over a possibly time-varying network, aiming at minimising a separable objective function subject to constraints. To achieve this objective we propose a novel subgradient…

Optimization and Control · Mathematics 2020-11-20 Licio Romao , Kostas Margellos , Giuseppe Notarstefano , Antonis Papachristodoulou

With the increase in the amount of data and the expansion of model scale, distributed parallel training becomes an important and successful technique to address the optimization challenges. Nevertheless, although distributed stochastic…

Machine Learning · Computer Science 2019-09-23 Shuheng Shen , Linli Xu , Jingchang Liu , Xianfeng Liang , Yifei Cheng

Federated learning~(FL) has recently attracted increasing attention from academia and industry, with the ultimate goal of achieving collaborative training under privacy and communication constraints. Existing iterative model averaging based…

Machine Learning · Computer Science 2022-07-21 Yuanhao Xiong , Ruochen Wang , Minhao Cheng , Felix Yu , Cho-Jui Hsieh

The Metaverse, a burgeoning collective virtual space merging augmented reality and persistent virtual worlds, necessitates advanced artificial intelligence (AI) and communication technologies to support immersive and interactive…

Machine Learning · Computer Science 2024-08-27 Yahao Ding , Wen Shang , Minrui Xu , Zhaohui Yang , Ye Hu , Dusit Niyato , Mohammad Shikh-Bahaei

Federated Learning (FL) is a distributed machine learning approach that enables model training in communication efficient and privacy-preserving manner. The standard optimization method in FL is Federated Averaging (FedAvg), which performs…

Machine Learning · Computer Science 2023-09-21 Zeyi Tao , Jindi Wu , Qun Li

Gradient compression with error compensation has attracted significant attention with the target of reducing the heavy communication overhead in distributed learning. However, existing compression methods either perform only unidirectional…

Machine Learning · Computer Science 2024-02-20 Yifei Cheng , Li Shen , Linli Xu , Xun Qian , Shiwei Wu , Yiming Zhou , Tie Zhang , Dacheng Tao , Enhong Chen

Federated optimization studies the problem of collaborative function optimization among multiple clients (e.g. mobile devices or organizations) under the coordination of a central server. Since the data is collected separately by each…

Machine Learning · Computer Science 2023-11-06 Chuanhao Li , Chong Liu , Yu-Xiang Wang

In this paper, we present a communication-efficient federated learning framework inspired by quantized compressed sensing. The presented framework consists of gradient compression for wireless devices and gradient reconstruction for a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-01 Yongjeong Oh , Namyoon Lee , Yo-Seb Jeon , H. Vincent Poor