English
Related papers

Related papers: Basis Matters: Better Communication-Efficient Seco…

200 papers

Federated learning (FL) aims to minimize the communication complexity of training a model over heterogeneous data distributed across many clients. A common approach is local methods, where clients take multiple optimization steps over local…

Machine Learning · Computer Science 2023-04-18 Charlie Hou , Kiran K. Thekumparampil , Giulia Fanti , Sewoong Oh

We present a novel Newton-type method for distributed optimization, which is particularly well suited for stochastic optimization and learning problems. For quadratic objectives, the method enjoys a linear rate of convergence which provably…

Machine Learning · Computer Science 2014-05-15 Ohad Shamir , Nathan Srebro , Tong Zhang

Distributed optimization is widely used in large-scale and privacy-preserving machine learning, where each agent stores a local objective and communicates only with its neighbors in a connected network. We study decentralized second-order…

Federated learning is a distributed optimization paradigm that allows training machine learning models across decentralized devices while keeping the data localized. The standard method, FedAvg, suffers from client drift which can hamper…

Machine Learning · Computer Science 2024-04-15 Xiaowen Jiang , Anton Rodomanov , Sebastian U. Stich

Many machine learning models depend on solving a large scale optimization problem. Recently, sub-sampled Newton methods have emerged to attract much attention for optimization due to their efficiency at each iteration, rectified a weakness…

Optimization and Control · Mathematics 2016-09-06 Haishan Ye , Luo Luo , Zhihua Zhang

Due to the rapidly growing scale and heterogeneity of wireless networks, the design of distributed cross-layer optimization algorithms have received significant interest from the networking research community. So far, the standard…

Networking and Internet Architecture · Computer Science 2016-11-18 Jia Liu , Cathy H. Xia , Ness B. Shroff , Hanif D. Sherali

Optimizing smooth convex functions in stochastic settings, where only noisy estimates of gradients and Hessians are available, is a fundamental problem in optimization. While first-order methods possess a low per-iteration cost, their…

Statistics Theory · Mathematics 2026-02-06 Antoine Godichon-Baggioni , Bruno Portier , Guillaume Sallé

We consider distributed optimization problems where networked nodes cooperatively minimize the sum of their locally known convex costs. A popular class of methods to solve these problems are the distributed gradient methods, which are…

Information Theory · Computer Science 2017-02-21 Dragana Bajovic , Dusan Jakovetic , Natasa Krejic , Natasa Krklec Jerinkic

We develop and analyze MARINA: a new communication efficient method for non-convex distributed learning over heterogeneous datasets. MARINA employs a novel communication compression strategy based on the compression of gradient differences…

Machine Learning · Computer Science 2022-01-11 Eduard Gorbunov , Konstantin Burlachenko , Zhize Li , Peter Richtárik

Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for…

Machine Learning · Computer Science 2021-12-14 Laizhong Cui , Xiaoxin Su , Yipeng Zhou , Jiangchuan Liu

Optimizing distributed learning systems is an art of balancing between computation and communication. There have been two lines of research that try to deal with slower networks: {\em communication compression} for low bandwidth networks,…

Machine Learning · Computer Science 2019-02-04 Hanlin Tang , Shaoduo Gan , Ce Zhang , Tong Zhang , Ji Liu

Compression of Neural Networks (NN) has become a highly studied topic in recent years. The main reason for this is the demand for industrial scale usage of NNs such as deploying them on mobile devices, storing them efficiently, transmitting…

Machine Learning · Statistics 2017-12-08 Marco Federici , Karen Ullrich , Max Welling

Communication overhead severely hinders the scalability of distributed machine learning systems. Recently, there has been a growing interest in using gradient compression to reduce the communication overhead of the distributed training.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-19 Yuchen Zhong , Cong Xie , Shuai Zheng , Haibin Lin

Bilevel optimization, crucial for hyperparameter tuning, meta-learning and reinforcement learning, remains less explored in the decentralized learning paradigm, such as decentralized federated learning (DFL). Typically, decentralized…

Machine Learning · Computer Science 2024-10-21 Min Wen , Chengchang Liu , Ahmed Abdelmoniem , Yipeng Zhou , Yuedong Xu

We study the problem of distributed cooperative learning, where a group of agents seeks to agree on a set of hypotheses that best describes a sequence of private observations. In the scenario where the set of hypotheses is large, we propose…

Machine Learning · Computer Science 2021-09-22 Mohammad Taha Toghani , César A. Uribe

Federated Learning (FL) is an increasingly popular machine learning paradigm in which multiple nodes try to collaboratively learn under privacy, communication and multiple heterogeneity constraints. A persistent problem in federated…

Machine Learning · Computer Science 2022-02-24 Elnur Gasanov , Ahmed Khaled , Samuel Horváth , Peter Richtárik

We explore a scheme that enables the training of a deep neural network in a Federated Learning configuration over an additive white Gaussian noise channel. The goal is to create a low complexity, linear compression strategy, called…

Information Theory · Computer Science 2023-01-25 Michail Gkagkos , Krishna R. Narayanan , Jean-Francois Chamberland , Costas N. Georghiades

Federated learning (FL) is a distributed method to train a global model over a set of local clients while keeping data localized. It reduces the risks of privacy and security but faces important challenges including expensive communication…

Machine Learning · Computer Science 2022-10-07 Seonhyeong Kim , Jiheon Woo , Daewon Seo , Yongjune Kim

Federated learning (FL) is a decentralized machine learning paradigm in which multiple clients collaboratively train a global model by exchanging only model updates with the central server without sharing the local data of the clients. Due…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Jonas Klotz , Barış Büyüktaş , Begüm Demir

Communication overhead is a known bottleneck in federated learning (FL). To address this, lossy compression is commonly used on the information communicated between the server and clients during training. In horizontal FL, where each client…

Machine Learning · Computer Science 2025-02-25 Pedro Valdeira , João Xavier , Cláudia Soares , Yuejie Chi
‹ Prev 1 3 4 5 6 7 10 Next ›