English

QUIC-FL: Quick Unbiased Compression for Federated Learning

Machine Learning 2023-06-13 v4 Artificial Intelligence Data Structures and Algorithms Networking and Internet Architecture

Abstract

Distributed Mean Estimation (DME), in which nn clients communicate vectors to a parameter server that estimates their average, is a fundamental building block in communication-efficient federated learning. In this paper, we improve on previous DME techniques that achieve the optimal O(1/n)O(1/n) Normalized Mean Squared Error (NMSE) guarantee by asymptotically improving the complexity for either encoding or decoding (or both). To achieve this, we formalize the problem in a novel way that allows us to use off-the-shelf mathematical solvers to design the quantization.

Keywords

Cite

@article{arxiv.2205.13341,
  title  = {QUIC-FL: Quick Unbiased Compression for Federated Learning},
  author = {Ran Ben Basat and Shay Vargaftik and Amit Portnoy and Gil Einziger and Yaniv Ben-Itzhak and Michael Mitzenmacher},
  journal= {arXiv preprint arXiv:2205.13341},
  year   = {2023}
}
R2 v1 2026-06-24T11:29:35.681Z