English

On Randomized Distributed Coordinate Descent with Quantized Updates

Machine Learning 2017-01-23 v2 Machine Learning

Abstract

In this paper, we study the randomized distributed coordinate descent algorithm with quantized updates. In the literature, the iteration complexity of the randomized distributed coordinate descent algorithm has been characterized under the assumption that machines can exchange updates with an infinite precision. We consider a practical scenario in which the messages exchange occurs over channels with finite capacity, and hence the updates have to be quantized. We derive sufficient conditions on the quantization error such that the algorithm with quantized update still converge. We further verify our theoretical results by running an experiment, where we apply the algorithm with quantized updates to solve a linear regression problem.

Keywords

Cite

@article{arxiv.1609.05539,
  title  = {On Randomized Distributed Coordinate Descent with Quantized Updates},
  author = {Mostafa El Gamal and Lifeng Lai},
  journal= {arXiv preprint arXiv:1609.05539},
  year   = {2017}
}

Comments

Accepted at CISS 2017

R2 v1 2026-06-22T15:53:33.668Z