English

On reducing the communication cost of the diffusion LMS algorithm

Machine Learning 2018-09-21 v2 Machine Learning Optimization and Control

Abstract

The rise of digital and mobile communications has recently made the world more connected and networked, resulting in an unprecedented volume of data flowing between sources, data centers, or processes. While these data may be processed in a centralized manner, it is often more suitable to consider distributed strategies such as diffusion as they are scalable and can handle large amounts of data by distributing tasks over networked agents. Although it is relatively simple to implement diffusion strategies over a cluster, it appears to be challenging to deploy them in an ad-hoc network with limited energy budget for communication. In this paper, we introduce a diffusion LMS strategy that significantly reduces communication costs without compromising the performance. Then, we analyze the proposed algorithm in the mean and mean-square sense. Next, we conduct numerical experiments to confirm the theoretical findings. Finally, we perform large scale simulations to test the algorithm efficiency in a scenario where energy is limited.

Keywords

Cite

@article{arxiv.1711.11423,
  title  = {On reducing the communication cost of the diffusion LMS algorithm},
  author = {Ibrahim El Khalil Harrane and Rémi Flamary and Cédric Richard},
  journal= {arXiv preprint arXiv:1711.11423},
  year   = {2018}
}
R2 v1 2026-06-22T23:02:27.593Z