English

Private Learning on Networks: Part II

Distributed, Parallel, and Cluster Computing 2017-11-07 v2 Machine Learning Optimization and Control

Abstract

This paper considers a distributed multi-agent optimization problem, with the global objective consisting of the sum of local objective functions of the agents. The agents solve the optimization problem using local computation and communication between adjacent agents in the network. We present two randomized iterative algorithms for distributed optimization. To improve privacy, our algorithms add "structured" randomization to the information exchanged between the agents. We prove deterministic correctness (in every execution) of the proposed algorithms despite the information being perturbed by noise with non-zero mean. We prove that a special case of a proposed algorithm (called function sharing) preserves privacy of individual polynomial objective functions under a suitable connectivity condition on the network topology.

Keywords

Cite

@article{arxiv.1703.09185,
  title  = {Private Learning on Networks: Part II},
  author = {Shripad Gade and Nitin H. Vaidya},
  journal= {arXiv preprint arXiv:1703.09185},
  year   = {2017}
}

Comments

Privacy-Convergence Trade-off added. New simulation results added (Current Version: 5 November 2017. First Version: 27 March 2017. )

R2 v1 2026-06-22T18:58:14.679Z