English

Linear Convergence of Distributed Mirror Descent with Integral Feedback for Strongly Convex Problems

Optimization and Control 2020-11-25 v1 Machine Learning Systems and Control Systems and Control

Abstract

Distributed optimization often requires finding the minimum of a global objective function written as a sum of local functions. A group of agents work collectively to minimize the global function. We study a continuous-time decentralized mirror descent algorithm that uses purely local gradient information to converge to the global optimal solution. The algorithm enforces consensus among agents using the idea of integral feedback. Recently, Sun and Shahrampour (2020) studied the asymptotic convergence of this algorithm for when the global function is strongly convex but local functions are convex. Using control theory tools, in this work, we prove that the algorithm indeed achieves (local) exponential convergence. We also provide a numerical experiment on a real data-set as a validation of the convergence speed of our algorithm.

Keywords

Cite

@article{arxiv.2011.12233,
  title  = {Linear Convergence of Distributed Mirror Descent with Integral Feedback for Strongly Convex Problems},
  author = {Youbang Sun and Shahin Shahrampour},
  journal= {arXiv preprint arXiv:2011.12233},
  year   = {2020}
}

Comments

12 pages, 1 figure

R2 v1 2026-06-23T20:28:55.024Z