English

Alternating Minimization Methods for Strongly Convex Optimization

Optimization and Control 2020-06-30 v2

Abstract

{We consider alternating minimization procedures for convex optimization problems with variable divided in many block, each block being amenable for minimization with respect to its variable with freezed other variables blocks. In the case of two blocks, we prove a linear convergence rate for alternating minimization procedure under Polyak-Lojasiewicz condition, which can be seen as a relaxation of the strong convexity assumption. Under strong convexity assumption in many-blocks setting we provide an accelerated alternating minimization procedure with linear rate depending on the square root of the condition number as opposed to condition number for the non-accelerated method. We also mention an approximating non-negative solution to a linear system of equations Ax=yAx=y with alternating minimization of Kullback-Leibler (KL) divergence between AxAx and yy.

Keywords

Cite

@article{arxiv.1911.08987,
  title  = {Alternating Minimization Methods for Strongly Convex Optimization},
  author = {Nazarii Tupitsa and Pavel Dvurechensky and Alexander Gasnikov and Sergey Guminov},
  journal= {arXiv preprint arXiv:1911.08987},
  year   = {2020}
}

Comments

1 figures

R2 v1 2026-06-23T12:22:25.815Z