English

Variable Smoothing for Weakly Convex Composite Functions

Optimization and Control 2021-06-01 v3

Abstract

We study minimization of a structured objective function, being the sum of a smooth function and a composition of a weakly convex function with a linear operator. Applications include image reconstruction problems with regularizers that introduce less bias than the standard convex regularizers. We develop a variable smoothing algorithm, based on the Moreau envelope with a decreasing sequence of smoothing parameters, and prove a complexity of O(ϵ3)\mathcal{O}(\epsilon^{-3}) to achieve an ϵ\epsilon-approximate solution. This bound interpolates between the O(ϵ2)\mathcal{O}(\epsilon^{-2}) bound for the smooth case and the O(ϵ4)\mathcal{O}(\epsilon^{-4}) bound for the subgradient method. Our complexity bound is in line with other works that deal with structured nonsmoothness of weakly convex functions.

Keywords

Cite

@article{arxiv.2003.07612,
  title  = {Variable Smoothing for Weakly Convex Composite Functions},
  author = {Axel Böhm and Stephen J. Wright},
  journal= {arXiv preprint arXiv:2003.07612},
  year   = {2021}
}