English

A variable smoothing algorithm for solving convex optimization problems

Optimization and Control 2012-07-16 v1 Numerical Analysis

Abstract

In this article we propose a method for solving unconstrained optimization problems with convex and Lipschitz continuous objective functions. By making use of the Moreau envelopes of the functions occurring in the objective, we smooth the latter to a convex and differentiable function with Lipschitz continuous gradient by using both variable and constant smoothing parameters. The resulting problem is solved via an accelerated first-order method and this allows us to recover approximately the optimal solutions to the initial optimization problem with a rate of convergence of order \O(lnkk)\O(\tfrac{\ln k}{k}) for variable smoothing and of order \O(1k)\O(\tfrac{1}{k}) for constant smoothing. Some numerical experiments employing the variable smoothing method in image processing and in supervised learning classification are also presented.

Keywords

Cite

@article{arxiv.1207.3254,
  title  = {A variable smoothing algorithm for solving convex optimization problems},
  author = {Radu Ioan Bot and Christopher Hendrich},
  journal= {arXiv preprint arXiv:1207.3254},
  year   = {2012}
}

Comments

23 pages

R2 v1 2026-06-21T21:35:13.505Z