English

Approximate Bregman proximal gradient algorithm with variable metric Armijo--Wolfe line search

Optimization and Control 2026-03-23 v2

Abstract

We propose a variant of the approximate Bregman proximal gradient (ABPG) algorithm for minimizing the sum of a smooth nonconvex function and a nonsmooth convex function. ABPG is known to converge globally to a stationary point even when the smooth part of the objective function does not have a globally Lipschitz continuous gradient, and its iterates can often be expressed in closed form. However, ABPG relies on an Armijo line search to guarantee global convergence, which can slow down its practical performance. To address this issue, we propose a variant of ABPG with a variable metric Armijo--Wolfe line search. Under the variable metric Armijo--Wolfe condition, we establish global subsequential convergence of the algorithm. Moreover, assuming the Kurdyka--\L{}ojasiewicz property, we also prove that the algorithm globally converges to a stationary point. Numerical experiments on p\ell_p-regularized least squares problems and nonnegative linear inverse problems demonstrate that the proposed algorithm outperforms existing algorithms.

Keywords

Cite

@article{arxiv.2510.06615,
  title  = {Approximate Bregman proximal gradient algorithm with variable metric Armijo--Wolfe line search},
  author = {Kiwamu Fujiki and Shota Takahashi and Akiko Takeda},
  journal= {arXiv preprint arXiv:2510.06615},
  year   = {2026}
}

Comments

33 pages, 14 figures

R2 v1 2026-07-01T06:23:01.192Z