English

Single-Forward-Step Projective Splitting: Exploiting Cocoercivity

Optimization and Control 2020-08-24 v3 Machine Learning

Abstract

This work describes a new variant of projective splitting for solving maximal monotone inclusions and complicated convex optimization problems. In the new version, cocoercive operators can be processed with a single forward step per iteration. In the convex optimization context, cocoercivity is equivalent to Lipschitz differentiability. Prior forward-step versions of projective splitting did not fully exploit cocoercivity and required two forward steps per iteration for such operators. Our new single-forward-step method establishes a symmetry between projective splitting algorithms, the classical forward-backward splitting method (FB), and Tseng's forward-backward-forward method (FBF). The new procedure allows for larger stepsizes for cocoercive operators: the stepsize bound is 2β2\beta for a β\beta-cocoercive operator, the same bound as has been established for FB. We show that FB corresponds to an unattainable boundary case of the parameters in the new procedure. Unlike FB, the new method allows for a backtracking procedure when the cocoercivity constant is unknown. Proving convergence of the algorithm requires some departures from the prior proof framework for projective splitting. We close with some computational tests establishing competitive performance for the method.

Keywords

Cite

@article{arxiv.1902.09025,
  title  = {Single-Forward-Step Projective Splitting: Exploiting Cocoercivity},
  author = {Patrick R. Johnstone and Jonathan Eckstein},
  journal= {arXiv preprint arXiv:1902.09025},
  year   = {2020}
}

Comments

Updated Numerical Experiments

R2 v1 2026-06-23T07:49:24.350Z