English

Splitting forward-backward penalty scheme for constrained variational problems

Optimization and Control 2014-08-06 v1

Abstract

We study a forward backward splitting algorithm that solves the variational inequality \begin{equation*} A x +\nabla \Phi(x)+ N_C (x) \ni 0 \end{equation*} where HH is a real Hilbert space, A:HHA: H\rightrightarrows H is a maximal monotone operator, Φ:HR\Phi: H\to\mathbb{R} is a smooth convex function, and NCN_C is the outward normal cone to a closed convex set CHC\subset H. The constraint set CC is represented as the intersection of the sets of minima of two convex penalization function Ψ1:HR\Psi_1:H\to\mathbb{R} and Ψ2:HR{+}\Psi_2: H\to\mathbb{R}\cup \{+\infty\}. The function Ψ1\Psi_1 is smooth, the function Ψ2\Psi_2 is proper and lower semicontinuous. Given a sequence (βn)(\beta_n) of penalization parameters which tends to infinity, and a sequence of positive time steps (λn)(\lambda_n), the algorithm {x1H,xn+1=(I+λnA+λnβnΨ2)1(xnλnΦ(xn)λnβnΨ1(xn)), n1. \left\{\begin{array}{rcl} x_1 & \in & H,\\ x_{n+1} & = & (I+\lambda_n A+\lambda_n\beta_n\partial\Psi_2)^{-1}(x_n-\lambda_n\nabla\Phi(x_n)-\lambda_n\beta_n\nabla\Psi_1(x_n)),\ n\geq 1. \end{array}\right. performs forward steps on the smooth parts and backward steps on the other parts. Under suitable assumptions, we obtain weak ergodic convergence of the sequence (xn)(x_n) to a solution of the variational inequality. Convergence is strong when either AA is strongly monotone or Φ\Phi is strongly convex. We also obtain weak convergence of the whole sequence (xn)(x_n) when AA is the subdifferential of a proper lower-semicontinuous convex function. This provides a unified setting for several classical and more recent results, in the line of historical research on continuous and discrete gradient-like systems.

Keywords

Cite

@article{arxiv.1408.0974,
  title  = {Splitting forward-backward penalty scheme for constrained variational problems},
  author = {Marc-Olivier Czarnecki and Nahla Noun and Juan Peypouquet},
  journal= {arXiv preprint arXiv:1408.0974},
  year   = {2014}
}
R2 v1 2026-06-22T05:20:46.064Z