English
Related papers

Related papers: Splitting forward-backward penalty scheme for cons…

200 papers

We describe an apparatus for subgradient-following of the optimum of convex problems with variational penalties. In this setting, we receive a sequence $y_i,\ldots,y_n$ and seek a smooth sequence $x_1,\ldots,x_n$. The smooth sequence needs…

Machine Learning · Computer Science 2025-04-11 Kai-Chia Mo , Shai Shalev-Shwartz , Nisæl Shártov

Many problems in science and engineering involve, as part of their solution process, the consideration of a separable function which is the sum of two convex functions, one of them possibly non-smooth. Recently a few works have discussed…

Optimization and Control · Mathematics 2017-03-06 Daniel Reem , Alvaro De Pierro

This paper is devoted to the variational inequality problems. We consider two classes of problems, the first is classical constrained variational inequality and the second is the same problem with functional (inequality type) constraints.…

Optimization and Control · Mathematics 2025-06-04 Mohammad S. Alkousa , Belal A. Alashqar , Fedor S. Stonyakin , Tarek Nabhani , Seydamet S. Ablaev

A sequential piecewise linear programming method is presented where bounded domains of non-convex functions are successively contracted about the solution of a piecewise linear program at each iteration of the algorithm. Although…

Optimization and Control · Mathematics 2020-04-21 James P. L. Tan

We develop two variance-reduced fast operator splitting methods to approximate solutions of a class of generalized equations, covering fundamental problems such as \rvs{minimization}, minimax problems, and variational inequalities as…

Optimization and Control · Mathematics 2025-08-14 Quoc Tran-Dinh

Monotone inclusions have wide applications in solving various convex optimization problems arising in signal and image processing, machine learning, and medical image reconstruction. In this paper, we propose a new splitting algorithm for…

Optimization and Control · Mathematics 2020-09-29 Hui Yu , Chunxiang Zong , Yuchao Tang

In infinite-dimensional Hilbert spaces we device a class of strongly convergent primal-dual schemes for solving variational inequalities defined by a Lipschitz continuous and pseudomonote map. Our novel numerical scheme is based on Tseng's…

Optimization and Control · Mathematics 2019-08-27 Benoit Duvocelle , Dennis Meier , Mathias Staudigl , Phan Tu Vuong

A broad range of inverse problems can be abstracted into the problem of minimizing the sum of several convex functions in a Hilbert space. We propose a proximal decomposition algorithm for solving this problem with an arbitrary number of…

Optimization and Control · Mathematics 2009-11-13 Patrick L. Combettes , Jean-Christophe Pesquet

In this paper, we develop an optimization-based framework for solving coupled forward-backward stochastic differential equations. We introduce an integral-form objective function and prove its equivalence to the error between consecutive…

Optimization and Control · Mathematics 2025-07-22 Yutian Wang , Yuan-Hua Ni , Xun Li

In this paper, based on inertial and Tseng's ideas, we propose two projection-based algorithms to solve a monotone inclusion problem in infinite dimensional Hilbert spaces. Solution theorems of strong convergence are obtained under the…

Optimization and Control · Mathematics 2020-08-31 Bing Tan , Zheng Zhou , Xiaolong Qin

The forward-backward splitting method (FBS) for minimizing a nonsmooth composite function can be interpreted as a (variable-metric) gradient method over a continuously differentiable function which we call forward-backward envelope (FBE).…

Optimization and Control · Mathematics 2019-11-11 Lorenzo Stella , Andreas Themelis , Panagiotis Patrinos

In this paper, we consider a class of nonconvex problems with linear constraints appearing frequently in the area of image processing. We solve this problem by the penalty method and propose the iteratively reweighted alternating…

Optimization and Control · Mathematics 2019-02-13 Tao Sun , Dongsheng Li , Hao Jiang , Zhe Quan

We study variational inequalities which are governed by a strongly monotone and Lipschitz continuous operator $F$ over a closed and convex set $S$. We assume that $S=C\cap A^{-1}(Q)$ is the nonempty solution set of a (multiple-set) split…

Optimization and Control · Mathematics 2019-08-21 Andrzej Cegielski , Aviv Gibali , Simeon Reich , Rafał Zalas

In this paper, we consider the nonlinear constrained optimization problem (NCP) with constraint set $\{x \in \mathcal{X}: c(x) = 0\}$, where $\mathcal{X}$ is a closed convex subset of $\mathbb{R}^n$. We propose an exact penalty approach,…

Optimization and Control · Mathematics 2025-05-06 Nachuan Xiao , Tianyun Tang , Shiwei Wang , Kim-Chuan Toh

We propose stochastic variance reduced algorithms for solving convex-concave saddle point problems, monotone variational inequalities, and monotone inclusions. Our framework applies to extragradient, forward-backward-forward, and…

Optimization and Control · Mathematics 2022-06-14 Ahmet Alacaoglu , Yura Malitsky

Tseng's forward-backward-forward algorithm is a valuable alternative for Korpelevich's extragradient method when solving variational inequalities over a convex and closed set governed by monotone and Lipschitz continuous operators, as it…

Optimization and Control · Mathematics 2020-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Phan Tu Vuong

This paper proposes an improved quasi-Newton penalty decomposition algorithm for the minimization of continuously differentiable functions, possibly nonconvex, over sparse symmetric sets. The method solves a sequence of penalty subproblems…

Optimization and Control · Mathematics 2026-01-21 Ahmad Mousavi , Morteza Kimiaei , Saman Babaie-Kafaki , Vyacheslav Kungurtsev

A Halpern-type relaxed inertial inexact progressive hedging algorithm (PHA) is proposed for solving multi-stage stochastic variational inequalities in general probability spaces. The subproblems in this algorithm are allowed to be…

Optimization and Control · Mathematics 2024-12-10 Jiaxin Chen , Zunjie Huang , Haisen Zhang

We design accelerated algorithms with improved rates for several fundamental classes of optimization problems. Our algorithms all build upon techniques related to the analysis of primal-dual extragradient methods via relative Lipschitzness…

Optimization and Control · Mathematics 2022-02-10 Yujia Jin , Aaron Sidford , Kevin Tian

In this paper, we propose a penalty dual-primal augmented lagrangian method for solving convex minimization problems under linear equality or inequality constraints. The proposed method combines a novel penalty technique with updates the…

Optimization and Control · Mathematics 2023-05-09 Jie Liu , Xiaoqing Ou , Jiawei Chen