English
Related papers

Related papers: Forward--Backward Splitting with Deviations for Mo…

200 papers

We introduce a framework for quasi-Newton forward--backward splitting algorithms (proximal quasi-Newton methods) with a metric induced by diagonal $\pm$ rank-$r$ symmetric positive definite matrices. This special type of metric allows for a…

Optimization and Control · Mathematics 2018-11-27 Stephen Becker , Jalal Fadili , Peter Ochs

In this paper, we propose an adaptive forward-backward-forward splitting algorithm for finding a zero of a pseudo-monotone operator which is split as a sum of three operators: the first is continuous single-valued, the second is…

Optimization and Control · Mathematics 2025-03-04 Flavia Chorobura , Ion Necoara , Jean-Christophe Pesquet

Proximal splitting algorithms for monotone inclusions (and convex optimization problems) in Hilbert spaces share the common feature to guarantee for the generated sequences in general weak convergence to a solution. In order to achieve…

Optimization and Control · Mathematics 2017-11-21 Radu Ioan Bot , Ernö Robert Csetnek , Dennis Meier

The Chambolle-Pock method, also known as the primal-dual hybrid gradient method, is a standard first-order algorithm for convex-concave saddle-point problems and composite convex optimization involving two proper, lower semicontinuous,…

Optimization and Control · Mathematics 2026-04-09 Manu Upadhyaya

The note contains a direct extension of the Chambolle and Pock convergence proof of the primal-dual hybrid gradient (PDHG) algorithm to the case of monotone inclusions.

Optimization and Control · Mathematics 2023-11-08 Levon Nurbekyan

We study the variable metric forward-backward splitting algorithm for convex minimization problems without the standard assumption of the Lipschitz continuity of the gradient. In this setting, we prove that, by requiring only mild…

Optimization and Control · Mathematics 2017-05-02 Saverio Salzo

We study frugal splitting algorithms with minimal lifting for solving monotone inclusion problems involving sums of maximal monotone and cocoercive operators. Building on a foundational result by Ryu, we fully characterize all methods that…

Optimization and Control · Mathematics 2025-04-16 Anton Åkerman , Enis Chenchene , Pontus Giselsson , Emanuele Naldi

We study the extension of the Chambolle--Pock primal-dual algorithm to nonsmooth optimization problems involving nonlinear operators between function spaces. Local convergence is shown under technical conditions including metric regularity…

Optimization and Control · Mathematics 2017-07-11 Christian Clason , Tuomo Valkonen

Splitting methods have emerged as powerful tools to address complex problems by decomposing them into smaller solvable components. In this work, we develop a general approach to forward-backward splitting methods for solving monotone…

Optimization and Control · Mathematics 2026-04-20 Minh N. Dao , Matthew K. Tam , Thang D. Truong

Variational inequality problems are recognized for their broad applications across various fields including machine learning and operations research. First-order methods have emerged as the standard approach for solving these problems due…

Optimization and Control · Mathematics 2025-03-24 Liang Zhang , Niao He , Michael Muehlebach

In this paper, we propose a reflected forward-backward splitting algorithic framework for finding a zero of the sum of finitely many monotone op-erators, including maximally monotone operators, cocoercive operators, and monotone and…

Optimization and Control · Mathematics 2026-05-19 Haowen Zheng , Yongyu Fu , Qiao-Li Dong , Shuangbao Li

We propose a novel approach to monotone operator splitting based on the notion of a saddle operator. Under investigation is a highly structured multivariate monotone inclusion problem involving a mix of set-valued, cocoercive, and…

Optimization and Control · Mathematics 2021-03-12 Minh N. Bùi , Patrick L. Combettes

We propose and study a novel stochastic inertial primal-dual approach to solve composite optimization problems. These latter problems arise naturally when learning with penalized regularization schemes. Our analysis provide convergence…

Optimization and Control · Mathematics 2015-07-06 Lorenzo Rosasco , Silvia Villa , Bang Cong Vu

We establish the convergence of the forward-backward splitting algorithm based on Bregman distances for the sum of two monotone operators in reflexive Banach spaces. Even in Euclidean spaces, the convergence of this algorithm has so far…

Optimization and Control · Mathematics 2020-09-29 Minh N. Bùi , Patrick L. Combettes

In this paper, we propose a stochastic version of the classical Tseng's forward-backward-forward method with inertial term for solving monotone inclusions given by the sum of a maximal monotone operator and a single-valued monotone operator…

Optimization and Control · Mathematics 2022-02-22 Van Dung Nguyen , Nguyen The Vinh

We propose in this paper a unifying scheme for several algorithms from the literature dedicated to the solving of monotone inclusion problems involving compositions with linear continuous operators in infinite dimensional Hilbert spaces. We…

Optimization and Control · Mathematics 2017-05-08 Radu Ioan Bot , Ernö Robert Csetnek

In this paper, we propose a stochastic forward-backward-forward splitting algorithm and prove its almost sure weak convergence in real separable Hilbert spaces. Applications to composite monotone inclusion and minimization problems are…

Optimization and Control · Mathematics 2015-05-20 Bang Cong Vũ

We introduce and study the convergence properties of a projection-type algorithm for solving the variational inequality problem for point-to-set operators. No monotoni\-city assumption is used in our analysis. The operator defining the…

Optimization and Control · Mathematics 2017-11-29 Regina S. Burachik , R. Díaz Millán

This article introduces a novel approach to learning monotone neural networks through a newly defined penalization loss. The proposed method is particularly effective in solving classes of variational problems, specifically monotone…

Optimization and Control · Mathematics 2025-03-07 Younes Belkouchi , Jean-Christophe Pesquet , Audrey Repetti , Hugues Talbot

This paper presents a modified iterative approach to solve the variational inequality problem using the double inertial technique in the context of a real Hilbert space. Our iterative technique involves a projection onto a generalized…

Functional Analysis · Mathematics 2026-03-19 Watanjeet Singh , Sumit Chandok