English
Related papers

Related papers: Nonlinear Forward-Backward Splitting with Momentum…

200 papers

We propose a forward-backward splitting dynamical system for solving inclusion problems of the form $0\in A(x)+B(x)$ in Hilbert spaces, where $A$ is a maximal operator and $B$ is a single-valued operator. Involved operators are assumed to…

Optimization and Control · Mathematics 2024-07-12 Nam V Tran , Hai T. T. Le , An V. Truong , Vuong T. Phan

Spingarn's method of partial inverses has found many applications in nonlinear analysis and in optimization. We show that it can be employed to solve composite monotone inclusions in duality, thus opening a new range of applications for the…

Optimization and Control · Mathematics 2013-10-07 Maryam A. Alghamdi , Abdullah Alotaibi , Patrick L. Combettes , Naseer Shahzad

In this article, we study inertial algorithms for numerically solving monotone inclusions involving the sum of a maximally monotone and a cocoercive operator. In particular, we analyze the convergence of inertial and relaxed versions of the…

Optimization and Control · Mathematics 2024-12-04 Fernando Roldán , Cristian Vega

The nonlinear conjugate gradient methods are known to be an effective approach for standard unconstrained optimization problems especially for large-scale problems. This paper proposes a proximal nonlinear conjugate gradient method, which…

Optimization and Control · Mathematics 2026-04-14 Shodai Hamana , Yasushi Narushima

Circumcentered techniques have been shown to significantly accelerate projection-based methods for convex feasibility problems. Motivated by this success, we propose two direct methods with circumcenter acceleration for solving variational…

Optimization and Control · Mathematics 2026-02-10 Roger Behling , Yunier Bello-Cruz , Alfredo Iusem , Di Liu , Luiz-Rafael Santos

We introduce a framework for quasi-Newton forward--backward splitting algorithms (proximal quasi-Newton methods) with a metric induced by diagonal $\pm$ rank-$r$ symmetric positive definite matrices. This special type of metric allows for a…

Optimization and Control · Mathematics 2018-11-27 Stephen Becker , Jalal Fadili , Peter Ochs

In this work we propose a new splitting technique, namely Asymmetric Forward-Backward-Adjoint splitting, for solving monotone inclusions involving three terms, a maximally monotone, a cocoercive and a bounded linear operator. Classical…

Optimization and Control · Mathematics 2016-10-17 Puya Latafat , Panagiotis Patrinos

We propose new primal-dual decomposition algorithms for solving systems of inclusions involving sums of linearly composed maximally monotone operators. The principal innovation in these algorithms is that they are block-iterative in the…

Optimization and Control · Mathematics 2015-11-30 Patrick L. Combettes , Jonathan Eckstein

This paper applies an idea of adaptive momentum for the nonlinear conjugate gradient to accelerate optimization problems in sparse recovery. Specifically, we consider two types of minimization problems: a (single) differentiable function…

Optimization and Control · Mathematics 2023-12-22 Mengqi Hu , Yifei Lou , Bao Wang , Ming Yan , Xiu Yang , Qiang Ye

In this paper, we present a convergence rate analysis for the inexact Krasnosel'skii-Mann iteration built from nonexpansive operators. Our results include two main parts: we first establish global pointwise and ergodic iteration-complexity…

Optimization and Control · Mathematics 2015-09-17 Jingwei Liang , Jalal Fadili , Gabriel Peyré

We describe convergence acceleration schemes for multistep optimization algorithms. The extrapolated solution is written as a nonlinear average of the iterates produced by the original optimization method. Our analysis does not need the…

Optimization and Control · Mathematics 2019-10-18 Raghu Bollapragada , Damien Scieur , Alexandre d'Aspremont

We introduce and investigate the convergence properties of an inertial forward-backward-forward splitting algorithm for approaching the set of zeros of the sum of a maximally monotone operator and a single-valued monotone and Lipschitzian…

Optimization and Control · Mathematics 2014-02-24 Radu Ioan Bot , Ernö Robert Csetnek

We prove linear convergence for a new family of modified Dirichlet--Neumann methods applied to quasilinear parabolic equations, as well as the convergence of the Robin--Robin method. Such nonoverlapping domain decomposition methods are…

Numerical Analysis · Mathematics 2023-08-30 Emil Engström , Eskil Hansen

In this paper, based on inertial and Tseng's ideas, we propose two projection-based algorithms to solve a monotone inclusion problem in infinite dimensional Hilbert spaces. Solution theorems of strong convergence are obtained under the…

Optimization and Control · Mathematics 2020-08-31 Bing Tan , Zheng Zhou , Xiaolong Qin

Primal-dual splitting schemes are a class of powerful algorithms that solve complicated monotone inclusions and convex optimization problems that are built from many simpler pieces. They decompose problems that are built from sums, linear…

Optimization and Control · Mathematics 2015-07-31 Damek Davis

In this paper, we propose an improved iterative method for solving the monotone inclusion problem in the form of $0 \in Ax + Dx + N_{C}(x)$ in real Hilbert space, where $A$ is a maximally monotone operator, $D$ and $B$ are monotone and…

Optimization and Control · Mathematics 2023-06-30 Buris Tongnoi

Resolvents of set-valued operators play a central role in various branches of mathematics and in particular in the design and the analysis of splitting algorithms for solving monotone inclusions. We propose a generalization of this notion,…

Optimization and Control · Mathematics 2020-06-24 Minh N. Bùi , Patrick L. Combettes

We propose and analyze the convergence of a novel stochastic forward-backward splitting algorithm for solving monotone inclusions given by the sum of a maximal monotone operator and a single-valued maximal monotone cocoercive operator. This…

Optimization and Control · Mathematics 2015-02-23 Lorenzo Rosasco , Silvia Villa , Bang Công Vũ

We propose a novel dynamically weighted inertial forward-backward algorithm (DWIFOB) for solving structured monotone inclusion problems. The scheme exploits the globally convergent forward-backward algorithm with deviations in [26] as the…

Optimization and Control · Mathematics 2022-03-02 Hamed Sadeghi , Sebastian Banert , Pontus Giselsson

In this paper, we propose a reflected forward-backward splitting algorithic framework for finding a zero of the sum of finitely many monotone op-erators, including maximally monotone operators, cocoercive operators, and monotone and…

Optimization and Control · Mathematics 2026-05-19 Haowen Zheng , Yongyu Fu , Qiao-Li Dong , Shuangbao Li