English
Related papers

Related papers: A reflected forward-backward splitting algorithmic…

200 papers

In this paper, we propose a new general and stable fixed-point approach to compute the resolvents of the composition of a set-valued maximal monotone operator with a linear bounded mapping. Weak, strong and linear convergence of the…

Optimization and Control · Mathematics 2025-02-05 Samir Adly , Ba Khiet Le

While monotone operator theory is often studied on Hilbert spaces, many interesting problems in machine learning and optimization arise naturally in finite-dimensional vector spaces endowed with non-Euclidean norms, such as…

Optimization and Control · Mathematics 2025-08-26 Alexander Davydov , Saber Jafarpour , Anton V. Proskurnikov , Francesco Bullo

We propose a proximal variable smoothing algorithm for nonsmooth optimization problem with sum of three functions involving weakly convex composite function. The proposed algorithm is designed as a time-varying forward-backward splitting…

Optimization and Control · Mathematics 2025-04-29 Keita Kume , Isao Yamada

In this paper, we propose a successive pseudo-convex approximation algorithm to efficiently compute stationary points for a large class of possibly nonconvex optimization problems. The stationary points are obtained by solving a sequence of…

Optimization and Control · Mathematics 2018-12-17 Yang Yang , Marius Pesavento

We present a forward-backward-based algorithm to minimize a sum of a differentiable function and a nonsmooth function, both being possibly nonconvex. The main contribution of this work is to consider the challenging case where the nonsmooth…

Optimization and Control · Mathematics 2021-02-02 Audrey Repetti , Yves Wiaux

Forward-backward methods are a very useful tool for the minimization of a functional given by the sum of a differentiable term and a nondifferentiable one and their investigation has experienced several efforts from many researchers in the…

Numerical Analysis · Mathematics 2015-06-10 Silvia Bonettini , Federica Porta , Valeria Ruggiero

We propose a unified framework to solve general low-rank plus sparse matrix recovery problems based on matrix factorization, which covers a broad family of objective functions satisfying the restricted strong convexity and smoothness…

Machine Learning · Statistics 2018-02-21 Xiao Zhang , Lingxiao Wang , Quanquan Gu

The backward-backward algorithm is a tool for finding minima of a regularization of the sum of two convex functions in Hilbert spaces. We generalize this setting to Hadamard spaces and prove the convergence of an error-tolerant version of…

Optimization and Control · Mathematics 2013-10-01 Sebastian Banert

A general primal-dual splitting algorithm for solving systems of structured coupled monotone inclusions in Hilbert spaces is introduced and its asymptotic behavior is analyzed. Each inclusion in the primal system features compositions with…

Optimization and Control · Mathematics 2013-02-14 Patrick L. Combettes

In this article, we study inertial algorithms for numerically solving monotone inclusions involving the sum of a maximally monotone and a cocoercive operator. In particular, we analyze the convergence of inertial and relaxed versions of the…

Optimization and Control · Mathematics 2024-12-04 Fernando Roldán , Cristian Vega

The three-operators splitting algorithm is a popular operator splitting method for finding the zeros of the sum of three maximally monotone operators, with one of which is cocoercive operator. In this paper, we propose a class of inertial…

Optimization and Control · Mathematics 2019-08-30 Fuying Cui , Yuchao Tang , Yang Yang

Projective splitting is a family of methods for solving inclusions involving sums of maximal monotone operators. First introduced by Eckstein and Svaiter in 2008, these methods have enjoyed significant innovation in recent years, becoming…

Optimization and Control · Mathematics 2020-02-19 Patrick R. Johnstone , Jonathan Eckstein

In infinite-dimensional Hilbert spaces we device a class of strongly convergent primal-dual schemes for solving variational inequalities defined by a Lipschitz continuous and pseudomonote map. Our novel numerical scheme is based on Tseng's…

Optimization and Control · Mathematics 2019-08-27 Benoit Duvocelle , Dennis Meier , Mathias Staudigl , Phan Tu Vuong

The aim of this article is to present two different primal-dual methods for solving structured monotone inclusions involving parallel sums of compositions of maximally monotone operators with linear bounded operators. By employing some…

Functional Analysis · Mathematics 2013-07-30 Radu Ioan Bot , Christopher Hendrich

We develop fixed-point algorithms for the approximation of structured matrices with rank penalties. In particular we use these fixed-point algorithms for making approximations by sums of exponentials, or frequency estimation. For the basic…

Numerical Analysis · Mathematics 2016-01-07 Fredrik Andersson , Marcus Carlsson

We propose a new first-order optimisation algorithm to solve high-dimensional non-smooth composite minimisation problems. Typical examples of such problems have an objective that decomposes into a non-smooth empirical risk part and a…

Optimization and Control · Mathematics 2015-07-07 Niao He , Zaid Harchaoui

In this paper, by using tools of second-order variational analysis, we study the popular forward-backward splitting method with Beck-Teboulle's line-search for solving convex optimization problem where the objective function can be split…

Optimization and Control · Mathematics 2018-06-19 Yunier Bello-Cruz , G. Li , T. T. A. Nghia

In this paper, we develop a new type of accelerated algorithms to solve some classes of maximally monotone equations as well as monotone inclusions. Instead of using Nesterov's accelerating approach, our methods rely on a so-called…

Optimization and Control · Mathematics 2021-12-08 Quoc Tran-Dinh , Yang Luo

We propose new primal-dual decomposition algorithms for solving systems of inclusions involving sums of linearly composed maximally monotone operators. The principal innovation in these algorithms is that they are block-iterative in the…

Optimization and Control · Mathematics 2015-11-30 Patrick L. Combettes , Jonathan Eckstein

In this paper, we propose a variable metric version of Tseng's algorithm (the forward-backward-forward algorithm: FBF) combined with extrapolation from the past that includes error terms for finding a zero of the sum of a maximally monotone…

Optimization and Control · Mathematics 2022-07-25 Buris Tongnoi