English
Related papers

Related papers: Iteration-Complexity of a Generalized Forward Back…

200 papers

In this paper, a polynomial-time algorithm is given to compute the generalized Hermite normal form for a matrix F over Z[x], or equivalently, the reduced Groebner basis of the Z[x]-module generated by the column vectors of F. The algorithm…

Symbolic Computation · Computer Science 2016-07-22 Rui-Juan Jing , Chun-Ming Yuan , Xiao-Shan Gao

We propose an abstract stochastic scheme for solving a broad range of monotone operator inclusion problems in Hilbert spaces. This framework allows for the introduction of stochasticity at several levels in monotone operator splitting…

Optimization and Control · Mathematics 2026-02-13 Patrick L. Combettes , Javier I. Madariaga

In this work, we propose and analyse forward-backward-type algorithms for finding a zero of the sum of finitely many monotone operators, which are not based on reduction to a two operator inclusion in the product space. Each iteration of…

Optimization and Control · Mathematics 2022-07-14 Francisco J. Aragón-Artacho , Yura Malitsky , Matthew K. Tam , David Torregrosa-Belén

For the inclusion problem involving two maximal monotone operators, under the metric subregularity of the composite operator, we derive the linear convergence of the generalized proximal point algorithm and several splitting algorithms,…

Optimization and Control · Mathematics 2016-09-28 Li Shen , Shaohua Pan

Recently, several studies proposed methods to utilize some classes of optimization problems in designing deep neural networks to encode constraints that conventional layers cannot capture. However, these methods are still in their infancy…

Machine Learning · Computer Science 2020-06-16 Younghan Jeon , Minsik Lee , Jin Young Choi

In this paper we describe an iterative operator-splitting method for unbounded operators. We derive error bounds for iterative splitting methods in the presence of unbounded operators and semigroup operators. Here mixed applications of…

Numerical Analysis · Mathematics 2009-04-02 Juergen Geiser

In this paper we propose new averaged iterative algorithms designed for solving a split common fixed-point problem in the class of demicontractive mappings. The algorithms are obtained by inserting an averaged term into the algorithms used…

General Mathematics · Mathematics 2024-06-25 Vasile Berinde , Khairul Saleh

We study the convergence of a random iterative sequence of a family of operators on infinite dimensional Hilbert spaces, inspired by the Stochastic Gradient Descent (SGD) algorithm in the case of the noiseless regression, as studied in [1].…

Functional Analysis · Mathematics 2022-09-02 Soumyadip Ghosh , Yingdong Lu , Tomasz J. Nowicki

This paper analyzes the iteration-complexity of a quadratic penalty accelerated inexact proximal point method for solving linearly constrained nonconvex composite programs. More specifically, the objective function is of the form $f + h$…

Optimization and Control · Mathematics 2019-07-17 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

We address the problem of finding the zeros of the sum of a maximally monotone operator and a cocoercive operator. Our approach introduces a modification to the forward-backward method by integrating an inertial/momentum term alongside a…

Optimization and Control · Mathematics 2023-12-20 Radu Ioan Bot , Dang-Khoa Nguyen , Chunxiang Zong

In this paper, we propose new algorithms for finding a common point of the solution set of a pseudomonotone equilibrium problem and the set of fixed points of a symmetric generalized hybrid mapping in a real Hilbert space. The convergence…

Optimization and Control · Mathematics 2015-08-18 Bui Van Dinh , Do Sang Kim

In this paper we investigate the computational aspects of some recently proposed iterative methods for approximating the canonical tight and canonical dual window of a Gabor frame (g,a,b). The iterations start with the window g while the…

Functional Analysis · Mathematics 2007-05-23 A. J. E. M. Janssen , Peter L. Soendergaard

We present a forward-backward-based algorithm to minimize a sum of a differentiable function and a nonsmooth function, both being possibly nonconvex. The main contribution of this work is to consider the challenging case where the nonsmooth…

Optimization and Control · Mathematics 2021-02-02 Audrey Repetti , Yves Wiaux

In this paper, we consider a class of Forward--Backward (FB) splitting methods that includes several variants (e.g. inertial schemes, FISTA) for minimizing the sum of two proper convex and lower semi-continuous functions, one of which has a…

Optimization and Control · Mathematics 2018-01-04 Jingwei Liang , Jalal Fadili , Gabriel Peyré

Using elementary means, we derive the three most popular splittings of $e^{(A+B)}$ and their error bounds in the case when $A$ and $B$ are (possibly unbounded) operators in a Hilbert space, generating strongly continuous semigroups,…

Functional Analysis · Mathematics 2024-01-15 Arieh Iserles , Karolina Kropielnicka

In this paper we propose two proximal gradient algorithms for fractional programming problems in real Hilbert spaces, where the numerator is a proper, convex and lower semicontinuous function and the denominator is a smooth function, either…

Optimization and Control · Mathematics 2016-02-01 Radu Ioan Bot , Ernö Robert Csetnek

We provide two weakly convergent algorithms for finding a zero of the sum of a maximally monotone operator, a cocoercive operator, and the normal cone to a closed vector subspace of a real Hilbert space. The methods exploit the intrinsic…

Optimization and Control · Mathematics 2012-12-27 Luis M. Briceño-Arias

In this paper, we analyze the convergence %semi-convergence properties of projected non-stationary block iterative methods (P-BIM) aiming to find a constrained solution to large linear, usually both noisy and ill-conditioned, systems of…

Numerical Analysis · Mathematics 2022-02-11 Mahdi Mirzapour , Andrzej Cegielski , Tommy Elfving

We present a family of distributed forward-backward methods with variable stepsizes to find a solution of structured monotone inclusion problems. The framework is constructed by means of relocated fixed-point iterations, extending the…

Optimization and Control · Mathematics 2026-01-23 Felipe Atenas , Minh N. Dao , Matthew K. Tam

In this paper, we introduce some new iterative optimisation algorithms on Riemannian manifolds and Hilbert spaces which have good global convergence guarantees to local minima. More precisely, these algorithms have the following properties:…

Optimization and Control · Mathematics 2025-05-29 Tuyen Trung Truong