English
Related papers

Related papers: Iteration-Complexity of a Generalized Forward Back…

200 papers

The deviation vectors provide additional degrees of freedom and effectively enhance the flexibility of algorithms. In the literature, the iterative schemes with deviations are constructed and their convergence analyses are performed on an…

Optimization and Control · Mathematics 2025-09-05 Yongyu Fu , Haowen Zheng , Qiao-Li Dong , Xiaolong Qin , Jing Zhao

The backward-backward algorithm is a tool for finding minima of a regularization of the sum of two convex functions in Hilbert spaces. We generalize this setting to Hadamard spaces and prove the convergence of an error-tolerant version of…

Optimization and Control · Mathematics 2013-10-01 Sebastian Banert

In this paper, we develop rapidly convergent forward-backward algorithms for computing zeroes of the sum of finitely many maximally monotone operators. A modification of the classical forward-backward method for two general operators is…

Optimization and Control · Mathematics 2021-07-22 Paul-Emile Maingé

We introduce a forward-backward-forward (FBF) algorithm for solving bilevel equilibrium problem associated with bifunctions on a real Hilbert space. This modifies the forward-backward algorithm by relaxing cocoercivity with monotone and…

Optimization and Control · Mathematics 2024-03-19 Kanchan Mittal , Pankaj Gautam , V. Vetrivel

In this paper, we propose an adaptive forward-backward-forward splitting algorithm for finding a zero of a pseudo-monotone operator which is split as a sum of three operators: the first is continuous single-valued, the second is…

Optimization and Control · Mathematics 2025-03-04 Flavia Chorobura , Ion Necoara , Jean-Christophe Pesquet

We introduce Flat Hilbert Bayesian Inference (FHBI), an algorithm designed to enhance generalization in Bayesian inference. Our approach involves an iterative two-step procedure with an adversarial functional perturbation step and a…

Machine Learning · Computer Science 2025-06-10 Tuan Truong , Quyen Tran , Quan Pham-Ngoc , Nhat Ho , Dinh Phung , Trung Le

We propose a forward-backward splitting algorithm based on Bregman distances for composite minimization problems in general reflexive Banach spaces. The convergence is established using the notion of variable quasi-Bregman monotone…

Optimization and Control · Mathematics 2016-10-10 Quang Van Nguyen

We propose and study the weak convergence of a projective splitting algorithm for solving multi-term composite monotone inclusion problems involving the finite sum of $n$ maximal monotone operators, each of which having an inner four-block…

Optimization and Control · Mathematics 2024-05-08 M. Marques Alves

We develop two variance-reduced fast operator splitting methods to approximate solutions of a class of generalized equations, covering fundamental problems such as \rvs{minimization}, minimax problems, and variational inequalities as…

Optimization and Control · Mathematics 2025-08-14 Quoc Tran-Dinh

Splitting algorithms for finding a zero of sum of operators often involve multiple steps which are referred to as forward or backward steps. Forward steps are the explicit use of the operators and backward steps involve the operators…

Optimization and Control · Mathematics 2021-04-13 Minh N. Dao , Hung M. Phan

The forward-backward splitting technique is a popular method for solving monotone inclusions that has applications in optimization. In this paper we explore the behaviour of the algorithm when the inclusion problem has no solution. We…

Optimization and Control · Mathematics 2016-08-09 Walaa M. Moursi

This paper studies the fundamental properties of the high-order forward-backward splitting mapping (HiFBS) and its associated forward-backward envelope (HiFBE) through the lens of high-order regularization for nonconvex composite functions.…

Optimization and Control · Mathematics 2025-11-14 Alireza Kabgani , Masoud Ahookhosh

In this article we present a modified S-iteration process that we combine with inertial extrapolation to find a common solution to the split monotone inclusion problem and the fixed point problem in real Hilbert space.Our goal is to…

Numerical Analysis · Mathematics 2021-10-11 Shamshad Husain , Uqba Rafat

This paper investigates the iterates $\hbb^1,\dots,\hbb^T$ obtained from iterative algorithms in high-dimensional linear regression problems, in the regime where the feature dimension $p$ is comparable with the sample size $n$, i.e., $p…

Machine Learning · Statistics 2024-04-30 Pierre C. Bellec , Kai Tan

We incorporate inertial terms in the hybrid proximal-extragradient algorithm and investigate the convergence properties of the resulting iterative scheme designed for finding the zeros of a maximally monotone operator in real Hilbert…

Functional Analysis · Mathematics 2014-07-02 Radu Ioan Bot , Ernö Robert Csetnek

Over the past years, operator splitting methods have become ubiquitous for non-smooth optimization owing to their simplicity and efficiency. In this paper, we consider the Forward--Douglas--Rachford splitting method (FDR) [10,40], and study…

Optimization and Control · Mathematics 2018-01-04 Cesare Molinari , Jingwei Liang , Jalal Fadili

In this paper, we establish sublinear and linear convergence of fixed point iterations generated by averaged operators in a Hilbert space. Our results are achieved under a bounded H\"older regularity assumption which generalizes the…

Optimization and Control · Mathematics 2018-08-16 Jonathan M. Borwein , Guoyin Li , Matthew K. Tam

We study a forward backward splitting algorithm that solves the variational inequality \begin{equation*} A x +\nabla \Phi(x)+ N_C (x) \ni 0 \end{equation*} where $H$ is a real Hilbert space, $A: H\rightrightarrows H$ is a maximal monotone…

Optimization and Control · Mathematics 2014-08-06 Marc-Olivier Czarnecki , Nahla Noun , Juan Peypouquet

We propose a splitting algorithm for solving a system of composite monotone inclusions formulated in the form of the extended set of solutions in real Hilbert spaces. The resluting algorithm is a an extension of the algorithm in [4]. The…

Optimization and Control · Mathematics 2013-08-14 Dinh Dung , Bang Cong Vu

In this paper, we propose an improved iterative method for solving the monotone inclusion problem in the form of $0 \in Ax + Dx + N_{C}(x)$ in real Hilbert space, where $A$ is a maximally monotone operator, $D$ and $B$ are monotone and…

Optimization and Control · Mathematics 2023-06-30 Buris Tongnoi