English
Related papers

Related papers: Fast convergence of generalized forward-backward a…

200 papers

This paper investigates first-order variable metric backward forward dynamical systems associated with monotone inclusion and convex minimization problems in real Hilbert space. The operators are chosen so that the backward-forward…

Optimization and Control · Mathematics 2021-06-15 Pankaj Gautam , D. R. Sahu , J. C. Yao

We analyze the convergence rate of an accelerated backward forward method for solving convex composite optimization problems. The method was developed by Taylor, Hendrickx and Glineur, and is different from the FISTA algorithm in its…

Optimization and Control · Mathematics 2026-04-30 Zepeng Wang , Juan Peypouquet

The forward-backward splitting algorithm is a popular operator-splitting method for solving monotone inclusion of the sum of a maximal monotone operator and a cocoercive operator. In this paper, we present a new convergence analysis of a…

Functional Analysis · Mathematics 2019-08-30 Fuying Cui , Yuchao Tang , Chuanxi Zhu

We propose a variation of the forward--backward splitting method for solving structured monotone inclusions. Our method integrates past iterates and two deviation vectors into the update equations. These deviation vectors bring flexibility…

Optimization and Control · Mathematics 2023-07-14 Hamed Sadeghi , Sebastian Banert , Pontus Giselsson

In this paper we provide a splitting method for finding a zero of the sum of a maximally monotone operator, a lipschitzian monotone operator, and a normal cone to a closed vectorial subspace of a real Hilbert space. The problem is…

Optimization and Control · Mathematics 2014-06-25 Luis M. Briceño-Arias

We consider the primal problem of finding the zeros of the sum of a maximally monotone operator with the composition of another maximally monotone operator with a linear continuous operator and a corresponding dual problem formulated by…

Optimization and Control · Mathematics 2012-06-27 Radu Ioan Bot , Ernö Robert Csetnek , Andre Heinrich

It is common to encounter large-scale monotone inclusion problems where the objective has a finite sum structure. We develop a general framework for variance-reduced forward-backward splitting algorithms for this problem. This framework…

Machine Learning · Statistics 2021-03-17 Xun Zhang , William B. Haskell , Zhisheng Ye

By time discretization of a second-order primal-dual dynamical system with damping $\alpha/t$ where an inertial construction in the sense of Nesterov is needed only for the primal variable, we propose a fast primal-dual algorithm for a…

Optimization and Control · Mathematics 2022-06-06 Xin He , Rong Hu , Ya-Ping Fang

In this paper, we develop a new type of accelerated algorithms to solve some classes of maximally monotone equations as well as monotone inclusions. Instead of using Nesterov's accelerating approach, our methods rely on a so-called…

Optimization and Control · Mathematics 2021-12-08 Quoc Tran-Dinh , Yang Luo

We consider the monotone inclusion problems in real Hilbert spaces. Proximal splitting algorithms are very popular technique to solve it and generally achieve weak convergence under mild assumptions. Researchers assume the strong conditions…

Optimization and Control · Mathematics 2022-05-05 Avinash Dixit , D. R. Sahu , Pankaj Gautam , T. Som

The nonlinear, or warped, resolvent recently explored by Giselsson and B\`ui-Combettes has been used to model a large set of existing and new monotone inclusion algorithms. To establish convergent algorithms based on these resolvents,…

Optimization and Control · Mathematics 2023-10-02 Martin Morin , Sebastian Banert , Pontus Giselsson

We propose an inertial Douglas-Rachford splitting algorithm for finding the set of zeros of the sum of two maximally monotone operators in Hilbert spaces and investigate its convergence properties. To this end we formulate first the…

Optimization and Control · Mathematics 2014-03-31 Radu Ioan Bot , Ernö Robert Csetnek , Christopher Hendrich

We propose a variable metric forward-backward splitting algorithm and prove its convergence in real Hilbert spaces. We then use this framework to derive primal-dual splitting algorithms for solving various classes of monotone inclusions in…

Optimization and Control · Mathematics 2012-06-29 Patrick L. Combettes , Bang C. Vũ

In this paper, we study a bilinear saddle point problem of the form $\min_{x}\max_{y} F(x) + \langle Ax, y \rangle - G(y)$, where $F$ and $G$ are $\mu_F$- and $\mu_G$-strongly convex functions, respectively. By incorporating Nesterov…

Optimization and Control · Mathematics 2025-09-11 Xin He , Ya-Ping Fang

The principle underlying this paper is the basic observation that the problem of simultaneously solving a large class of composite monotone inclusions and their duals can be reduced to that of finding a zero of the sum of a maximally…

Optimization and Control · Mathematics 2010-11-29 L. Briceno-Arias , P. L. Combettes

We develop a novel primal-dual algorithm to solve a class of nonsmooth and nonlinear compositional convex minimization problems, which covers many existing and brand-new models as special cases. Our approach relies on a combination of a new…

Optimization and Control · Mathematics 2021-04-20 Yuzixuan Zhu , Deyi Liu , Quoc Tran-Dinh

We study acceleration and preconditioning strategies for a class of Douglas-Rachford methods aiming at the solution of convex-concave saddle-point problems associated with Fenchel-Rockafellar duality. While the basic iteration converges…

Optimization and Control · Mathematics 2016-04-22 Kristian Bredies , Hongpeng Sun

In this article, we study two methods for solving monotone inclusions in real Hilbert spaces involving the sum of a maximally monotone operator, a monotone-Lipschitzian operator, a cocoercive operator, and a normal cone to a vector…

Optimization and Control · Mathematics 2024-05-13 Fernando Roldán

In this paper, we propose a stochastic forward-backward-forward splitting algorithm and prove its almost sure weak convergence in real separable Hilbert spaces. Applications to composite monotone inclusion and minimization problems are…

Optimization and Control · Mathematics 2015-05-20 Bang Cong Vũ

We analyze the convergence rate of the monotone accelerated proximal gradient method, which can be used to solve structured convex composite optimization problems. A linear convergence rate is established when the smooth part of the…

Optimization and Control · Mathematics 2026-03-16 Zepeng Wang , Juan Peypouquet