English
Related papers

Related papers: Four-operator splitting algorithms for solving mon…

200 papers

We introduce the Stochastic Monotone Aggregated Root-Finding (SMART) algorithm, a new randomized operator-splitting scheme for finding roots of finite sums of operators. These algorithms are similar to the growing class of incremental…

Optimization and Control · Mathematics 2016-06-13 Damek Davis

A recent innovation in projective splitting algorithms for monotone operator inclusions has been the development of a procedure using two forward steps instead of the customary proximal steps for operators that are Lipschitz continuous.…

Optimization and Control · Mathematics 2020-02-19 Patrick R. Johnstone , Jonathan Eckstein

We introduce a dynamical system to the problem of finding zeros of the sum of two maximally monotone operators. We investigate the existence, uniqueness and extendability of solutions to this dynamical system in a Hilbert space. We prove…

Classical Analysis and ODEs · Mathematics 2021-08-17 Ewa M. Bednarczuk , Raj Narayan Dhara , Krzysztof E. Rutkowski

Primal-dual splitting schemes are a class of powerful algorithms that solve complicated monotone inclusions and convex optimization problems that are built from many simpler pieces. They decompose problems that are built from sums, linear…

Optimization and Control · Mathematics 2015-07-31 Damek Davis

Properties of compositions and convex combinations of averaged nonexpansive operators are investigated and applied to the design of new fixed point algorithms in Hilbert spaces. An extended version of the forward-backward splitting…

Functional Analysis · Mathematics 2014-10-09 Patrick L. Combettes , Isao Yamada

Resolvents of set-valued operators play a central role in various branches of mathematics and in particular in the design and the analysis of splitting algorithms for solving monotone inclusions. We propose a generalization of this notion,…

Optimization and Control · Mathematics 2020-06-24 Minh N. Bùi , Patrick L. Combettes

The problem of finding a minimizer of the sum of two convex functions - or, more generally, that of finding a zero of the sum of two maximally monotone operators - is of central importance in variational analysis. Perhaps the most popular…

Optimization and Control · Mathematics 2014-08-01 Heinz H. Bauschke , Warren L. Hare , Walaa M. Moursi

In this paper, under the monotonicity of pairs of operators, we propose some Generalized Proximal Point Algorithms to solve non-monotone inclusions using warped resolvents and transformed resolvents. The weak, strong, and linear convergence…

Optimization and Control · Mathematics 2025-01-24 Ba Khiet Le , Minh N. Dao , Michel Théra

For solving structured monotone inclusion problems involving the sum of finitely many maximal monotone operators, we propose and study a relative-error inertial-relaxed inexact projective splitting algorithm. The proposed algorithm benefits…

Optimization and Control · Mathematics 2023-01-25 M. Marques Alves , Marina Geremia , Raul T. Marcavillaca

We propose a flexible approach for computing the resolvent of the sum of weakly monotone operators in real Hilbert spaces. This relies on splitting methods where strong convergence is guaranteed. We also prove linear convergence under…

Optimization and Control · Mathematics 2018-09-12 Minh N. Dao , Hung M. Phan

Machine learning approaches relying on such criteria as adversarial robustness or multi-agent settings have raised the need for solving game-theoretic equilibrium problems. Of particular relevance to these applications are methods targeting…

Machine Learning · Computer Science 2023-10-27 Xufeng Cai , Ahmet Alacaoglu , Jelena Diakonikolas

The Douglas-Rachford algorithm is a popular method for finding zeros of sums of monotone operators. By its definition, the Douglas-Rachford operator is not symmetric with respect to the order of the two operators. In this paper we provide a…

Optimization and Control · Mathematics 2015-05-13 Heinz H. Bauschke , Walaa M. Moursi

We study stochastic monotone inclusion problems, which widely appear in machine learning applications, including robust regression and adversarial learning. We propose novel variants of stochastic Halpern iteration with recursive variance…

Optimization and Control · Mathematics 2023-01-10 Xufeng Cai , Chaobing Song , Cristóbal Guzmán , Jelena Diakonikolas

It is well known that the projection method is not convergent for monotone equilibrium problems. Recently Sosa \textit{et al.} in \cite{SS2011} proposed a projection algorithm ensuring convergence for paramonotone equilibrium problems. In…

Optimization and Control · Mathematics 2018-04-30 Le Dung Muu , Phung Minh Duc , Xuan Thanh Le

The Douglas-Rachford algorithm is a very popular splitting technique for finding a zero of the sum of two maximally monotone operators. However, the behaviour of the algorithm remains mysterious in the general inconsistent case, i.e., when…

Optimization and Control · Mathematics 2016-04-21 Heinz H. Bauschke , Walaa M. Moursi

In this paper, we propose and study the iteration complexity of an inexact Douglas-Rachford splitting (DRS) method and a Douglas-Rachford-Tseng's forward-backward (F-B) splitting method for solving two-operator and four-operator monotone…

Optimization and Control · Mathematics 2017-12-01 M. Marques Alves , M. Geremia

It is common to encounter large-scale monotone inclusion problems where the objective has a finite sum structure. We develop a general framework for variance-reduced forward-backward splitting algorithms for this problem. This framework…

Machine Learning · Statistics 2021-03-17 Xun Zhang , William B. Haskell , Zhisheng Ye

The correspondence between the class of nonexpansive mappings and the class of maximally monotone operators via the reflected resolvents of the latter has played an instrumental role in the convergence analysis of the splitting methods.…

Optimization and Control · Mathematics 2022-05-19 Leon Liu , Walaa M. Moursi , Jon Vanderwerff

This paper proposes a two-point inertial proximal point algorithm to find zero of maximal monotone operators in Hilbert spaces. We obtain weak convergence results and non-asymptotic $O(1/n)$ convergence rate of our proposed algorithm in…

Optimization and Control · Mathematics 2022-07-21 Olaniyi S. Iyiola , Yekini Shehu

A parallel splitting method is proposed for solving systems of coupled monotone inclusions in Hilbert spaces. Convergence is established for a wide class of coupling schemes. Unlike classical alternating algorithms, which are limited to two…

Optimization and Control · Mathematics 2009-02-26 H. Attouch , L. M. Briceno-Arias , P. L. Combettes