English
Related papers

Related papers: Convergence Rate Analysis for Fixed-Point Iteratio…

200 papers

This paper considers a networked system with a finite number of users and supposes that each user tries to minimize its own private objective function over its own private constraint set. It is assumed that each user's constraint set can be…

Optimization and Control · Mathematics 2015-10-22 Hideaki Iiduka

We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic…

Optimization and Control · Mathematics 2021-08-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

In his recent research M. K. Tam (2018) considered a framework for the analysis of iterative algorithms which can be described in terms of a structured set-valued operator. At each point in the ambient space, the value of the operator can…

Optimization and Control · Mathematics 2023-04-20 Alexander J. Zaslavski

Most algorithms for solving optimization problems or finding saddle points of convex-concave functions are fixed-point algorithms. In this work we consider the generic problem of finding a fixed point of an average of operators, or an…

Machine Learning · Computer Science 2020-06-17 Grigory Malinovsky , Dmitry Kovalev , Elnur Gasanov , Laurent Condat , Peter Richtárik

Averaged operators have played an important role in fixed point theory in Hilbert spaces. They emerged as a necessity to obtain solutions to fixed point problems where the underlying operator is not contractive and thus renders Banach fixed…

Functional Analysis · Mathematics 2025-03-11 Arian Berdellima

In this work, we propose and study a framework of generalized proximal point algorithms associated with a maximally monotone operator. We indicate sufficient conditions on the regularization and relaxation parameters of generalized proximal…

Optimization and Control · Mathematics 2022-03-29 Hui Ouyang

We prove that the fixed point iteration of arbitrary positive concave mappings with nonempty fixed point set converges geometrically for any starting point. We also show that positivity is crucial for this result to hold, and the concept of…

Optimization and Control · Mathematics 2022-10-19 Tomasz Piotrowski , Renato L. G. Cavalcante

We develop a framework for quantitative convergence analysis of Picard iterations of expansive set-valued fixed point mappings. There are two key components of the analysis. The first is a natural generalization of single-valued averaged…

Optimization and Control · Mathematics 2018-09-24 D. Russell Luke , Nguyen H. Thao , Matthew K. Tam

We establish linear convergence rates for a certain class of extrapolated fixed point algorithms which are based on dynamic string-averaging methods in a real Hilbert space. This applies, in particular, to the extrapolated simultaneous and…

Optimization and Control · Mathematics 2018-05-11 Christian Bargetz , Victor I. Kolobov , Simeon Reich , Rafał Zalas

We consider the application of the type-I Anderson acceleration to solving general non-smooth fixed-point problems. By interleaving with safe-guarding steps, and employing a Powell-type regularization and a re-start checking for strong…

Optimization and Control · Mathematics 2018-08-14 Junzi Zhang , Brendan O'Donoghue , Stephen Boyd

Fixed-point equations with Lipschitz operators have been studied for more than a century, and are central to problems in mathematical optimization, game theory, economics, and dynamical systems, among others. When the Lipschitz constant of…

Optimization and Control · Mathematics 2025-11-12 Jelena Diakonikolas

In this paper we introduce and study a class of structured set-valued operators which we call union averaged nonexpansive. At each point in their domain, the value of such an operator can be expressed as a finite union of single-valued…

Optimization and Control · Mathematics 2020-04-06 Minh N. Dao , Matthew K. Tam

Generative Adversarial Networks (GANs) are a popular formulation to train generative models for complex high dimensional data. The standard method for training GANs involves a gradient descent-ascent (GDA) procedure on a minimax…

Machine Learning · Computer Science 2023-05-30 Evan Becker , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

Generative Adversarial Networks (GANs) are one of the most popular tools for learning complex high dimensional distributions. However, generalization properties of GANs have not been well understood. In this paper, we analyze the…

Machine Learning · Computer Science 2019-02-12 Hoang Thanh-Tung , Truyen Tran , Svetha Venkatesh

The correspondence between the monotonicity of a (possibly) set-valued operator and the firm nonexpansiveness of its resolvent is a key ingredient in the convergence analysis of many optimization algorithms. Firmly nonexpansive operators…

Optimization and Control · Mathematics 2019-02-27 Heinz H. Bauschke , Walaa M. Moursi , Xianfu Wang

Aitken extrapolation normally applied to convergent fixed point iteration is extended to extrapolate the solution of a divergent iteration. In addition, higher order Aitken extrapolation is introduced that enables successive decomposition…

Numerical Analysis · Mathematics 2013-10-17 Ababu Teklemariam Tiruneh

Inverse problems consist of recovering a signal from a collection of noisy measurements. These problems can often be cast as feasibility problems; however, additional regularization is typically necessary to ensure accurate and stable…

Machine Learning · Computer Science 2021-04-30 Howard Heaton , Samy Wu Fung , Aviv Gibali , Wotao Yin

Alternative iterative methods for a nonexpansive mapping in a Banach space are proposed and proved to be convergent to a common solution to a fixed point problem and a variational inequality. We give rates of asymptotic regularity for such…

Functional Analysis · Mathematics 2009-06-01 Vittorio Colao , Laurentiu Leustean , Genaro Lopez , Victoria Martin-Marquez

We introduce regularity notions for averaged nonexpansive operators. Combined with regularity notions of their fixed point sets, we obtain linear and strong convergence results for quasicyclic, cyclic, and random iterations. New convergence…

Optimization and Control · Mathematics 2014-02-25 Heinz H. Bauschke , Dominikus Noll , Hung M. Phan

We establish linear convergence of relocated fixed-point iterations as introduced by Atenas et al. (2025) assuming the algorithmic operator satisfies a linear error bound. In particular, this framework applies to the setting where the…

Optimization and Control · Mathematics 2025-12-16 Felipe Atenas , Farhana Ahmed Simi , Matthew K Tam