English
Related papers

Related papers: Linear Convergence Rates for Extrapolated Fixed Po…

200 papers

The paper provides a thorough comparison between R-continuity and other fundamental tools in optimization such as metric regularity, metric subregularity and calmness. We show that R-continuity has some advantages in the convergence rate…

Optimization and Control · Mathematics 2024-08-20 Ba Khiet Le , Michel Théra

In this paper, we establish the $R$-linear rate of convergence of a golden ratio algorithm for solving an equilibrium problem in a Hilbert space. Several experiments are performed to show the numerical behavior of the algorithm and also to…

Optimization and Control · Mathematics 2018-10-09 Dang Van Hieu

We use proof mining techniques to obtain a uniform rate of asymptotic regularity for the instance of the parallel algorithm used by L\'opez-Acedo and Xu to find common fixed points of finite families of $k$-strict pseudocontractive…

Functional Analysis · Mathematics 2016-06-21 Andrei Sipos

In this paper we propose a distributed dual gradient algorithm for minimizing linearly constrained separable convex problems and analyze its rate of convergence. In particular, we prove that under the assumption of strong convexity and…

Optimization and Control · Mathematics 2014-10-01 Ion Necoara , Valentin Nedelcu

The problem of minimizing the sum of nonsmooth, convex objective functions defined on a real Hilbert space over the intersection of fixed point sets of nonexpansive mappings, onto which the projections cannot be efficiently computed, is…

Optimization and Control · Mathematics 2016-02-08 Hideaki Iiduka

We design accelerated algorithms with improved rates for several fundamental classes of optimization problems. Our algorithms all build upon techniques related to the analysis of primal-dual extragradient methods via relative Lipschitzness…

Optimization and Control · Mathematics 2022-02-10 Yujia Jin , Aaron Sidford , Kevin Tian

In the framework of a real Hilbert space we consider the problem of approaching solutions to a class of hierarchical variational inequality problems, subsuming several other problem classes including certain mathematical programs under…

Optimization and Control · Mathematics 2026-01-27 Pavel Dvurechensky , Meggie Marschner , Shimrit Shtern , Mathias Staudigl

Spectral algorithms leverage spectral regularization techniques to analyze and process data, providing a flexible framework for addressing supervised learning problems. To deepen our understanding of their performance in real-world…

Machine Learning · Statistics 2025-07-23 Jun Fan , Zheng-Chu Guo , Lei Shi

We study a fixed point iterative method based on generalized relaxation of strictly quasi-nonexpansive operators. The iterative method is assembled by averaging of strings, and each string is composed of finitely many strictly…

Optimization and Control · Mathematics 2021-05-03 Touraj Nikazad , Mahdi Mirzapour

We develop a framework for quantitative convergence analysis of Picard iterations of expansive set-valued fixed point mappings. There are two key components of the analysis. The first is a natural generalization of single-valued averaged…

Optimization and Control · Mathematics 2018-09-24 D. Russell Luke , Nguyen H. Thao , Matthew K. Tam

We present quadratically convergent algorithms to compute the extremal value of a real parameter for which a given rational transfer function of a linear time-invariant system is passive. This problem is formulated for both continuous-time…

Optimization and Control · Mathematics 2022-05-26 Tim Mitchell , Paul Van Dooren

This paper studies the learning of linear operators between infinite-dimensional Hilbert spaces. The training data comprises pairs of random input vectors in a Hilbert space and their noisy images under an unknown self-adjoint linear…

Statistics Theory · Mathematics 2023-05-12 Maarten V. de Hoop , Nikola B. Kovachki , Nicholas H. Nelsen , Andrew M. Stuart

This work is devoted to establish the strong convergence results of an iterative algorithm generated by the shrinking projection method in Hilbert spaces. The proposed approximation sequence is used to find a common element in the set of…

Functional Analysis · Mathematics 2018-03-07 Abdul Ghaffar , Zafar Ullah , Muhammad Aqeel Ahmad Khan , Faisal Mumtaz

The data-compatibility approach to constrained optimization, proposed here, strives to a point that is "close enough" to the solution set and whose target function value is "close enough" to the constrained minimum value. These notions can…

Optimization and Control · Mathematics 2020-10-26 Yair Censor , Maroun Zaknoon , Alexander J. Zaslavski

Most algorithms for solving optimization problems or finding saddle points of convex-concave functions are fixed-point algorithms. In this work we consider the generic problem of finding a fixed point of an average of operators, or an…

Machine Learning · Computer Science 2020-06-17 Grigory Malinovsky , Dmitry Kovalev , Elnur Gasanov , Laurent Condat , Peter Richtárik

This article aims to present the $AT$ algorithm, a novel two-step iterative approach for approximating fixed points of weak contractions within complete normed linear spaces. The article demonstrates the convergence of $AT$ algorithm…

Classical Analysis and ODEs · Mathematics 2024-07-08 Akansha Tyagi , Sachin Vashistha

The proximal point algorithm is a widely used tool for solving a variety of convex optimization problems such as finding zeros of maximally monotone operators, fixed points of nonexpansive mappings, as well as minimizing convex functions.…

Optimization and Control · Mathematics 2018-04-19 Laurentiu Leustean , Adriana Nicolae , Andrei Sipos

In this paper we study the bounded perturbation resilience of projection and contraction algorithms for solving variational inequality (VI) problems in real Hilbert spaces. Under typical and standard assumptions of monotonicity and…

Optimization and Control · Mathematics 2017-11-20 Qiao-Li Dong , Aviv Gibali , Dan Jiang , Shang-Hong Ke

We study random iterations of averaged operators in Hilbert spaces and prove that the associated residuals converge exponentially fast, both in expectation and almost surely. Our results provide quantitative bounds in terms of a single…

Functional Analysis · Mathematics 2025-09-15 James Tian

Many iterative methods for solving optimization or feasibility problems have been invented, and often convergence of the iterates to some solution is proven. Under favourable conditions, one might have additional bounds on the distance of…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao , Dominikus Noll , Hung M. Phan