English
Related papers

Related papers: Krasnoselskii-Mann Iterations: Inertia, Perturbati…

200 papers

A new scheme of the iterative perturbation theory is proposed for the strongly correlated electron systems with orbital degeneracy. The method is based on the modified self-energy of Yeyati, et al. which interpolates between the weak and…

Strongly Correlated Electrons · Physics 2009-10-31 T. Saso

In this work, we deal with an iteration method for approximating a fixed point of a contraction mapping using the Mann's algorithm under functional random errors. We first show its almost complete convergence to the fixed point by mean of…

Probability · Mathematics 2017-01-24 Bahia Barache , Idir Arab , Abdelnasser Dahmani

We investigate iterated Tikhonov methods coupled with a Kaczmarz strategy for obtaining stable solutions of nonlinear systems of ill-posed operator equations. We show that the proposed method is a convergent regularization method. In the…

Numerical Analysis · Mathematics 2020-12-23 J. Baumeister , A. De Cezaro , A. Leitao

We prove weak and strong convergence theorems for a double Krasnoselskij type iterative method to approximate coupled solutions of a bivariate nonexpansive operator F : C x C --> C, where C is a nonempty closed and convex subset of a…

Functional Analysis · Mathematics 2014-02-21 V. Berinde , A. R. Khan , M. Pacurar

We propose in this paper a proximal and contraction method for solving a convex mixed variational inequality problem in a real Hilbert space. To accelerate the convergence of our proposed method, we incorporate an inertial extrapolation…

Optimization and Control · Mathematics 2025-11-25 Chidi Elijah Nwakpa , Austine Efut Ofem , Kalu Okam Okorie , Chinedu Izuchukwu , Chibueze Christian Okeke

Incremental methods are widely utilized for solving finite-sum optimization problems in machine learning and signal processing. In this paper, we study a family of incremental methods -- including incremental subgradient, incremental…

Optimization and Control · Mathematics 2022-12-26 Xiao Li , Zhihui Zhu , Anthony Man-Cho So , Jason D Lee

This work proposes a general strategy for solving possibly nonlinear problems arising from implicit time discretizations as a sequence of explicit solutions. The resulting sequence may exhibit instabilities similar to those of the base…

Numerical Analysis · Mathematics 2025-10-21 Nicolas A. Barnafi , Felipe Galarce , Pablo Brubeck

We study iterative regularization for linear models, when the bias is convex but not necessarily strongly convex. We characterize the stability properties of a primal-dual gradient based approach, analyzing its convergence in the presence…

Machine Learning · Statistics 2020-10-30 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

We investigate the Stochastic Krasnoselskii-Mann iterations for expected nonexpansive fixed-point problems in a real Hilbert space. We establish convergence guarantees under significantly weaker assumptions on the variance than those…

Optimization and Control · Mathematics 2026-05-12 Daniel Cortild , Coralia Cartis

We combine two iterative algorithms for solving large-scale systems of linear inequalities, the relaxation method of Agmon, Motzkin et al. and the randomized Kaczmarz method. In doing so, we obtain a family of algorithms that generalize and…

Optimization and Control · Mathematics 2019-06-05 Jesus De Loera , Jamie Haddock , Deanna Needell

In this paper, we establish sublinear and linear convergence of fixed point iterations generated by averaged operators in a Hilbert space. Our results are achieved under a bounded H\"older regularity assumption which generalizes the…

Optimization and Control · Mathematics 2018-08-16 Jonathan M. Borwein , Guoyin Li , Matthew K. Tam

Acceleration and momentum are the de facto standard in modern applications of machine learning and optimization, yet the bulk of the work on implicit regularization focuses instead on unaccelerated methods. In this paper, we study the…

Machine Learning · Statistics 2022-01-21 Yue Sheng , Alnur Ali

We introduce a fixed point iteration process built on optimization of a linear function over a compact domain. We prove the process always converges to a fixed point and explore the set of fixed points in various convex sets. In particular,…

Optimization and Control · Mathematics 2021-03-18 Pedro Felzenszwalb , Caroline Klivans , Alice Paul

This is the first of a series of papers in which we study deep computations (ultracomputations) and deep iterates, formalizing the ideas of "asymptotic limit" of computations and compositional iterates, respectively. In this first paper of…

Logic · Mathematics 2026-01-28 Samson Alva , Eduardo Dueñez , Jose Iovino , Claire Walton

A wide variety of different (fixed-point) iterative methods for the solution of nonlinear equations exists. In this work we will revisit a unified iteration scheme in Hilbert spaces from our previous work that covers some prominent…

Numerical Analysis · Mathematics 2019-05-17 Pascal Heid , Thomas P. Wihler

We develop new perturbation techniques for conducting convergence analysis of various first-order algorithms for a class of nonsmooth optimization problems. We consider the iteration scheme of an algorithm to construct a perturbed…

Optimization and Control · Mathematics 2018-10-25 Xiangfeng Wang , Jane Ye , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

In this paper we address the numerical solution of nonlinear ill-posed systems by iterative regularization methods in the classes of Levenberg-Marquardt, trust-region and adaptive quadratic regularization procedures. Both with exact and…

Numerical Analysis · Mathematics 2015-04-17 Stefania Bellavia , Benedetta Morini

The objective of this research is to explore a convex feasibility problem, which consists of a monotone variational inequality problem and a fixed point problem. We introduce four inertial extragradient algorithms that are motivated by the…

Optimization and Control · Mathematics 2021-07-27 Bing Tan , Jingjing Fan , Xiaolong Qin

While the theory of operator approximation with any given accuracy is well elaborated, the theory of {best constrained} constructive operator approximation is still not so well developed. Despite increasing demands from applications this…

Optimization and Control · Mathematics 2018-11-09 Anatoli Torokhti , Pablo Soto-Quiros

We consider the convergence of iterative solvers for problems of nonlinear magnetostatics. Using the equivalence to an underlying minimization problem, we can establish global linear convergence of a large class of methods, including the…

Numerical Analysis · Mathematics 2024-03-28 Herbert Egger , Felix Engertsberger , Bogdan Radu