English
Related papers

Related papers: Stochastic fixed-point iterations for nonexpansive…

200 papers

We propose a generalization of the stochastic Krasnoselskil-Mann $(SKM)$ algorithm to reflexive Banach spaces endowed with Bregman distances. Under standard martingale-difference noise assumptions in the dual space and mild conditions on…

Optimization and Control · Mathematics 2025-06-11 Saeed Hashemi Sababe , Ehsan Lotfali Ghasab

We analyze the oracle complexity of the stochastic Halpern iteration with minibatch, where we aim to approximate fixed-points of nonexpansive and contractive operators in a normed finite-dimensional space. We show that if the underlying…

Optimization and Control · Mathematics 2025-05-13 Mario Bravo , Juan Pablo Contreras

We propose a conversion scheme that turns regret minimizing algorithms into fixed point iterations, with convergence guarantees following from regret bounds. The resulting iterations can be seen as a grand extension of the classical…

Optimization and Control · Mathematics 2025-09-29 Joon Kwon

The Krasnoselskii-Mann iteration is an important algorithm in optimization and variational analysis for finding fixed points of nonexpansive mappings. In the general case, it produces a sequence converging \emph{weakly} to a fixed point…

Optimization and Control · Mathematics 2026-03-24 Sedi Bartz , Heinz H. Bauschke , Yuan Gao

In this paper we use proof mining methods to compute rates of ($T$-)asymptotic regularity of the generalized Krasnoselskii-Mann-type iteration associated to a nonexpansive mapping $T:X\to X$ in a uniformly convex normed space $X$. For…

Optimization and Control · Mathematics 2025-01-23 Paulo Firmino , Laurentiu Leustean

In the setting of CAT(k) spaces, common fixed point iterations built from prox mappings (e.g. prox-prox, Krasnoselsky-Mann relaxations, nonlinear projected-gradients) converge locally linearly under the assumption of linear metric…

Optimization and Control · Mathematics 2021-12-13 Florian Lauster , D. Russell Luke

Using the technique of enrichment of contractive type mappings by Krasnoselskij averaging, presented here for the first time, we introduce and study the class of {\it enriched nonexpansive mappings} in Hilbert spaces. In order to…

Functional Analysis · Mathematics 2019-09-06 Vasile Berinde

This paper considers a stochastic optimization problem over the fixed point sets of quasinonexpansive mappings on Riemannian manifolds. The problem enables us to consider Riemannian hierarchical optimization problems over complicated sets,…

Optimization and Control · Mathematics 2020-12-18 Hideaki Iiduka , Hiroyuki Sakai

We study a stochastic optimization problem in which the sampling distribution depends on the decision variable, and the available samples are generated through an iterate-dependent Markov chain. Such settings arise naturally in problems…

Optimization and Control · Mathematics 2026-05-18 Anik Kumar Paul , Shalabh Bhatnagar

We establish the weak convergence of inertial Krasnoselskii-Mann iterations towards a common fixed point of a family of quasi-nonexpansive operators, along with estimates for the non-asymptotic rate at which the residuals vanish. Strong and…

Optimization and Control · Mathematics 2023-08-23 Juan José Maulén , Ignacio Fierro , Juan Peypouquet

The problem of determining the (least) fixpoint of (higher-dimensional) functions over the non-negative reals frequently occurs when dealing with systems endowed with a quantitative semantics. We focus on the situation in which the…

Logic in Computer Science · Computer Science 2026-01-23 Paolo Baldan , Sebastian Gurke , Barbara König , Florian Wittbold

We consider maps defined on the interior of a normal, closed cone in a real Banach space that are nonexpansive with respect to Thompson's metric. With mild compactness assumptions, we prove that the Krasnoselskii iterates of such maps…

Functional Analysis · Mathematics 2023-08-15 Brian Lins

We study the problem of solving fixed-point equations for seminorm-contractive operators and establish foundational results on the non-asymptotic behavior of iterative algorithms in both deterministic and stochastic settings. Specifically,…

Machine Learning · Computer Science 2025-02-21 Zaiwei Chen , Sheng Zhang , Zhe Zhang , Shaan Ul Haque , Siva Theja Maguluri

In this paper we obtain a quadratic bound on the rate of asymptotic regularity for the Krasnoselski-Mann iterations of nonexpansive mappings in CAT(0)-spaces, whereas previous results guarantee only exponential bounds. The method we use is…

Functional Analysis · Mathematics 2007-05-23 Laurentiu Leustean

Motivated by applications in reinforcement learning (RL), we study a nonlinear stochastic approximation (SA) algorithm under Markovian noise, and establish its finite-sample convergence bounds under various stepsizes. Specifically, we show…

Optimization and Control · Mathematics 2022-01-27 Zaiwei Chen , Sheng Zhang , Thinh T. Doan , John-Paul Clarke , Siva Theja Maguluri

Multi-time-scale stochastic approximation is an iterative algorithm for finding the fixed point of a set of $N$ coupled operators given their noisy samples. It has been observed that due to the coupling between the decision variables and…

Optimization and Control · Mathematics 2024-09-13 Sihan Zeng , Thinh T. Doan

We study the performance of stochastic first-order methods for finding saddle points of convex-concave functions. A notorious challenge faced by such methods is that the gradients can grow arbitrarily large during optimization, which may…

Machine Learning · Computer Science 2024-06-10 Gergely Neu , Nneka Okolo

This paper is concerned with the study of a family of fixed point iterations combining relaxation with different inertial (acceleration) principles. We provide a systematic, unified and insightful analysis of the hypotheses that ensure…

Optimization and Control · Mathematics 2025-06-24 Daniel Cortild , Juan Peypouquet

We study Krasnoselskii-Mann style iterative algorithms for approximating fixpoints of asymptotically weakly contractive mappings, with a focus on providing generalised convergence proofs along with explicit rates of convergence. More…

Functional Analysis · Mathematics 2021-04-30 Thomas Powell , Franziskus Wiesnet

We study the convergence of stochastic fixed point iterations in the consistent case (in the sense of Butnariu and Fl{\aa}m (1995)) in several different settings, under decreasingly restrictive regularity assumptions of the fixed point…

Optimization and Control · Mathematics 2020-03-26 Neal Hermer , D. Russell Luke , Anja Sturm