English
Related papers

Related papers: Convergence analysis for a new faster iteration me…

200 papers

We present a simple way to learn a transformation that maps samples of one distribution to the samples of another distribution. Our algorithm comprises an iteration of 1) drawing samples from some simple distribution and transforming them…

Machine Learning · Computer Science 2018-07-03 Joose Rajamäki , Perttu Hämäläinen

Finding roots of equations is at the heart of most computational science. A well-known and widely used iterative algorithm is the Newton's method. However, its convergence depends heavily on the initial guess, with poor choices often…

Numerical Analysis · Mathematics 2020-04-09 Ankush Aggarwal , Sanjay Pant

In this article, we derive an iterative scheme through a quasi-Newton technique to capture robust weakly efficient points of uncertain multiobjective optimization problems under the upper set less relation. It is assumed that the set of…

Optimization and Control · Mathematics 2025-05-21 K. Gupta , D. Ghosh , C. Tammer , X. Zhao , J. C. Yao

In this paper we combine two existing approaches for approximating attractors. One of them approximates the attractors arbitrarily well by sublevel sets related to solutions of infinite dimensional linear programming problems. A downside…

Optimization and Control · Mathematics 2023-10-06 Corbinian Schlosser

We propose Iterative Homography Network, namely IHN, a new deep homography estimation architecture. Different from previous works that achieve iterative refinement by network cascading or untrainable IC-LK iterator, the iterator of IHN has…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Si-Yuan Cao , Jianxin Hu , Zehua Sheng , Hui-Liang Shen

This paper investigates optimal error bounds and convergence rates for general Mann iterations for computing fixed-points of non-expansive maps. We look for iterations that achieve the smallest fixed-point residual after $n$ steps, by…

Optimization and Control · Mathematics 2022-05-13 Juan Pablo Contreras , Roberto Cominetti

We survey permutation-based methods for approximate k-nearest neighbor search. In these methods, every data point is represented by a ranked list of pivots sorted by the distance to this point. Such ranked lists are called permutations. The…

Machine Learning · Computer Science 2016-11-01 Bilegsaikhan Naidan , Leonid Boytsov , Eric Nyberg

This article introduces new acceleration methods for fixed-point iterations. Extrapolations are computed using two or three mappings alternately and a new type of step length is proposed with good properties for nonlinear applications. The…

Optimization and Control · Mathematics 2021-08-17 Nicolas Lepage-Saucier

We define a stochastic variant of the proximal point algorithm in the general setting of nonlinear (separable) Hadamard spaces for approximating zeros of the mean of a stochastically perturbed monotone vector field and prove its convergence…

Optimization and Control · Mathematics 2025-10-14 Nicholas Pischke

In this work, a simple and efficient dual iterative refinement (DIR) method is proposed for dense correspondence between two nearly isometric shapes. The key idea is to use dual information, such as spatial and spectral, or local and global…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Rui Xiang , Rongjie Lai , Hongkai Zhao

Recent works by Bot-Fadili-Nguyen (arXiv:2510.22715) and by Jang-Ryu (arXiv:2510.23513) resolve long-standing iterate convergence questions for accelerated (proximal) gradient methods. In particular, Bot-Fadili-Nguyen prove weak convergence…

Optimization and Control · Mathematics 2025-11-11 Walaa M. Moursi , Andrew Naguib , Viktor Pavlovic , Stephen A. Vavasis

In this paper, we analyze the convergence of a risk sensitive like filter where the risk sensitivity parameter is time varying. Such filter has a Kalman like structure and its gain matrix is updated according to a Riccati like iteration. We…

Optimization and Control · Mathematics 2015-09-29 Mattia Zorzi , Bernard C. Levy

In this paper, firstly, we introduce the concept of convexity in A-metric spaces and show that Mann iteration process converges to the unique fixed point of Zamfirescu type contractions in this newly defined convex A-metric space. Secondly,…

General Topology · Mathematics 2021-01-18 Isa Yildirim

We prove convergence with optimal algebraic rates for an adaptive finite element method for nonlinear equations with strongly monotone operator. Unlike prior works, our analysis also includes the iterative and inexact solution of the…

Numerical Analysis · Mathematics 2018-11-27 Gregor Gantner , Alexander Haberl , Dirk Praetorius , Bernhard Stiftner

We consider the problem of minimizing a sum of $n$ functions over a convex parameter set $\mathcal{C} \subset \mathbb{R}^p$ where $n\gg p\gg 1$. In this regime, algorithms which utilize sub-sampling techniques are known to be effective. In…

Machine Learning · Statistics 2015-12-03 Murat A. Erdogdu , Andrea Montanari

A new framework for analyzing Fejer convergent algorithms is presented. Using this framework we define a very general class of Fejer convergent algorithms and establish its convergence properties. We also introduce a new definition of…

Optimization and Control · Mathematics 2012-04-19 B. F. Svaiter

In this paper, we establish sublinear and linear convergence of fixed point iterations generated by averaged operators in a Hilbert space. Our results are achieved under a bounded H\"older regularity assumption which generalizes the…

Optimization and Control · Mathematics 2018-08-16 Jonathan M. Borwein , Guoyin Li , Matthew K. Tam

Aitken extrapolation normally applied to convergent fixed point iteration is extended to extrapolate the solution of a divergent iteration. In addition, higher order Aitken extrapolation is introduced that enables successive decomposition…

Numerical Analysis · Mathematics 2013-10-17 Ababu Teklemariam Tiruneh

In this paper we consider, in the general context of CAT(0) spaces, an iterative schema which alternates between Halpern and Krasnoselskii-Mann style iterations. We prove, under suitable conditions, the strong convergence of this algorithm,…

Functional Analysis · Mathematics 2023-03-10 Bruno Dinis , Pedro Pinto

Iterative hard thresholding (IHT) has gained in popularity over the past decades in large-scale optimization. However, convergence properties of this method have only been explored recently in non-convex settings. In matrix completion,…

Optimization and Control · Mathematics 2023-01-11 Trung Vu , Evgenia Chunikhina , Raviv Raich