English
Related papers

Related papers: A randomized Kaczmarz algorithm with exponential c…

200 papers

In this paper, an extension of Kaczmarz method, the Kaczmarz method with oblique projection (KO), is introduced and analyzed. Using this method, a number of iteration steps to solve the over-determined systems of linear equations are…

Numerical Analysis · Mathematics 2021-06-28 Weiguo Li , Qifeng Wang , Wendi Bao , Li Liu

In this technical report we present a Projection onto Convex Sets (POCS) type algorithm for solving systems of linear equations. POCS methods have found many applications ranging from computer tomography to digital signal and image…

Numerical Analysis · Mathematics 2012-04-03 Deanna Needell , Rachel Ward

A class of averaging block nonlinear Kaczmarz methods is developed for the solution of the nonlinear system of equations. The convergence theory of the proposed method is established under suitable assumptions and the upper bounds of the…

Numerical Analysis · Mathematics 2023-07-31 Aqin Xiao , Junfeng Yin

A multi-step extended maximum residual Kaczmarz method is presented for the solution of the large inconsistent linear system of equations by using the multi-step iterations technique. Theoretical analysis proves the proposed method is…

Numerical Analysis · Mathematics 2023-09-07 Aqin Xiao , Junfeng Yin , Ning Zheng

Randomized iterative algorithms have attracted much attention in recent years because they can approximately solve large-scale linear systems of equations without accessing the entire coefficient matrix. In this paper, we propose two novel…

Numerical Analysis · Mathematics 2021-10-22 Kui Du , Xiao-Hui Sun

The Kaczmarz algorithm is an iterative technique designed to solve consistent linear systems of equations. It falls within the category of row-action methods, focusing on handling one equation per iteration. This characteristic makes it…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-01 Inês Ferreira , Juan A. Acebrón , José Monteiro

Randomized Kaczmarz is a simple iterative method for finding solutions of linear systems $Ax = b$. We point out that the arising sequence $(x_k)_{k=1}^{\infty}$ tends to converge to the solution $x$ in an interesting way: generically, as $k…

Numerical Analysis · Mathematics 2021-09-15 Stefan Steinerberger

The block Kaczmarz method is an iterative scheme for solving overdetermined least-squares problems. At each step, the algorithm projects the current iterate onto the solution space of a subset of the constraints. This paper describes a…

Numerical Analysis · Mathematics 2015-03-20 Deanna Needell , Joel A. Tropp

To efficiently solve large scale nonlinear systems, we propose a novel Random Greedy Fast Block Kaczmarz method. This approach integrates the strengths of random and greedy strategies while avoiding the computationally expensive…

Numerical Analysis · Mathematics 2025-08-14 Renjie Ding , Dongling Wang

The randomized Kaczmarz algorithm is one of the most popular approaches for solving large-scale linear systems due to its simplicity and efficiency. In this paper, we propose two classes of global randomized Kaczmarz methods for solving…

Numerical Analysis · Mathematics 2025-12-23 Yu-Qi Niu , Bing Zheng

Randomized block Kaczmraz method plays an important role in solving large-scale linear system. One of the key points of this type of methods is how to effectively select working rows. However, in most of the state-of-the-art randomized…

Numerical Analysis · Mathematics 2023-12-04 Gang Wu , Qiao Chang

We investigate the randomized Kaczmarz method that adaptively updates the stepsize using readily available information for solving inconsistent linear systems. A novel geometric interpretation is provided which shows that the proposed…

Numerical Analysis · Mathematics 2023-03-17 Yun Zeng , Deren Han , Yansheng Su , Jiaxin Xie

The Kaczmarz method is an iterative projection scheme for solving con-sistent system $Ax = b$. It is later extended to the inconsistent and ill-posed linear problems. But the classical Kaczmarz method is sensitive to the correlation of the…

Numerical Analysis · Mathematics 2022-10-04 Chuan-gang Kang , Heng Zhou

We present an enhanced version of the row-based randomized block-Kaczmarz method to solve a linear system of equations. This improvement makes use of a regularization during block updates in the solution, and a dynamic proposal distribution…

Numerical Analysis · Mathematics 2025-10-03 Suvendu Kar , Murugesan Venkatapathi

This paper is about randomized iterative algorithms for solving a linear system of equations $X \beta = y$ in different settings. Recent interest in the topic was reignited when Strohmer and Vershynin (2009) proved the linear convergence…

Optimization and Control · Mathematics 2014-06-23 Aaditya Ramdas

Randomized regularized Kaczmarz algorithms have recently been proposed to solve tensor recovery models with {\it consistent} linear measurements. In this work, we propose a novel algorithm based on the randomized extended Kaczmarz algorithm…

Numerical Analysis · Mathematics 2021-12-17 Kui Du , Xiao-Hui Sun

The Kaczmarz method is an iterative method for solving large systems of equations that projects iterates orthogonally onto the solution space of each equation. In contrast to direct methods such as Gaussian elimination or QR-factorization,…

Numerical Analysis · Computer Science 2013-09-30 Noreen Jamil , Deanna Needell , Johannes Muller , Christof Lutteroth , Gerald Weber

In this paper, for solving inconsistent matrix equations we propose a dual-space residual-based randomized extended Kaczmarz method and its version with Nesterov momentum. Without the full column rank assumptions on coefficient matrices, we…

Numerical Analysis · Mathematics 2026-04-08 Wendi Bao , Jing Li , Lili Xing , Weiguo Li , Jichao Wang

The Kaczmarz algorithm is an iterative method for solving a system of linear equations. It can be extended so as to reconstruct a vector $x$ in a (separable) Hilbert space from the inner-products $\{\langle x, \phi_{n} \rangle\}$. The…

Functional Analysis · Mathematics 2018-11-02 Anna Aboud , Emelie Curl , Steven N. Harding , M. Vaughan , Eric S. Weber

The randomized Kaczmarz method and its accelerated variants are a powerful class of iterative methods for solving large-scale linear systems, offering guaranteed convergence with low per-iteration cost. However, their numerical stability…

Numerical Analysis · Mathematics 2026-05-19 Michał Dereziński , Ethan N. Epperly , Deanna Needell , Alexander Xue