English
Related papers

Related papers: Kaczmarz Algorithm with Soft Constraints for User …

200 papers

We study the Kaczmarz methods for solving systems of quadratic equations, i.e., the generalized phase retrieval problem. The methods extend the Kaczmarz methods for solving systems of linear equations by integrating a phase selection…

Numerical Analysis · Mathematics 2015-09-01 Ke Wei

The block Kaczmarz method is an iterative scheme for solving overdetermined least-squares problems. At each step, the algorithm projects the current iterate onto the solution space of a subset of the constraints. This paper describes a…

Numerical Analysis · Mathematics 2015-03-20 Deanna Needell , Joel A. Tropp

Randomized linear system solvers have become popular as they have the potential to reduce floating point complexity while still achieving desirable convergence rates. One particularly promising class of methods, random sketching solvers,…

Numerical Analysis · Mathematics 2020-12-23 Vivak Patel , Mohammad Jahangoshahi , Daniel Adrian Maldonado

Kaczmarz algorithm is an efficient iterative algorithm to solve overdetermined consistent system of linear equations. During each updating step, Kaczmarz chooses a hyperplane based on an individual equation and projects the current estimate…

Numerical Analysis · Computer Science 2015-11-20 Yujun Li , Kaichun Mo , Haishan Ye

The randomized Kaczmarz algorithm is one of the most popular approaches for solving large-scale linear systems due to its simplicity and efficiency. In this paper, we propose two classes of global randomized Kaczmarz methods for solving…

Numerical Analysis · Mathematics 2025-12-23 Yu-Qi Niu , Bing Zheng

The randomized Kaczmarz (RK) algorithm is one of the most computationally and memory-efficient iterative algorithms for solving large-scale linear systems. However, practical applications often involve noisy and potentially inconsistent…

Numerical Analysis · Mathematics 2025-10-10 El Houcine Bergou , Soumia Boucherouite , Aritra Dutta , Xin Li , Anna Ma

In this paper, we propose a federated algorithm for solving large linear systems that is inspired by the classic randomized Kaczmarz algorithm. We provide convergence guarantees of the proposed method, and as a corollary of our analysis, we…

Numerical Analysis · Mathematics 2025-05-15 Halyun Jeong , Deanna Needell , Chi-Hao Wu

To efficiently solve large scale nonlinear systems, we propose a novel Random Greedy Fast Block Kaczmarz method. This approach integrates the strengths of random and greedy strategies while avoiding the computationally expensive…

Numerical Analysis · Mathematics 2025-08-14 Renjie Ding , Dongling Wang

The randomized version of the Kaczmarz method for the solution of linear systems is known to converge linearly in expectation. In this work we extend this result and show that the recently proposed Randomized Sparse Kaczmarz method for…

Optimization and Control · Mathematics 2016-10-11 Frank Schöpfer , Dirk A. Lorenz

The Kaczmarz method is an iterative method for solving overcomplete linear systems of equations Ax=b. The randomized version of the Kaczmarz method put forth by Strohmer and Vershynin iteratively projects onto a randomly chosen solution…

Numerical Analysis · Mathematics 2015-06-24 Deanna Needell , Ran Zhao , Anastasios Zouzias

The Kaczmarz method is an iterative algorithm for solving systems of linear equalities and inequalities, that iteratively projects onto these constraints. Recently, Strohmer and Vershynin [J. Fourier Anal. Appl., 15(2):262-278, 2009] gave a…

Numerical Analysis · Mathematics 2016-12-26 Julie Nutini , Behrooz Sepehry , Issam Laradji , Mark Schmidt , Hoyt Koepke , Alim Virani

The randomized Kaczmarz method and its accelerated variants are a powerful class of iterative methods for solving large-scale linear systems, offering guaranteed convergence with low per-iteration cost. However, their numerical stability…

Numerical Analysis · Mathematics 2026-05-19 Michał Dereziński , Ethan N. Epperly , Deanna Needell , Alexander Xue

The randomized sparse Kaczmarz method, designed for seeking the sparse solutions of the linear systems $Ax=b$, selects the $i$-th projection hyperplane with likelihood proportional to $\|a_{i}\|_2^2$, where $a_{i}^T$ is $i$-th row of $A$.…

Numerical Analysis · Mathematics 2023-06-13 Lu Zhang , Ziyang Yuan , Hongxia Wang , Hui Zhang

The Kaczmarz algorithm is an iterative method for solving a system of linear equations. It can be extended so as to reconstruct a vector $x$ in a (separable) Hilbert space from the inner-products $\{\langle x, \phi_{n} \rangle\}$. The…

Functional Analysis · Mathematics 2018-11-02 Anna Aboud , Emelie Curl , Steven N. Harding , M. Vaughan , Eric S. Weber

The randomized Kaczmarz method is an iterative algorithm that solves overdetermined systems of linear equations. Recently, the method was extended to systems of equalities and inequalities by Leventhal and Lewis. Even more recently, Needell…

Numerical Analysis · Mathematics 2014-09-04 Jonathan Briskman , Deanna Needell

To find the least squares solution of a very large and inconsistent system of equations, one can employ the extended Kaczmarz algorithm. This method simultaneously removes the error term, such that a consistent system is asymptotically…

Numerical Analysis · Mathematics 2015-04-02 Stefania Petra , Constantin Popa

In this paper, by regarding the two-subspace Kaczmarz method [20] as an alternated inertial randomized Kaczmarz algorithm we present a new convergence rate estimate which is shown to be better than that in [20] under a mild condition.…

Numerical Analysis · Mathematics 2023-06-16 Songnian He , Ziting Wang , Qiao-Li Dong

Kaczmarz method is one popular iterative method for solving inverse problems, especially in computed tomography. Recently, it was established that a randomized version of the method enjoys an exponential convergence for well-posed problems,…

Numerical Analysis · Mathematics 2017-12-06 Yuling Jiao , Bangti Jin , Xiliang Lu

The Kaczmarz algorithm is an iterative technique designed to solve consistent linear systems of equations. It falls within the category of row-action methods, focusing on handling one equation per iteration. This characteristic makes it…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-01 Inês Ferreira , Juan A. Acebrón , José Monteiro

The Kaczmarz method for solving a linear system $Ax = b$ interprets such a system as a collection of equations $\left\langle a_i, x\right\rangle = b_i$, where $a_i$ is the $i-$th row of $A$, then picks such an equation and corrects $x_{k+1}…

Numerical Analysis · Mathematics 2021-09-15 Stefan Steinerberger