English
Related papers

Related papers: Solving systems of phaseless equations via Kaczmar…

200 papers

We propose a new method for preconditioning Kaczmarz method by sketching. Kaczmarz method is a stochastic method for solving overdetermined linear systems based on a sampling of matrix rows. The standard approach to speed up convergence of…

Numerical Analysis · Computer Science 2019-03-06 Alexandr Katrutsa , Ivan Oseledets

The randomized Kaczmarz algorithm is one of the most popular approaches for solving large-scale linear systems due to its simplicity and efficiency. In this paper, we propose two classes of global randomized Kaczmarz methods for solving…

Numerical Analysis · Mathematics 2025-12-23 Yu-Qi Niu , Bing Zheng

To find the least squares solution of a very large and inconsistent system of equations, one can employ the extended Kaczmarz algorithm. This method simultaneously removes the error term, such that a consistent system is asymptotically…

Numerical Analysis · Mathematics 2015-04-02 Stefania Petra , Constantin Popa

The article mainly introduces preprocessing algorithms for solving linear equation systems. This algorithm uses three algorithms as inner iterations, namely RPCG algorithm, ADI algorithm, and Kaczmarz algorithm. Then, it uses BA-GMRES as an…

Numerical Analysis · Mathematics 2024-04-10 Juan Zhang , Yiyi Luo

Stochastic iterative algorithms such as the Kaczmarz and Gauss-Seidel methods have gained recent attention because of their speed, simplicity, and the ability to approximately solve large-scale linear systems of equations without needing to…

Numerical Analysis · Mathematics 2019-01-10 Anna Ma , Deanna Needell , Aaditya Ramdas

We combine two iterative algorithms for solving large-scale systems of linear inequalities, the relaxation method of Agmon, Motzkin et al. and the randomized Kaczmarz method. In doing so, we obtain a family of algorithms that generalize and…

Optimization and Control · Mathematics 2019-06-05 Jesus De Loera , Jamie Haddock , Deanna Needell

The Kaczmarz algorithm is popular for iteratively solving an overdetermined system of linear equations. The traditional Kaczmarz algorithm can approximate the solution in few sweeps through the equations but a randomized version of the…

Numerical Analysis · Computer Science 2014-02-04 Hemant Kumar Aggarwal , Angshul Majumdar

The Kaczmarz algorithm (KA) is a popular method for solving a system of linear equations. In this note we derive a new exponential convergence result for the KA. The key allowing us to establish the new result is to rewrite the KA in such a…

Systems and Control · Computer Science 2015-06-23 Liang Dai , Thomas Schön

We study a version of the randomized Kaczmarz algorithm for solving systems of linear equations where the iterates are confined to the solution space of a selected subsystem. We show that the subspace constraint leads to an accelerated…

Numerical Analysis · Mathematics 2024-06-11 Jackie Lok , Elizaveta Rebrova

The Kaczmarz algorithm is a simple iterative scheme for solving consistent linear systems. At each step, the method projects the current iterate onto the solution space of a single constraint. Hence, it requires very low cost per iteration…

Optimization and Control · Mathematics 2019-02-27 Ion Necoara

A class of fast greedy block Kaczmarz methods combined with general greedy strategy and average technique are proposed for solving large consistent linear systems. Theoretical analysis of the convergence of the proposed method is given in…

Numerical Analysis · Mathematics 2022-10-18 Aqin Xiao , Junfeng Yin , Ning Zheng

The Kaczmarz algorithm is an iterative technique designed to solve consistent linear systems of equations. It falls within the category of row-action methods, focusing on handling one equation per iteration. This characteristic makes it…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-01 Inês Ferreira , Juan A. Acebrón , José Monteiro

The Kaczmarz method is an iterative numerical method for solving large and sparse rectangular systems of linear equations. Gearhart, Koshy and Tam have developed an acceleration technique for the Kaczmarz method that minimizes the distance…

Numerical Analysis · Mathematics 2022-01-26 Janosch Rieger

The Kaczmarz algorithm is a well known iterative method for solving overdetermined linear systems. Its randomized version yields provably exponential convergence in expectation. In this paper, we propose two new methods to speed up the…

Numerical Analysis · Computer Science 2016-08-02 Tengfei Ma

The Kaczmarz method is a popular iterative scheme for solving large-scale linear systems. The randomized Kaczmarz method (RK) greatly improves the convergence rate of the Kaczmarz method, by using the rows of the coefficient matrix in…

Numerical Analysis · Mathematics 2020-12-01 Yutong Jiang , Gang Wu , Long Jiang

In this paper, an extension of Kaczmarz method, the Kaczmarz method with oblique projection (KO), is introduced and analyzed. Using this method, a number of iteration steps to solve the over-determined systems of linear equations are…

Numerical Analysis · Mathematics 2021-06-28 Weiguo Li , Qifeng Wang , Wendi Bao , Li Liu

The randomized Kaczmarz (RK) method is an iterative method for approximating the least-squares solution of large linear systems of equations. The standard RK method uses sequential updates, making parallel computation difficult. Here, we…

Numerical Analysis · Mathematics 2020-02-12 Jacob D. Moorman , Thomas K. Tu , Denali Molitor , Deanna Needell

We develop procedures, based on minimization of the composition $f(x) = h(c(x))$ of a convex function $h$ and smooth function $c$, for solving random collections of quadratic equalities, applying our methodology to phase retrieval problems.…

Statistics Theory · Mathematics 2018-04-24 John C. Duchi , Feng Ruan

In this paper, by regarding the two-subspace Kaczmarz method [20] as an alternated inertial randomized Kaczmarz algorithm we present a new convergence rate estimate which is shown to be better than that in [20] under a mild condition.…

Numerical Analysis · Mathematics 2023-06-16 Songnian He , Ziting Wang , Qiao-Li Dong

Randomized Kaczmarz methods form a family of linear system solvers which converge by repeatedly projecting their iterates onto randomly sampled equations. While effective in some contexts, such as highly over-determined least squares,…

Numerical Analysis · Mathematics 2025-07-30 Michał Dereziński , Deanna Needell , Elizaveta Rebrova , Jiaming Yang