English
Related papers

Related papers: Preprocessed GMRES for fast solution of linear equ…

200 papers

Stochastic iterative algorithms such as the Kaczmarz and Gauss-Seidel methods have gained recent attention because of their speed, simplicity, and the ability to approximately solve large-scale linear systems of equations without needing to…

Numerical Analysis · Mathematics 2019-01-10 Anna Ma , Deanna Needell , Aaditya Ramdas

This paper is about GMRES algorithms for the solution of nonsingular linear systems. We first consider basic algorithms and study their convergence. We then focus on acceleration strategies and parallel algorithms that are useful for…

Numerical Analysis · Mathematics 2023-02-08 Qinmeng Zou

The randomized Kaczmarz algorithm has received considerable attention recently because of its simplicity, speed, and the ability to approximately solve large-scale linear systems of equations. In this paper we propose randomized double and…

Numerical Analysis · Mathematics 2020-10-28 Kui Du , Xiao-Hui Sun

Randomized iterative methods, such as the Kaczmarz method and its variants, have gained growing attention due to their simplicity and efficiency in solving large-scale linear systems. Meanwhile, absolute value equations (AVE) have attracted…

Numerical Analysis · Mathematics 2025-05-13 Jiaxin Xie , Hou-Duo Qi , Deren Han

The Kaczmarz method is an algorithm for finding the solution to an overdetermined consistent system of linear equations Ax=b by iteratively projecting onto the solution spaces. The randomized version put forth by Strohmer and Vershynin…

Numerical Analysis · Mathematics 2011-02-15 Yonina C. Eldar , Deanna Needell

We combine two iterative algorithms for solving large-scale systems of linear inequalities, the relaxation method of Agmon, Motzkin et al. and the randomized Kaczmarz method. In doing so, we obtain a family of algorithms that generalize and…

Optimization and Control · Mathematics 2019-06-05 Jesus De Loera , Jamie Haddock , Deanna Needell

To efficiently solve large scale nonlinear systems, we propose a novel Random Greedy Fast Block Kaczmarz method. This approach integrates the strengths of random and greedy strategies while avoiding the computationally expensive…

Numerical Analysis · Mathematics 2025-08-14 Renjie Ding , Dongling Wang

We propose a new method for preconditioning Kaczmarz method by sketching. Kaczmarz method is a stochastic method for solving overdetermined linear systems based on a sampling of matrix rows. The standard approach to speed up convergence of…

Numerical Analysis · Computer Science 2019-03-06 Alexandr Katrutsa , Ivan Oseledets

A greedy randomized augmented Kaczmarz (GRAK) method was proposed in [Z.-Z. Bai and W.-T. WU, SIAM J. Sci. Comput., 43 (2021), pp. A3892-A3911] for large and sparse inconsistent linear systems. However, one has to construct two new index…

Numerical Analysis · Mathematics 2023-10-24 Shunchang Li , Gang Wu

The Kaczmarz method is an iterative algorithm for solving systems of linear equalities and inequalities, that iteratively projects onto these constraints. Recently, Strohmer and Vershynin [J. Fourier Anal. Appl., 15(2):262-278, 2009] gave a…

Numerical Analysis · Mathematics 2016-12-26 Julie Nutini , Behrooz Sepehry , Issam Laradji , Mark Schmidt , Hoyt Koepke , Alim Virani

A multi-step extended maximum residual Kaczmarz method is presented for the solution of the large inconsistent linear system of equations by using the multi-step iterations technique. Theoretical analysis proves the proposed method is…

Numerical Analysis · Mathematics 2023-09-07 Aqin Xiao , Junfeng Yin , Ning Zheng

Kaczmarz algorithm is an efficient iterative algorithm to solve overdetermined consistent system of linear equations. During each updating step, Kaczmarz chooses a hyperplane based on an individual equation and projects the current estimate…

Numerical Analysis · Computer Science 2015-11-20 Yujun Li , Kaichun Mo , Haishan Ye

The Kaczmarz method is an iterative numerical method for solving large and sparse rectangular systems of linear equations. Gearhart, Koshy and Tam have developed an acceleration technique for the Kaczmarz method that minimizes the distance…

Numerical Analysis · Mathematics 2022-01-26 Janosch Rieger

We consider the quantum implementations of the two classical iterative solvers for a system of linear equations, including the Kaczmarz method which uses a row of coefficient matrix in each iteration step, and the coordinate descent method…

Quantum Physics · Physics 2020-02-26 Changpeng Shao , Hua Xiang

A class of fast greedy block Kaczmarz methods combined with general greedy strategy and average technique are proposed for solving large consistent linear systems. Theoretical analysis of the convergence of the proposed method is given in…

Numerical Analysis · Mathematics 2022-10-18 Aqin Xiao , Junfeng Yin , Ning Zheng

In this research, to solve the large indefinite least squares problem, we firstly transform its normal equation into a sparse block three-by-three linear systems, then use GMRES method with an accelerated preconditioner to solve it. The…

Numerical Analysis · Mathematics 2025-05-26 Jun Li , Lingsheng Meng

A class of averaging block nonlinear Kaczmarz methods is developed for the solution of the nonlinear system of equations. The convergence theory of the proposed method is established under suitable assumptions and the upper bounds of the…

Numerical Analysis · Mathematics 2023-07-31 Aqin Xiao , Junfeng Yin

When solving linear systems $Ax=b$, $A$ and $b$ are given, but the measurements $b$ often contain corruptions. Inspired by recent work on the quantile-randomized Kaczmarz method, we propose an acceleration of the randomized Kaczmarz method…

Numerical Analysis · Mathematics 2024-10-18 Emeric Battaglia , Anna Ma

In this paper, an extension of Kaczmarz method, the Kaczmarz method with oblique projection (KO), is introduced and analyzed. Using this method, a number of iteration steps to solve the over-determined systems of linear equations are…

Numerical Analysis · Mathematics 2021-06-28 Weiguo Li , Qifeng Wang , Wendi Bao , Li Liu

The Randomized Kaczmarz Algorithm is a randomized method which aims at solving a consistent system of over determined linear equations. This note discusses how to find an optimized randomization scheme for this algorithm, which is related…

Systems and Control · Computer Science 2016-11-17 Liang Dai , Mojtaba Soltanalian , Kristiaan Pelckmans