English
Related papers

Related papers: On Subsampled Quantile Randomized Kaczmarz

200 papers

Large-scale linear systems of the form $Ax=b$ are often doubly-noisy, in the sense that both its measurement matrix $A$ and measurement vector $b$ are noisy. In this paper, we extend the relaxed greedy randomized Kaczmarz (RGRK) method to…

Numerical Analysis · Mathematics 2026-04-01 Lu Zhang , Jinchuan Zeng , Hui Zhang

The standard randomized sparse Kaczmarz (RSK) method is an algorithm to compute sparse solutions of linear systems of equations and uses sequential updates, and thus, does not take advantage of parallel computations. In this work, we…

Numerical Analysis · Mathematics 2022-10-18 Lionel Tondji , Dirk A Lorenz

The Randomized Kaczmarz Algorithm is a randomized method which aims at solving a consistent system of over determined linear equations. This note discusses how to find an optimized randomization scheme for this algorithm, which is related…

Systems and Control · Computer Science 2016-11-17 Liang Dai , Mojtaba Soltanalian , Kristiaan Pelckmans

Randomized iterative algorithms for solving a factorized linear system, $\mathbf A\mathbf B\mathbf x=\mathbf b$ with $\mathbf A\in{\mathbb{R}}^{m\times \ell}$, $\mathbf B\in{\mathbb{R}}^{\ell\times n}$, and $\mathbf b\in{\mathbb{R}}^m$,…

Numerical Analysis · Mathematics 2023-07-25 Kui Du

Randomized block Kaczmraz method plays an important role in solving large-scale linear system. One of the key points of this type of methods is how to effectively select working rows. However, in most of the state-of-the-art randomized…

Numerical Analysis · Mathematics 2023-12-04 Gang Wu , Qiao Chang

In this paper, combining count sketch and maximal weighted residual Kaczmarz method, we propose a fast randomized algorithm for large overdetermined linear systems. Convergence analysis of the new algorithm is provided. Numerical…

Numerical Analysis · Mathematics 2020-04-07 Yanjun Zhang , Hanyu Li

The random reshuffling Kaczmarz (RRK) method enjoys the simplicity and efficiency in solving linear systems as a Kaczmarz-type method, whereas it also inherits the practical improvements of the stochastic gradient descent (SGD) with random…

Numerical Analysis · Mathematics 2025-08-08 Deren Han , Jiaxin Xie

The Kaczmarz algorithm is an iterative technique designed to solve consistent linear systems of equations. It falls within the category of row-action methods, focusing on handling one equation per iteration. This characteristic makes it…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-01 Inês Ferreira , Juan A. Acebrón , José Monteiro

To conduct a more in-depth investigation of randomized solvers for solving linear systems, we adopt a unified randomized batch-sampling Kaczmarz framework with per-iteration costs as low as cyclic block methods, and develop a general…

Numerical Analysis · Mathematics 2026-04-21 Dong-Yue Xie , Xi Yang

Quantum supremacy poses that a realistic quantum computer can perform a calculation that classical computers cannot in any reasonable amount of time. It has become a topic of significant research interest since the birth of the field, and…

Quantum Physics · Physics 2023-01-10 Kabgyun Jeong

The Kaczmarz method for solving linear systems of equations is an iterative algorithm that has found many applications ranging from computer tomography to digital signal processing. Despite the popularity of this method, useful theoretical…

Numerical Analysis · Mathematics 2007-05-23 Thomas Strohmer , Roman Vershynin

The randomized Kaczmarz ($\RK$) algorithm is a simple but powerful approach for solving consistent linear systems $Ax=b$. This paper proposes an accelerated randomized Kaczmarz ($\ARK$) algorithm with better convergence than the standard…

Numerical Analysis · Mathematics 2014-06-10 Ji Liu , Stephen J. Wright

The Randomized Kaczmarz method (RK) is a stochastic iterative method for solving linear systems that has recently grown in popularity due to its speed and low memory requirement. Selectable Set Randomized Kaczmarz (SSRK) is an variant of RK…

Numerical Analysis · Mathematics 2022-02-04 Yotam Yaniv , Jacob D. Moorman , William Swartworth , Thomas Tu , Daji Landis , Deanna Needell

The Kaczmarz algorithm is popular for iteratively solving an overdetermined system of linear equations. The traditional Kaczmarz algorithm can approximate the solution in few sweeps through the equations but a randomized version of the…

Numerical Analysis · Computer Science 2014-02-04 Hemant Kumar Aggarwal , Angshul Majumdar

The Extended Randomized Kaczmarz method is a well known iterative scheme which can find the Moore-Penrose inverse solution of a possibly inconsistent linear system and requires only one additional column of the system matrix in each…

Numerical Analysis · Mathematics 2022-07-21 Frank Schöpfer , Dirk A Lorenz , Lionel Tondji , Maximilian Winkler

Due to the ever growing amounts of data leveraged for machine learning and scientific computing, it is increasingly important to develop algorithms that sample only a small portion of the data at a time. In the case of linear least-squares,…

Machine Learning · Computer Science 2025-12-18 Gil Goldshlager , Jiang Hu , Lin Lin

The Kaczmarz method for solving a linear system $Ax = b$ interprets such a system as a collection of equations $\left\langle a_i, x\right\rangle = b_i$, where $a_i$ is the $i-$th row of $A$, then picks such an equation and corrects $x_{k+1}…

Numerical Analysis · Mathematics 2021-09-15 Stefan Steinerberger

Solving linear systems of equations is a fundamental problem in mathematics. When the linear system is so large that it cannot be loaded into memory at once, iterative methods such as the randomized Kaczmarz method excel. Here, we extend…

Numerical Analysis · Mathematics 2020-06-03 Anna Ma , Denali Molitor

The Kaczmarz algorithm is a popular solver for overdetermined linear systems due to its simplicity and speed. In this paper, we propose a modification that speeds up the convergence of the randomized Kaczmarz algorithm for systems of linear…

Numerical Analysis · Computer Science 2013-05-17 Hassan Mansour , Ozgur Yilmaz

We provide a complete characterization of the randomized Kaczmarz algorithm (RKA) for inconsistent linear systems. The Kaczmarz algorithm, known in some fields as the algebraic reconstruction technique, is a classical method for solving…

Numerical Analysis · Mathematics 2015-02-05 Chuang Wang , Ameya Agaskar , Yue M. Lu