English
Related papers

Related papers: Reverse Quantile-RK and its Application to Quantil…

200 papers

The randomized block Kaczmarz (RBK) method is a widely utilized iterative scheme for solving large-scale linear systems. However, the theoretical analysis and practical effectiveness of this method heavily rely on a good row paving of the…

Numerical Analysis · Mathematics 2025-03-19 Ruike Xiang , Jiaxin Xie , Qiye Zhang

The randomized Kaczmarz method and its accelerated variants are a powerful class of iterative methods for solving large-scale linear systems, offering guaranteed convergence with low per-iteration cost. However, their numerical stability…

Numerical Analysis · Mathematics 2026-05-19 Michał Dereziński , Ethan N. Epperly , Deanna Needell , Alexander Xue

Motivated by the randomized sketch to solve a variety of problems in scientific computation, we improve both the maximal weighted residual Kaczmarz method and the randomized block average Kaczmarz method using two new randomized sketch…

Numerical Analysis · Mathematics 2025-11-18 Haochen Jiang , Dongdong Liu , Xianping Wu , Xu Yang

Kaczmarz method is one popular iterative method for solving inverse problems, especially in computed tomography. Recently, it was established that a randomized version of the method enjoys an exponential convergence for well-posed problems,…

Numerical Analysis · Mathematics 2017-12-06 Yuling Jiao , Bangti Jin , Xiliang Lu

The block Kaczmarz method and its variants are designed for solving the over-determined linear system. They involve iteratively projecting the current point onto the solution space of a subset of constraints. In this work, by alternately…

Numerical Analysis · Mathematics 2023-11-02 Nian-Ci Wu , Yang Zhou , Zhaolu Tian

The Kaczmarz algorithm is a well known iterative method for solving overdetermined linear systems. Its randomized version yields provably exponential convergence in expectation. In this paper, we propose two new methods to speed up the…

Numerical Analysis · Computer Science 2016-08-02 Tengfei Ma

The randomized Kaczmarz (RK) method is a well-known approach for solving linear least-squares problems with a large number of rows. RK accesses and processes just one row at a time, leading to exponentially fast convergence for consistent…

Numerical Analysis · Mathematics 2025-04-11 Ethan N. Epperly , Gil Goldshlager , Robert J. Webber

The randomized Kaczmarz algorithm has received considerable attention recently because of its simplicity, speed, and the ability to approximately solve large-scale linear systems of equations. In this paper we propose randomized double and…

Numerical Analysis · Mathematics 2020-10-28 Kui Du , Xiao-Hui Sun

The Kaczmarz method is an iterative method for solving overcomplete linear systems of equations Ax=b. The randomized version of the Kaczmarz method put forth by Strohmer and Vershynin iteratively projects onto a randomly chosen solution…

Numerical Analysis · Mathematics 2015-06-24 Deanna Needell , Ran Zhao , Anastasios Zouzias

The Randomized Kaczmarz method (RK) is a stochastic iterative method for solving linear systems that has recently grown in popularity due to its speed and low memory requirement. Selectable Set Randomized Kaczmarz (SSRK) is an variant of RK…

Numerical Analysis · Mathematics 2022-02-04 Yotam Yaniv , Jacob D. Moorman , William Swartworth , Thomas Tu , Daji Landis , Deanna Needell

The randomized Kaczmarz (RK) algorithm is one of the most computationally and memory-efficient iterative algorithms for solving large-scale linear systems. However, practical applications often involve noisy and potentially inconsistent…

Numerical Analysis · Mathematics 2025-10-10 El Houcine Bergou , Soumia Boucherouite , Aritra Dutta , Xin Li , Anna Ma

In applications like medical imaging, error correction, and sensor networks, one needs to solve large-scale linear systems that may be corrupted by a small number of arbitrarily large corruptions. We consider solving such large-scale…

Numerical Analysis · Mathematics 2018-12-27 Jamie Haddock , Deanna Needell

Randomized Kaczmarz methods form a family of linear system solvers which converge by repeatedly projecting their iterates onto randomly sampled equations. While effective in some contexts, such as highly over-determined least squares,…

Numerical Analysis · Mathematics 2025-07-30 Michał Dereziński , Deanna Needell , Elizaveta Rebrova , Jiaming Yang

We present a new framework for the analysis and design of randomized algorithms for solving various types of linear systems, including consistent or inconsistent, full rank or rank-deficient. Our method is formulated with four randomized…

Optimization and Control · Mathematics 2022-08-25 Deren Han , Jiaxin Xie

Large-scale linear systems of the form $Ax=b$ are often doubly-noisy, in the sense that both its measurement matrix $A$ and measurement vector $b$ are noisy. In this paper, we extend the relaxed greedy randomized Kaczmarz (RGRK) method to…

Numerical Analysis · Mathematics 2026-04-01 Lu Zhang , Jinchuan Zeng , Hui Zhang

A randomized Kaczmarz method was recently proposed for phase retrieval, which has been shown numerically to exhibit empirical performance over other state-of-the-art phase retrieval algorithms both in terms of the sampling complexity and in…

Numerical Analysis · Mathematics 2021-09-27 Meng Huang , Yang Wang

Linear regression is effective at identifying interpretable trends in a data set, but averages out potentially different effects on subgroups within data. We propose an iterative algorithm based on the randomized Kaczmarz (RK) method to…

Numerical Analysis · Mathematics 2022-12-09 Erin George , Yotam Yaniv , Deanna Needell

To conduct a more in-depth investigation of randomized solvers for solving linear systems, we adopt a unified randomized batch-sampling Kaczmarz framework with per-iteration costs as low as cyclic block methods, and develop a general…

Numerical Analysis · Mathematics 2026-04-21 Dong-Yue Xie , Xi Yang

We present an enhanced version of the row-based randomized block-Kaczmarz method to solve a linear system of equations. This improvement makes use of a regularization during block updates in the solution, and a dynamic proposal distribution…

Numerical Analysis · Mathematics 2025-10-03 Suvendu Kar , Murugesan Venkatapathi

To efficiently solve large scale nonlinear systems, we propose a novel Random Greedy Fast Block Kaczmarz method. This approach integrates the strengths of random and greedy strategies while avoiding the computationally expensive…

Numerical Analysis · Mathematics 2025-08-14 Renjie Ding , Dongling Wang