English
Related papers

Related papers: Reflective block Kaczmarz algorithms for least squ…

200 papers

In the recent paper [Duff I. et al, SIAM J. Sci. Comp., 37(3) (2015), A1248-A1269] the authors proposed an interesting procedure for the parallel solution of large, sparse consistent linear systems of equations. In this respect, according…

Numerical Analysis · Mathematics 2018-01-30 Andrei Dumitraşc , Constantin Popa

The randomized Kaczmarz (RK) algorithm is one of the most computationally and memory-efficient iterative algorithms for solving large-scale linear systems. However, practical applications often involve noisy and potentially inconsistent…

Numerical Analysis · Mathematics 2025-10-10 El Houcine Bergou , Soumia Boucherouite , Aritra Dutta , Xin Li , Anna Ma

The randomized extended Kaczmarz method, proposed by Zouzias and Freris (SIAM J. Matrix Anal. Appl. 34: 773-793, 2013), is appealing for solving least-squares problems. However, its randomly selecting rows and columns of A with probability…

Numerical Analysis · Mathematics 2025-06-23 Xin-Fang Zhang , Meng-Long Xiao , Tao Li

The Kaczmarz algorithm is a popular solver for overdetermined linear systems due to its simplicity and speed. In this paper, we propose a modification that speeds up the convergence of the randomized Kaczmarz algorithm for systems of linear…

Numerical Analysis · Computer Science 2013-05-17 Hassan Mansour , Ozgur Yilmaz

We propose iterative projection methods for solving square or rectangular consistent linear systems Ax = b. Existing projection methods use sketching matrices (possibly randomized) to generate a sequence of small projected subproblems, but…

Numerical Analysis · Mathematics 2023-12-13 Johannes J. Brust , Michael A. Saunders

With the growth of large data as well as large-scale learning tasks, the need for efficient and robust linear system solvers is greater than ever. The randomized Kaczmarz method (RK) and similar stochastic iterative methods have received…

Numerical Analysis · Mathematics 2023-01-04 Lu Cheng , Benjamin Jarman , Deanna Needell , Elizaveta Rebrova

The Extended Randomized Kaczmarz method is a well known iterative scheme which can find the Moore-Penrose inverse solution of a possibly inconsistent linear system and requires only one additional column of the system matrix in each…

Numerical Analysis · Mathematics 2022-07-21 Frank Schöpfer , Dirk A Lorenz , Lionel Tondji , Maximilian Winkler

The Kaczmarz method is successfully used for solving discretizations of linear inverse problems, especially in computed tomography where it is known as ART. Practitioners often observe and appreciate its fast convergence in the first few…

Numerical Analysis · Mathematics 2026-01-13 Per Christian Hansen , Michiel E. Hochstenbach

The Kaczmarz method is an iterative projection scheme for solving con-sistent system $Ax = b$. It is later extended to the inconsistent and ill-posed linear problems. But the classical Kaczmarz method is sensitive to the correlation of the…

Numerical Analysis · Mathematics 2022-10-04 Chuan-gang Kang , Heng Zhou

Randomized Kaczmarz methods form a family of linear system solvers which converge by repeatedly projecting their iterates onto randomly sampled equations. While effective in some contexts, such as highly over-determined least squares,…

Numerical Analysis · Mathematics 2025-07-30 Michał Dereziński , Deanna Needell , Elizaveta Rebrova , Jiaming Yang

The block Kaczmarz method and its variants are designed for solving the over-determined linear system. They involve iteratively projecting the current point onto the solution space of a subset of constraints. In this work, by alternately…

Numerical Analysis · Mathematics 2023-11-02 Nian-Ci Wu , Yang Zhou , Zhaolu Tian

Kaczmarz's alternating projection method has been widely used for solving a consistent (mostly over-determined) linear system of equations Ax=b. Because of its simple iterative nature with light computation, this method was successfully…

Numerical Analysis · Computer Science 2014-07-22 Tim Wallace , Ali Sekmen

The Kaczmarz algorithm is an iterative technique designed to solve consistent linear systems of equations. It falls within the category of row-action methods, focusing on handling one equation per iteration. This characteristic makes it…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-01 Inês Ferreira , Juan A. Acebrón , José Monteiro

We propose a simple doubly stochastic block Gauss--Seidel algorithm for solving linear systems of equations. By varying the row partition parameter and the column partition parameter of the coefficient matrix, we recover the Landweber…

Numerical Analysis · Mathematics 2020-07-09 Kui Du , Xiaohui Sun

In many modern imaging applications the desire to reconstruct high resolution images, coupled with the abundance of data from acquisition using ultra-fast detectors, have led to new challenges in image reconstruction. A main challenge is…

Numerical Analysis · Mathematics 2020-06-24 Julianne Chung , Matthias Chung , J. Tanner Slagel , Luis Tenorio

The randomzied Kaczmarz method, along with its recently developed variants, has become a popular tool for dealing with large-scale linear systems. However, these methods usually fail to converge when the linear systems are affected by heavy…

Optimization and Control · Mathematics 2023-10-09 Lu Zhang , Hongxia Wang , Hui Zhang

We provide a complete characterization of the randomized Kaczmarz algorithm (RKA) for inconsistent linear systems. The Kaczmarz algorithm, known in some fields as the algebraic reconstruction technique, is a classical method for solving…

Numerical Analysis · Mathematics 2015-02-05 Chuang Wang , Ameya Agaskar , Yue M. Lu

The distributed Kaczmarz algorithm is an adaptation of the standard Kaczmarz algorithm to the situation in which data is distributed throughout a network represented by a tree. We isolate substructures of the network and study convergence…

Numerical Analysis · Mathematics 2020-06-03 Riley Borgard , Steven N. Harding , Haley Duba , Chloe Makdad , Jay Mayfield , Randal Tuggle , Eric Weber

We investigate the randomized Kaczmarz method that adaptively updates the stepsize using readily available information for solving inconsistent linear systems. A novel geometric interpretation is provided which shows that the proposed…

Numerical Analysis · Mathematics 2023-03-17 Yun Zeng , Deren Han , Yansheng Su , Jiaxin Xie

Phase retrieval has been an attractive but difficult problem rising from physical science, and there has been a gap between state-of-the-art theoretical convergence analyses and the corresponding efficient retrieval methods. Firstly, these…

Information Theory · Computer Science 2017-12-06 Gen Li , Yuchen Jiao , Yuantao Gu