English
Related papers

Related papers: A Relaxed Randomized Averaging Block Extended Breg…

200 papers

The distributed Kaczmarz algorithm is an adaptation of the standard Kaczmarz algorithm to the situation in which data is distributed throughout a network represented by a tree. We isolate substructures of the network and study convergence…

Numerical Analysis · Mathematics 2020-06-03 Riley Borgard , Steven N. Harding , Haley Duba , Chloe Makdad , Jay Mayfield , Randal Tuggle , Eric Weber

The randomized Kaczmarz algorithm has received considerable attention recently because of its simplicity, speed, and the ability to approximately solve large-scale linear systems of equations. In this paper we propose randomized double and…

Numerical Analysis · Mathematics 2020-10-28 Kui Du , Xiao-Hui Sun

A class of fast greedy block Kaczmarz methods combined with general greedy strategy and average technique are proposed for solving large consistent linear systems. Theoretical analysis of the convergence of the proposed method is given in…

Numerical Analysis · Mathematics 2022-10-18 Aqin Xiao , Junfeng Yin , Ning Zheng

We present an enhanced version of the row-based randomized block-Kaczmarz method to solve a linear system of equations. This improvement makes use of a regularization during block updates in the solution, and a dynamic proposal distribution…

Numerical Analysis · Mathematics 2025-10-03 Suvendu Kar , Murugesan Venkatapathi

We study Kaczmarz type methods to solve consistent linear matrix equations. We first present a block Kaczmarz (BK) method that employs a deterministic cyclic row selection strategy. Assuming that the associated coefficient matrix has full…

Numerical Analysis · Mathematics 2026-02-04 Wenli Wang , Duo Liu , Gangrong Qu , Michiel E. Hochstenbach

The Kaczmarz algorithm is popular for iteratively solving an overdetermined system of linear equations. The traditional Kaczmarz algorithm can approximate the solution in few sweeps through the equations but a randomized version of the…

Numerical Analysis · Computer Science 2014-02-04 Hemant Kumar Aggarwal , Angshul Majumdar

The Randomized Kaczmarz method (RK) is a stochastic iterative method for solving linear systems that has recently grown in popularity due to its speed and low memory requirement. Selectable Set Randomized Kaczmarz (SSRK) is an variant of RK…

Numerical Analysis · Mathematics 2022-02-04 Yotam Yaniv , Jacob D. Moorman , William Swartworth , Thomas Tu , Daji Landis , Deanna Needell

We study a version of the randomized Kaczmarz algorithm for solving systems of linear equations where the iterates are confined to the solution space of a selected subsystem. We show that the subspace constraint leads to an accelerated…

Numerical Analysis · Mathematics 2024-06-11 Jackie Lok , Elizaveta Rebrova

Recovery of a sparse signal from a nonlinear system arises in many practical applications including compressive sensing, image reconstruction and machine learning. In this paper, a fast block nonlinear Bregman-Kaczmarz method with averaging…

Numerical Analysis · Mathematics 2025-02-24 Aqin Xiao , Xiangyu Gao , Jun-Feng Yin

The Kaczmarz algorithm is an iterative method that solves linear systems of equations. It stands out among iterative algorithms when dealing with large systems for two reasons. First, at each iteration, the Kaczmarz algorithm uses a single…

Numerical Analysis · Mathematics 2024-04-10 Inês A. Ferreira , Juan A. Acebrón , José Monteiro

The randomized sparse Kaczmarz method, designed for seeking the sparse solutions of the linear systems $Ax=b$, selects the $i$-th projection hyperplane with likelihood proportional to $\|a_{i}\|_2^2$, where $a_{i}^T$ is $i$-th row of $A$.…

Numerical Analysis · Mathematics 2023-06-13 Lu Zhang , Ziyang Yuan , Hongxia Wang , Hui Zhang

The sketch-and-project, as a general archetypal algorithm for solving linear systems, unifies a variety of randomized iterative methods such as the randomized Kaczmarz and randomized coordinate descent. However, since it aims to find a…

Numerical Analysis · Mathematics 2022-05-04 Ziyang Yuan , Lu Zhang , Hongxia Wang , Hui Zhang

Kaczmarz algorithm is an efficient iterative algorithm to solve overdetermined consistent system of linear equations. During each updating step, Kaczmarz chooses a hyperplane based on an individual equation and projects the current estimate…

Numerical Analysis · Computer Science 2015-11-20 Yujun Li , Kaichun Mo , Haishan Ye

We introduce a new iterative regularization method for solving inverse problems that can be written as systems of linear or non-linear equations in Hilbert spaces. The proposed averaged Kaczmarz (AVEK) method can be seen as a hybrid method…

Numerical Analysis · Mathematics 2018-03-09 Housen Li , Markus Haltmeier

The Bregman-Kaczmarz method is an iterative method which can solve strongly convex problems with linear constraints and uses only one or a selected number of rows of the system matrix in each iteration, thereby making it amenable for…

Optimization and Control · Mathematics 2023-07-31 Dirk A. Lorenz , Maximilian Winkler

The Kaczmarz algorithm is an iterative method for solving systems of linear equations. We introduce a modified Kaczmarz algorithm for solving systems of linear equations in a distributed environment, i.e. the equations within the system are…

Numerical Analysis · Mathematics 2019-04-12 Chinmay Hegde , Fritz Keinert , Eric S. Weber

The randomized projection (RP) method is a simple iterative scheme for solving linear feasibility problems and has recently gained popularity due to its speed and low memory requirement. This paper develops an accelerated variant of the…

Optimization and Control · Mathematics 2022-11-21 Lin Zhu , Yuan Lei , Jiaxin Xie

We propose a new randomized method for solving systems of nonlinear equations, which can find sparse solutions or solutions under certain simple constraints. The scheme only takes gradients of component functions and uses Bregman…

Optimization and Control · Mathematics 2024-02-26 Robert Gower , Dirk A. Lorenz , Maximilian Winkler

The Kaczmarz algorithm is one of the most popular methods for solving large-scale over-determined linear systems due to its simplicity and computational efficiency. This method can be viewed as a special instance of a more general class of…

Probability · Mathematics 2020-01-23 Deanna Needell , Elizaveta Rebrova

The Kaczmarz method is an iterative algorithm for solving systems of linear equations Ax=b. Theoretical convergence rates for this algorithm were largely unknown until recently when work was done on a randomized version of the algorithm. It…

Numerical Analysis · Mathematics 2010-04-01 Deanna Needell