English
Related papers

Related papers: Kaczmarz Kac Walk

200 papers

The distributed Kaczmarz algorithm is an adaptation of the standard Kaczmarz algorithm to the situation in which data is distributed throughout a network represented by a tree. We isolate substructures of the network and study convergence…

Numerical Analysis · Mathematics 2020-06-03 Riley Borgard , Steven N. Harding , Haley Duba , Chloe Makdad , Jay Mayfield , Randal Tuggle , Eric Weber

This paper is about randomized iterative algorithms for solving a linear system of equations $X \beta = y$ in different settings. Recent interest in the topic was reignited when Strohmer and Vershynin (2009) proved the linear convergence…

Optimization and Control · Mathematics 2014-06-23 Aaditya Ramdas

The Helmholtz equation arises in many applications, such as seismic and medical imaging. These application are characterized by the need to propagate many wavelengths through an inhomogeneous medium. The typical size of the problems in 3D…

Numerical Analysis · Mathematics 2013-09-23 Tristan van Leeuwen

A new method for solving Laplacian linear systems proposed by Kelner et al. involves the random sampling and update of fundamental cycles in a graph. Kelner et al. proved asymptotic bounds on the complexity of this method but did not report…

Data Structures and Algorithms · Computer Science 2015-10-07 Erik G. Boman , Kevin Deweese , John R. Gilbert

The Kaczmarz method (KZ) and its variants, which are types of stochastic gradient descent (SGD) methods, have been extensively studied due to their simplicity and efficiency in solving linear equation systems. The iterative thresholding…

Machine Learning · Statistics 2023-04-21 Halyun Jeong , Deanna Needell

In this article a modified Levenberg-Marquardt method coupled with a Kaczmarz strategy for obtaining stable solutions of nonlinear systems of ill-posed operator equations is investigated. We show that the proposed method is a convergent…

Numerical Analysis · Mathematics 2020-11-20 J. Baumeister , B. Kaltenbacher , A. Leitao

The Kaczmarz method is a row-action method for solving consistent non-square linear systems, and Gearhart-Koshy acceleration is a line-search that minimizes the Euclidean norm of the error along a ray in the direction of a Kaczmarz step.…

Numerical Analysis · Mathematics 2025-06-18 Markus Hegland , Janosch Rieger

In [Steinerberger, Q. Appl. Math., 79:3, 419-429, 2021] and [Shao, SIAM J. Matrix Anal. Appl. 44(1), 212-239, 2023], two new types of Kaczmarz algorithms, which share some similarities, for consistent linear systems were proposed. These two…

Numerical Analysis · Mathematics 2024-07-30 Changpeng Shao

The Kaczmarz algorithm in Hilbert spaces is a classical iterative method for stably recovering vectors from inner product data. In this paper, we extend the algorithm to the setting of Hilbert $C^*$-modules and establish analogues of its…

Functional Analysis · Mathematics 2025-08-20 Daniel Alpay , Chad Berner , Eric S. Weber

The Kaczmarz and Gauss-Seidel methods both solve a linear system $\bf{X}\bf{\beta} = \bf{y}$ by iteratively refining the solution estimate. Recent interest in these methods has been sparked by a proof of Strohmer and Vershynin which shows…

Numerical Analysis · Mathematics 2018-02-05 Anna Ma , Deanna Needell , Aaditya Ramdas

We first explore methods for approximating the commute time and Katz score between a pair of nodes. These methods are based on the approach of matrices, moments, and quadrature developed in the numerical linear algebra community. They rely…

Social and Information Networks · Computer Science 2012-03-08 Francesco Bonchi , Pooya Esfandiar , David F. Gleich , Chen Greif , Laks V. S. Lakshmanan

The Sampling Kaczmarz Motzkin (SKM) algorithm is a generalized method for solving large scale linear systems of inequalities. Having its root in the relaxation method of Agmon, Schoenberg, and Motzkin and the randomized Kaczmarz method, SKM…

Optimization and Control · Mathematics 2022-08-16 Md Sarowar Morshed , Md Saiful Islam , Md. Noor-E-Alam

A simple iteration methodology for the solution of a set of a linear algebraic equations is presented. The explanation of this method is based on a pure geometrical interpretation and pictorial representation. Convergence using this method…

Computational Physics · Physics 2010-12-30 Avas V. Khugaev , Renat A. Sultanov , D. Guster

A type of iterative orthogonally accumulated projection methods for solving linear system of equations are proposed in this paper. This type of methods are applications of accumulated projection(AP) technique proposed recently by authors.…

Numerical Analysis · Mathematics 2016-08-24 Wujian Peng , Shuhua Zhang

Solving a Radon-Kaczmarz puzzle involves filling a square grid with positive integers, each between one and nine, satisfying certain clues coming from the sum of entries that lie on the same line in the square grid. Given a set of slopes…

Combinatorics · Mathematics 2018-12-07 Steven Rossi , Xiao Xiao

We present new adaptive sampling rules for the sketch-and-project method for solving linear systems. To deduce our new sampling rules, we first show how the progress of one step of the sketch-and-project method depends directly on a…

Numerical Analysis · Mathematics 2019-09-10 Robert Gower , Denali Molitor , Jacob Moorman , Deanna Needell

Given a full column rank matrix $A \in \mathbb{R}^{m\times n}$ ($m\geq n$), we consider a special class of linear systems of the form $A^\top Ax=A^\top b+c$ with $x, c \in \mathbb{R}^{n}$ and $b \in \mathbb{R}^{m}$. The occurrence of $c$ in…

Numerical Analysis · Mathematics 2019-11-04 Henri Calandra , Serge Gratton , Elisa Riccietti , Xavier Vasseur

In this article we combine the projective Landweber method, recently proposed by the authors, with Kaczmarz's method for solving systems of non-linear ill-posed equations. The underlying assumption used in this work is the tangential cone…

Numerical Analysis · Mathematics 2020-11-12 A. Leitao , B. F. Svaiter

We develop the Akhiezer iteration, a generalization of the classical Chebyshev iteration, for the inner product-free, iterative solution of indefinite linear systems using orthogonal polynomials for measures supported on multiple, disjoint…

Numerical Analysis · Mathematics 2024-01-18 Cade Ballew , Thomas Trogdon

An iterative method LSMR is presented for solving linear systems $Ax=b$ and least-squares problem $\min \norm{Ax-b}_2$, with $A$ being sparse or a fast linear operator. LSMR is based on the Golub-Kahan bidiagonalization process. It is…

Mathematical Software · Computer Science 2012-01-25 David Fong , Michael Saunders