English
Related papers

Related papers: A randomized Kaczmarz algorithm with exponential c…

200 papers

We describe an asynchronous parallel variant of the randomized Kaczmarz (RK) algorithm for solving the linear system $Ax=b$. The analysis shows linear convergence and indicates that nearly linear speedup can be expected if the number of…

Numerical Analysis · Mathematics 2014-06-10 Ji Liu , Stephen J. Wright , Srikrishna Sridhar

A greedy randomized nonlinear Bregman-Kaczmarz method by sampling the working index with residual information is developed for the solution of the constrained nonlinear system of equations. Theoretical analyses prove the convergence of the…

Numerical Analysis · Mathematics 2024-06-25 Aqin Xiao , Junfeng Yin

Tensor recovery has recently arisen in a lot of application fields, such as transportation, medical imaging and remote sensing. Under the assumption that signals possess sparse and/or low-rank structures, many tensor recovery methods have…

Optimization and Control · Mathematics 2021-02-16 Xuemei Chen , Jing Qin

Randomized linear solvers randomly compress and solve a linear system with compelling theoretical convergence rates and computational complexities. However, such solvers suffer a substantial disconnect between their theoretical rates and…

Numerical Analysis · Mathematics 2023-05-01 Vivak Patel , Mohammad Jahangoshahi , Daniel Adrian Maldonado

Randomized Kaczmarz (RK) is a simple and fast solver for consistent overdetermined systems, but it is known to be fragile under noise. We study overdetermined $m\times n$ linear systems with a sparse set of corrupted equations, $ {\bf…

Numerical Analysis · Mathematics 2026-02-16 Sofiia Shvaiko , Longxiu Huang , Elizaveta Rebrova

The Kaczmarz method is widely recognized as an efficient iterative algorithm for solving large-scale linear systems, owing to its simplicity and low memory requirements. However, the development of its nonlinear extensions for solving…

Numerical Analysis · Mathematics 2026-03-30 Renjie Ding , Dongling Wang , Jun Zou

Developing large-scale distributed methods that are robust to the presence of adversarial or corrupted workers is an important part of making such methods practical for real-world problems. Here, we propose an iterative approach that is…

Machine Learning · Computer Science 2022-03-02 Xia Li , Longxiu Huang , Deanna Needell

In this paper, several Kaczmarz-type numerical methods for solving the matrix equation $AX=B$ and $XA=C$ are proposed, where the coefficient matrix $A$ may be full rank or rank deficient. These methods are iterative methods without matrix…

Numerical Analysis · Mathematics 2023-06-01 Weiguo Li , Wendi Bao , Lili Xing , Zhiwei Guo

A Riemannian gradient descent algorithm and a truncated variant are presented to solve systems of phaseless equations $|Ax|^2=y$. The algorithms are developed by exploiting the inherent low rank structure of the problem based on the…

Numerical Analysis · Mathematics 2018-09-11 Jian-Feng Cai , Ke Wei

Recovering a signal $x^\ast \in \mathbb{R}^n$ from a sequence of linear measurements is an important problem in areas such as computerized tomography and compressed sensing. In this work, we consider an online setting in which measurements…

Numerical Analysis · Mathematics 2022-11-14 Benjamin Jarman , Yotam Yaniv , Deanna Needell

Large-scale linear systems, $Ax=b$, frequently arise in practice and demand effective iterative solvers. Often, these systems are noisy due to operational errors or faulty data-collection processes. In the past decade, the randomized…

Numerical Analysis · Mathematics 2024-08-26 El Houcine Bergou , Soumia Boucherouite , Aritra Dutta , Xin Li , Anna Ma

In this paper, we investigate the Kaczmarz-Tanabe method for exact and inexact linear systems. The Kaczmarz-Tanabe method is derived from the Kaczmarz method, but is more stable than that. We analyze the convergence and the convergence rate…

Numerical Analysis · Mathematics 2022-10-07 Chuan-gang Kang

Randomized iterative methods, such as the Kaczmarz method and its variants, have gained growing attention due to their simplicity and efficiency in solving large-scale linear systems. Meanwhile, absolute value equations (AVE) have attracted…

Numerical Analysis · Mathematics 2025-05-13 Jiaxin Xie , Hou-Duo Qi , Deren Han

We consider various iterative algorithms for solving the linear equation $ax=b$ using a quantum computer operating on the principle of quantum annealing. Assuming that the computer's output is described by the Boltzmann distribution, it is…

Quantum Physics · Physics 2023-10-25 V. Shalgin , S. Tikhomirov

Although it is relatively easy to apply, the gradient method often displays a disappointingly slow rate of convergence. Its convergence is specially based on the structure of the matrix of the algebraic linear system, and on the choice of…

Numerical Analysis · Mathematics 2025-06-03 Ibrahima Dione

We establish an improved classical algorithm for solving linear systems in a model analogous to the QRAM that is used by quantum linear solvers. Precisely, for the linear system $A\x = \b$, we show that there is a classical algorithm that…

Quantum Physics · Physics 2023-04-18 Changpeng Shao , Ashley Montanaro

Recent advancements in quantum computing and quantum-inspired algorithms have sparked renewed interest in binary optimization. These hardware and software innovations promise to revolutionize solution times for complex problems. In this…

We investigate modified steepest descent methods coupled with a loping Kaczmarz strategy for obtaining stable solutions of nonlinear systems of ill-posed operator equations. We show that the proposed method is a convergent regularization…

Numerical Analysis · Mathematics 2008-08-03 A. De Cezaro , M. Haltmeier , A. Leitao , O. Scherzer

Randomized Kaczmarz-type methods are widely used for their simplicity and efficiency in solving large-scale linear systems and optimization problems. However, their applicability is limited when dealing with inconsistent systems or…

Numerical Analysis · Mathematics 2025-12-11 Zeyu Dong , Aqin Xiao , Guojian Yin , Junfeng Yin

The randomized extended Kaczmarz method, proposed by Zouzias and Freris (SIAM J. Matrix Anal. Appl. 34: 773-793, 2013), is appealing for solving least-squares problems. However, its randomly selecting rows and columns of A with probability…

Numerical Analysis · Mathematics 2025-06-23 Xin-Fang Zhang , Meng-Long Xiao , Tao Li