English
Related papers

Related papers: A randomized Kaczmarz algorithm with exponential c…

200 papers

Asynchronous methods for solving systems of linear equations have been researched since Chazan and Miranker's pioneering 1969 paper on chaotic relaxation. The underlying idea of asynchronous methods is to avoid processor idle time by…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-16 Haim Avron , Alex Druinsky , Anshul Gupta

Tensors serve as a crucial tool in the representation and analysis of complex, multi-dimensional data. As data volumes continue to expand, there is an increasing demand for developing optimization algorithms that can directly operate on…

Optimization and Control · Mathematics 2024-05-15 Katherine Henneberger , Jing Qin

In this article we develop and analyze novel iterative regularization techniques for the solution of systems of nonlinear ill--posed operator equations. The basic idea consists in considering separately each equation of this system and…

Numerical Analysis · Mathematics 2020-11-20 M. Haltmeier , A. Leitao , O. Scherzer

The reconstruction of tensor-valued signals from corrupted measurements, known as tensor regression, has become essential in many multi-modal applications such as hyperspectral image reconstruction and medical imaging. In this work, we…

The sketch-and-project (SAP) framework for solving systems of linear equations has unified the theory behind popular projective iterative methods such as randomized Kaczmarz, randomized coordinate descent, and variants thereof. The…

Numerical Analysis · Mathematics 2022-04-13 Benjamin Jarman , Nathan Mankovich , Jacob D. Moorman

A new method for solving Laplacian linear systems proposed by Kelner et al. involves the random sampling and update of fundamental cycles in a graph. Kelner et al. proved asymptotic bounds on the complexity of this method but did not report…

Data Structures and Algorithms · Computer Science 2015-10-07 Erik G. Boman , Kevin Deweese , John R. Gilbert

Randomized Kaczmarz (RK), Motzkin Method (MM) and Sampling Kaczmarz Motzkin (SKM) algorithms are commonly used iterative techniques for solving a system of linear inequalities (i.e., $Ax \leq b$). As linear systems of equations represent a…

Optimization and Control · Mathematics 2022-08-16 Md Sarowar Morshed , Md Saiful Islam , Md. Noor-E-Alam

One-bit quantization with time-varying sampling thresholds has recently found significant utilization potential in statistical signal processing applications due to its relatively low power consumption and low implementation cost. In…

Information Theory · Computer Science 2023-03-20 Arian Eamaz , Farhang Yeganegi , Deanna Needell , Mojtaba Soltanalian

In this paper, we analyze the greedy randomized Kaczmarz (GRK) method proposed in Bai and Wu (SIAM J. Sci. Comput., 40(1):A592--A606, 2018) for solving linear systems. We develop more precise greedy probability criteria to effectively…

Numerical Analysis · Mathematics 2023-11-15 Yansheng Su , Deren Han , Yun Zeng , Jiaxin Xie

In a recent paper, a distributed algorithm was proposed for solving linear algebraic equations of the form $Ax = b$ assuming that the equation has at least one solution. The equation is presumed to be solved by $m$ agents assuming that each…

Optimization and Control · Mathematics 2017-01-06 Ji Liu , A. Stephen Morse , Angelia Nedich , Tamer Basar

The Sampling Kaczmarz Motzkin (SKM) algorithm is a generalized method for solving large scale linear systems of inequalities. Having its root in the relaxation method of Agmon, Schoenberg, and Motzkin and the randomized Kaczmarz method, SKM…

Optimization and Control · Mathematics 2022-08-16 Md Sarowar Morshed , Md Saiful Islam , Md. Noor-E-Alam

Quantile-based randomized Kaczmarz (QRK) was recently introduced to efficiently solve sparsely corrupted linear systems $\mathbf{A} \mathbf{x}^*+\mathbf{\epsilon} = \mathbf{b}$ [SIAM J. Matrix Anal. Appl., 43(2), 605-637], where…

Numerical Analysis · Mathematics 2025-07-22 Jian-Feng Cai , Junren Chen , Anna Ma , Tong Wu

Iterative linear solvers have gained recent popularity due to their computational efficiency and low memory footprint for large-scale linear systems. The relaxation method, or Motzkin's method, can be viewed as an iterative method that…

Numerical Analysis · Mathematics 2018-10-30 Jamie Haddock , Deanna Needell

Linear equations play a pivotal role in many areas of science and engineering, making efficient solutions to linear systems highly desirable. The development of quantum algorithms for solving linear systems has been a significant…

Quantum Physics · Physics 2025-02-20 Nhat A. Nghiem

A randomized subspace action algorithm is investigated for fusion frame signal recovery problems. It is noted that Kaczmarz bounds provide upper bounds on the algorithm's error moments. The main question of which probability distributions…

Numerical Analysis · Mathematics 2015-04-24 Xuemei Chen , Alexander Powell

The Sparse Kaczmarz method is a famous and widely used iterative method for solving the regularized basis pursuit problem. A general scheme of the surrogate hyperplane sparse Kaczmarz method is proposed. In particular, a class of…

Numerical Analysis · Mathematics 2024-06-24 Ze Wang , Jun-Feng Yin , Ji-Chen Zhao

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

We present economical iterative algorithms built on the Biconjugate $A$-Orthonormalization Procedure for real unsymmetric and complex non-Hermitian systems. The principal characteristics of the developed solvers is that they are fast…

Numerical Analysis · Mathematics 2010-04-12 B. Carpentieri , Y. -F. Jing , T. -Z. Huang , Y. Duan

In many modern imaging applications the desire to reconstruct high resolution images, coupled with the abundance of data from acquisition using ultra-fast detectors, have led to new challenges in image reconstruction. A main challenge is…

Numerical Analysis · Mathematics 2020-06-24 Julianne Chung , Matthias Chung , J. Tanner Slagel , Luis Tenorio

Kaczmarz is one of the most prominent iterative solvers for linear systems of equations. Despite substantial research progress in recent years, the state-of-the-art Kaczmarz algorithms have not fully resolved the seesaw effect, a major…

Numerical Analysis · Mathematics 2025-09-24 Aneesh Panchal , Ratikanta Behera