English
Related papers

Related papers: Reflective block Kaczmarz algorithms for least squ…

200 papers

To exploit the benefits of massive multiple-input multiple-output (M-MIMO) technology in scenarios where base stations (BSs) need to be cheap and equipped with simple hardware, the computational complexity of classical signal processing…

Signal Processing · Electrical Eng. & Systems 2020-03-11 Victor Croisfelt Rodrigues , Jose Carlos Marinello Filho , Taufik Abrao

This paper presents novel adaptive reduced-rank filtering algorithms based on joint iterative optimization of adaptive filters. The novel scheme consists of a joint iterative optimization of a bank of full-rank adaptive filters that…

Information Theory · Computer Science 2013-04-30 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

The randomized Kaczmarz ($\RK$) algorithm is a simple but powerful approach for solving consistent linear systems $Ax=b$. This paper proposes an accelerated randomized Kaczmarz ($\ARK$) algorithm with better convergence than the standard…

Numerical Analysis · Mathematics 2014-06-10 Ji Liu , Stephen J. Wright

In the literature, there exist several studies on symbol-based multigrid methods for the solution of linear systems having structured coefficient matrices. In particular, the convergence analysis for such methods has been obtained in an…

Numerical Analysis · Mathematics 2021-11-15 Matthias Bolten , Marco Donatelli , Paola Ferrari , Isabella Furci

In this paper, we analyze the convergence behavior of the randomized extended Kaczmarz (REK) method for all types of linear systems (consistent or inconsistent, overdetermined or underdetermined, full-rank or rank-deficient). The analysis…

Numerical Analysis · Mathematics 2021-05-12 Yanjun Zhang , Hanyu Li

In this paper, we study the problem of finding the least square solutions of over-determined linear algebraic equations over networks in a distributed manner. Each node has access to one of the linear equations and holds a dynamic state. We…

Optimization and Control · Mathematics 2019-09-10 Tao Yang , Jemin George , Jiahu Qin , Xinlei Yi , Junfeng Wu

We propose two new algebraic reconstruction techniques based on Kaczmarz's method that produce a regularized solution to noisy tomography problems. Tomography problems exhibit semi-convergence when iterative methods are employed, and the…

Numerical Analysis · Mathematics 2021-01-29 Bart S. van Lith , Per Christian Hansen , Michiel E. Hochstenbach

We present a Projection onto Convex Sets (POCS) type algorithm for solving systems of linear equations. POCS methods have found many applications ranging from computer tomography to digital signal and image processing. The Kaczmarz method…

Numerical Analysis · Mathematics 2012-10-10 Deanna Needell , Rachel Ward

The matrix factor model has drawn growing attention for its advantage in achieving two-directional dimension reduction simultaneously for matrix-structured observations. In this paper, we propose a simple iterative least squares algorithm…

Methodology · Statistics 2023-08-02 Yong He , Ran Zhao , Wen-Xin Zhou

Computing quark propagators in lattice QCD is equivalent to solving large, sparse linear systems with multiple right-hand sides. Block algorithms attempt to accelerate the convergence of iterative Krylov-subspace methods by solving the…

High Energy Physics - Lattice · Physics 2009-10-30 Stephen M. Pickles , UKQCD Collaboration

We introduce an algorithm for the least squares solution of a rectangular linear system $Ax=b$, in which $A$ may be arbitrarily ill-conditioned. We assume that a complementary matrix $Z$ is known such that $A - AZ^*A$ is numerically low…

Numerical Analysis · Mathematics 2019-12-10 Vincent Coppe , Daan Huybrechs , Roel Matthysen , Marcus Webb

In this paper, we consider a novel two-dimensional randomized Kaczmarz method and its improved version with simple random sampling, which chooses two active rows with probability proportional to the square of their cross-product-like…

Numerical Analysis · Mathematics 2025-06-27 Tao Li , Meng-Long Xiao , Xin-Fang Zhang

In this paper, we consider the standard forms of two kinds of Kaczmarz-Tanabe type methods, one is derived from the Kaczmarz method and the other is derived from the symmetric Kaczmarz method. As a famous image reconstruction method in…

Numerical Analysis · Mathematics 2023-05-23 Chuan-gang Kang

We propose a new asynchronous parallel block-descent algorithmic framework for the minimization of the sum of a smooth nonconvex function and a nonsmooth convex one, subject to both convex and nonconvex constraints. The proposed framework…

Optimization and Control · Mathematics 2018-04-02 Loris Cannelli , Francisco Facchinei , Vyacheslav Kungurtsev , Gesualdo Scutari

The Kaczmarz method is an iterative numerical method for solving large and sparse rectangular systems of linear equations. Gearhart, Koshy and Tam have developed an acceleration technique for the Kaczmarz method that minimizes the distance…

Numerical Analysis · Mathematics 2022-01-26 Janosch Rieger

In this work, we shed light on the so-called Kaczmarz method for solving Linear System (LS) and Linear Feasibility (LF) problems from a optimization point of view. We introduce well-known optimization approaches such as Lagrangian penalty…

Optimization and Control · Mathematics 2022-08-15 Md Sarowar Morshed

Randomized iterative algorithms, such as the randomized Kaczmarz method, have gained considerable popularity due to their efficacy in solving matrix-vector and matrix-matrix regression problems. Our present work leverages the insights…

We show that an idea, originating initially with a fundamental recursive iteration scheme (usually referred as "the" Kaczmarz algorithm), admits important applications in such infinite-dimensional, and non-commutative, settings as are…

Functional Analysis · Mathematics 2019-04-10 Palle Jorgensen , Myung-Sin Song , Feng Tian

Differentiable systems in this paper means systems of equations that are described by differentiable real functions in real matrix variables. This paper proposes algorithms for finding minimal rank solutions to such systems over (arbitrary…

Optimization and Control · Mathematics 2017-05-30 Thanh Hieu Le

The nonlinear Kaczmarz method was recently proposed to solve the system of nonlinear equations. In this paper, we first discuss two greedy selection rules, i.e., the maximum residual and maximum distance rules, for the nonlinear Kaczmarz…

Numerical Analysis · Mathematics 2022-09-14 Yanjun Zhang , Hanyu Li , Ling Tang