English
Related papers

Related papers: Krylov iterative methods for linear least squares …

200 papers

This paper presents the first results to combine two theoretically sound methods (spectral projection and multigrid methods) together to attack ill-conditioned linear systems. Our preliminary results show that the proposed algorithm applied…

Numerical Analysis · Mathematics 2016-02-18 Craig C. Douglas , Long Lee , Man-Chung Yeung

The hybrid LSMR algorithm is proposed for large-scale general-form regularization. It is based on a Krylov subspace projection method where the matrix $A$ is first projected onto a subspace, typically a Krylov subspace, which is implemented…

Numerical Analysis · Mathematics 2024-09-17 Yanfei Yang

The rational Krylov subspace method (RKSM) and the low-rank alternating directions implicit (LR-ADI) iteration are established numerical tools for computing low-rank solution factors of large-scale Lyapunov equations. In order to generate…

Numerical Analysis · Mathematics 2019-05-07 Patrick Kürschner , Melina A. Freitag

We investigate the regularizing behavior of an iterative Krylov subspace method for the solution of linear inverse problems in precisions lower than double. Recent works have considered the projection of iterated Tikhonov methods using…

Numerical Analysis · Mathematics 2025-12-02 Chelsea Drum , James. G. Nagy , Lucas Onisk

In this paper, we study a class of approximation problems, appearing in data approximation and signal processing. The approximations are constructed as combinations of polynomial splines (piecewise polynomials), whose parameters are subject…

Optimization and Control · Mathematics 2015-03-05 Zahra Roshan Zamir , Nadezda Sukhorukova

Many science and engineering applications involve solving a linear least-squares system formed from some field measurements. In the distributed cyber-physical systems (CPS), often each sensor node used for measurement only knows partial…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-23 Lei Shi , Liang Zhao , Wen-Zhan Song , Goutham Kamath , Yuan Wu , Xuefeng Liu

One of the most computationally expensive steps of the low-rank ADI method for large-scale Lyapunov equations is the solution of a shifted linear system at each iteration. We propose the use of the extended Krylov subspace method for this…

Numerical Analysis · Mathematics 2022-08-09 Peter Benner , Davide Palitta , Jens Saak

Total least squares (TLS) is an effective method for solving linear equations with the situations, when noise is not just in observation matrices but also in mapping matrices. Moreover, the Tikhonov regularization is widely used in plenty…

Numerical Analysis · Mathematics 2022-11-14 F. Han , Y. Wei , P. Xie

We apply novel inner-iteration preconditioned Krylov subspace methods to the interior-point algorithm for linear programming (LP). Inner-iteration preconditioners recently proposed by Morikuni and Hayami enable us to overcome the severe…

Optimization and Control · Mathematics 2021-11-09 Yiran Cui , Keiichi Morikuni , Takashi Tsuchiya , Ken Hayami

The article deals with iterative methods of solving linear operator equations $x = Bx + f$ and $Ax = f$ with self-adjoint operators in Hilbert space $X$ in critical case when $\rho(B) = 1$ and $0 \in {\rm Sp}\, A$. The main results are…

Functional Analysis · Mathematics 2014-12-04 O. V. Matysik , P. P. Zabreiko

Iteratively Re-weighted Least Squares (IRLS) is a method for solving minimization problems involving non-quadratic cost functions, perhaps non-convex and non-smooth, which however can be described as the infimum over a family of quadratic…

Numerical Analysis · Mathematics 2016-02-24 Massimo Fornasier , Steffen Peter , Holger Rauhut , Stephan Worm

We propose a new iteratively reweighted least squares (IRLS) algorithm for the recovery of a matrix $X \in \mathbb{C}^{d_1\times d_2}$ of rank $r \ll\min(d_1,d_2)$ from incomplete linear observations, solving a sequence of low complexity…

Numerical Analysis · Mathematics 2018-02-28 Christian Kümmerle , Juliane Sigl

As the scale of problems and data used for experimental design, signal processing and data assimilation grow, the oft-occuring least squares subproblems are correspondingly growing in size. As the scale of these least squares problems…

Computation · Statistics 2023-02-09 Nathaniel Pritchard , Vivak Patel

The method of ``Total Least Squares'' is proposed as a more natural way (than ordinary least squares) to approximate the data if both the matrix and and the right-hand side are contaminated by ``errors''. In this tutorial note, we give a…

Rings and Algebras · Mathematics 2025-10-20 P. P. N. de Groen

In this paper we propose a variant of the linear least squares model allowing practitioners to partition the input features into groups of variables that they require to contribute similarly to the final result. The output allows…

Machine Learning · Computer Science 2024-07-17 Roberto Esposito , Mattia Cerrato , Marco Locatelli

We present a parallel algorithm for the undirected $s,t$-mincut problem with floating-point valued weights. Our overarching algorithm uses an iteratively reweighted least squares framework. This generates a sequence of Laplacian linear…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-14 Yao Zhu , David F. Gleich

In the last decade, tensors have shown their potential as valuable tools for various tasks in numerical linear algebra. While most of the research has been focusing on how to compress a given tensor in order to maintain information as well…

Numerical Analysis · Mathematics 2024-09-17 Alberto Bucci , Davide Palitta , Leonardo Robol

CG, SYMMLQ, and MINRES are Krylov subspace methods for solving symmetric systems of linear equations. When these methods are applied to an incompatible system (that is, a singular symmetric least-squares problem), CG could break down and…

Numerical Analysis · Mathematics 2015-03-30 Sou-Cheng T. Choi , Christopher C. Paige , Michael A. Saunders

This paper is devoted to condition numbers of the multidimensional total least squares problem with linear equality constraint (TLSE). Based on the perturbation theory of invariant subspace, the TLSE problem is proved to be equivalent to a…

Numerical Analysis · Mathematics 2020-12-18 Qiaohua Liu , Zhigang Jia , Yimin Wei

In this article, we present a parallel recursive algorithm based on multi-level domain decomposition that can be used as a precondtioner to a Krylov subspace method to solve sparse linear systems of equations arising from the discretization…

Numerical Analysis · Mathematics 2012-10-24 Rahul S. Sampath , Bobby Philip , Srikanth Allu , Srdjan Simunovic