English
Related papers

Related papers: Krylov iterative methods for linear least squares …

200 papers

Krylov subspace methods, such as the Conjugate Gradient (CG) and BiCGSTAB methods, are widely used in scientific computing for solving linear systems. In this study, we propose a new framework for solving large Sylvester equations in a…

Numerical Analysis · Mathematics 2026-05-28 Yuki Satake , Takeshi Fukaya , Tomohiro Sogabe , Shao-Liang Zhang

There is a recent surge of interest in developing algorithms for finding sparse solutions of underdetermined systems of linear equations $y = \Phi x$. In many applications, extremely large problem sizes are envisioned, with at least tens of…

Information Theory · Computer Science 2009-04-08 Arian Maleki

We provide convergence rates for Krylov subspace solutions to the trust-region and cubic-regularized (nonconvex) quadratic problems. Such solutions may be efficiently computed by the Lanczos method and have long been used in practice. We…

Optimization and Control · Mathematics 2019-01-03 Yair Carmon , John C. Duchi

We consider the following constrained Rayleigh quotient optimization problem (CRQopt) $$ \min_{x\in \mathbb{R}^n} x^{T}Ax\,\,\mbox{subject to}\,\, x^{T}x=1\,\mbox{and}\,C^{T}x=b, $$ where $A$ is an $n\times n$ real symmetric matrix and $C$…

Numerical Analysis · Mathematics 2019-11-11 Yunshen Zhou , Zhaojun Bai , Ren-Cang Li

We propose an iterative quantum-assisted least squares (i-QLS) optimization method that leverages quantum annealing to overcome the scalability and precision limitations of prior quantum least squares approaches. Unlike traditional…

We describe a randomized Krylov-subspace method for estimating the spectral condition number of a real matrix A or indicating that it is numerically rank deficient. The main difficulty in estimating the condition number is the estimation of…

Numerical Analysis · Computer Science 2018-08-31 Haim Avron , Alex Druinsky , Sivan Toledo

- We discuss the approximation of distributed null controls for partial differential equations. The main purpose is to determine an approximation of controls that drives the solution from a prescribed initial state at the initial time to…

Optimization and Control · Mathematics 2015-10-14 Arnaud Münch , Pablo Pedregal

We compute a \emph{sparse} solution to the classical least-squares problem $\min_x||A x -b||,$ where $A$ is an arbitrary matrix. We describe a novel algorithm for this sparse least-squares problem. The algorithm operates as follows: first,…

Data Structures and Algorithms · Computer Science 2013-12-31 Christos Boutsidis , Malik Magdon-Ismail

Updating a linear least squares solution can be critical for near real-time signalprocessing applications. The Greville algorithm proposes a simple formula for updating the pseudoinverse of a matrix A $\in$ R nxm with rank r. In this paper,…

Mathematical Software · Computer Science 2021-06-23 Ruben Staub , Stephan N. Steinmann

This paper shows how partial differential problems can be solved thanks to cellular computing and an adaptation of the Least Squares Finite Elements Method. As cellular computing can be implemented on distributed parallel architectures,…

Mathematical Physics · Physics 2014-04-03 Nicolas Fressengeas , Hervé Frezza-Buet

There are many practical applications based on the Least Square Error (LSE) approximation. It is based on a square error minimization 'on a vertical' axis. The LSE method is simple and easy also for analytical purposes. However, if data…

Graphics · Computer Science 2018-02-22 Vaclav Skala

A discrete-time linear dynamical system (LDS) is given by an update matrix $M \in \mathbb{R}^{d\times d}$, and has the trajectories $\langle s, Ms, M^2s, \ldots \rangle$ for $s \in \mathbb{R}^d$. Reachability-type decision problems of…

Logic in Computer Science · Computer Science 2025-12-30 Toghrul Karimov

The solution of linear inverse problems when the unknown parameters outnumber data requires addressing the problem of a nontrivial null space. After restating the problem within the Bayesian framework, a priori information about the unknown…

Numerical Analysis · Mathematics 2015-03-25 Daniela Calvetti , Francesca Pitolli , Erkki Somersalo , Barbara Vantaggi

This paper presents two new augmented flexible (AF)-Krylov subspace methods, AF-GMRES and AF-LSQR, to compute solutions of large-scale linear discrete ill-posed problems that can be modeled as the sum of two independent random variables,…

Numerical Analysis · Mathematics 2023-10-10 Malena Sabate Landman , Jiahua Jiang , Jianru Zhang , Wuwei Ren

We propose a new algorithm for the problem of recovering data that adheres to multiple, heterogeneous low-dimensional structures from linear observations. Focusing on data matrices that are simultaneously row-sparse and low-rank, we propose…

Machine Learning · Computer Science 2024-01-19 Christian Kümmerle , Johannes Maly

Since numbers in the computer are represented with a fixed number of bits, loss of accuracy during calculation is unavoidable. At high precision where more bits (e.g. 64) are allocated to each number, round-off errors are typically small.…

Numerical Analysis · Mathematics 2022-10-11 Yizhou Chen , Xiaoyun Gong , Xiang Ji

The sparse linear reconstruction problem is a core problem in signal processing which aims to recover sparse solutions to linear systems. The original problem regularized by the total number of nonzero components (also known as $L_0$…

Optimization and Control · Mathematics 2025-11-19 Yuyuan Ouyang , Kyle Yates

We introduce an iterative solver named MINARES for symmetric linear systems $Ax \approx b$, where $A$ is possibly singular. MINARES is based on the symmetric Lanczos process, like MINRES and MINRES-QLP, but it minimizes $\|Ar_k\|$ in each…

Numerical Analysis · Mathematics 2023-10-04 Alexis Montoison , Dominique Orban , Michael A. Saunders

Nowadays, many fields of study are have to deal with large and sparse data matrixes, but the most important issue is finding the inverse of these matrixes. Thankfully, Krylov subspace methods can be used in solving these types of problem.…

Optimization and Control · Mathematics 2018-11-26 Shitao Fan

In this paper, we concentrate on the backward error and condition number of the indefinite least squares problem. For the normwise backward error of the indefinite least square problem, we adopt the linearization method to derive the tight…

Numerical Analysis · Mathematics 2016-12-21 Huai-An Diao , Tong-Yu Zhou