English
Related papers

Related papers: Hybrid LSMR algorithms for large-scale general-for…

200 papers

This article presents a method for solving large-scale linear inverse problems regular- ized with a nonlinear, edge-preserving penalty term such as the total variation or Perona-Malik. In the proposed scheme, the nonlinearity is handled…

Numerical Analysis · Mathematics 2013-09-02 Simon R. Arridge , Marta M. Betcke , Lauri Harhanen

In this paper, we introduce a unified framework for nonlinear Krylov subspace methods (nlKrylov) to solve systems of nonlinear equations. Building on classical GCR-like/type linear Krylov solvers such as GMRESR, we generalize these…

Numerical Analysis · Mathematics 2025-11-19 Tom Werner , Ning Wan , Agnieszka Miedlar

The Kaczmarz method is a row-action method for solving consistent non-square linear systems, and Gearhart-Koshy acceleration is a line-search that minimizes the Euclidean norm of the error along a ray in the direction of a Kaczmarz step.…

Numerical Analysis · Mathematics 2025-06-18 Markus Hegland , Janosch Rieger

We present an overview of randomized orthogonalization techniques that construct a well-conditioned basis whose sketch is orthonormal. Randomized orthogonalization has recently emerged as a powerful paradigm for reducing the computational…

Numerical Analysis · Mathematics 2025-12-18 Jean-Guillaume de Damas , Laura Grigori , Igor Simunec , Edouard Timsit

With the recent emergence of mixed precision hardware, there has been a renewed interest in its use for solving numerical linear algebra problems fast and accurately. The solution of least squares (LS) problems $\min_x\|b-Ax\|_2$, where $A…

Numerical Analysis · Mathematics 2024-01-29 Erin Carson , Eda Oktay

In this paper, we are concerned with efficiently solving the sequences of regularized linear least squares problems associated with employing Tikhonov-type regularization with regularization operators designed to enforce edge recovery. An…

Numerical Analysis · Mathematics 2023-06-29 Matthias Bolten , Scott P. MacLachlan , Misha E. Kilmer

Meshless collocation with multiquadric radial basis functions (MQ-RBFs) delivers high accuracy for the three-dimensional Helmholtz equation but produces dense, severely ill-conditioned linear systems. We develop and evaluate three…

Numerical Analysis · Mathematics 2025-11-14 Mohamed El Guide , Khalide Jbilou , Kamal Lachhab , Driss Ouazar

Randomized orthogonal projection methods (ROPMs) can be used to speed up the computation of Krylov subspace methods in various contexts. Through a theoretical and numerical investigation, we establish that these methods produce…

Numerical Analysis · Mathematics 2023-03-14 Edouard Timsit , Laura Grigori , Oleg Balabanov

When solving ill-posed inverse problems, a good choice of the prior is critical for the computation of a reasonable solution. A common approach is to include a Gaussian prior, which is defined by a mean vector and a symmetric and positive…

Numerical Analysis · Mathematics 2020-04-01 Taewon Cho , Julianne Chung , Jiahua Jiang

We consider the linear least squares problem with linear equality constraints (LSE problem) formulated as $\min_{x\in\mathbb{R}^{n}}\|Ax-b\|_2 \ \mathrm{s.t.} \ Cx = d$. Although there are some classical methods available to solve this…

Numerical Analysis · Mathematics 2025-01-06 Haibo Li

Reconstructing high-quality images with sharp edges requires the use of edge-preserving constraints in the regularized form of the inverse problem. The use of the $\ell_q$-norm on the gradient of the image is a common such constraint. For…

Numerical Analysis · Mathematics 2023-09-28 Mirjeta Pasha , Eric de Sturler , Misha E. Kilmer

Recent development on mixed precision techniques has largely enhanced the performance of various linear algebra solvers, one of which being the solver for the least squares problem $\min_{x}\lVert b-Ax\rVert_{2}$. By transforming least…

Numerical Analysis · Mathematics 2025-09-09 Bowen Gao , Yuxin Ma , Meiyue Shao

A square-root-free matrix QR decomposition (QRD) scheme was rederived in [1] based on [2] to simplify computations when solving least-squares (LS) problems on embedded systems. The scheme of [1] aims at eliminating both the square-root and…

Numerical Analysis · Computer Science 2016-05-18 Mohammad M. Mansour

This paper addresses a quadratic problem with assignment constraints, an NP-hard combinatorial optimization problem arisen from facility location, multiple-input multiple-output detection, and maximum mean discrepancy calculation et al. The…

Optimization and Control · Mathematics 2025-12-15 Lijun Xie , Ran Gu , Xin Liu

It is well known that for singular inconsistent range-symmetric linear systems, the generalized minimal residual (GMRES) method determines a least squares solution without breakdown. The reached least squares solution may be or not be the…

Numerical Analysis · Mathematics 2024-01-24 Kui Du , Jia-Jun Fan , Fang Wang

We consider the solution of the $\ell_1$ regularized image deblurring problem using isotropic and anisotropic regularization implemented with the split Bregman algorithm. For large scale problems, we replace the system matrix $A$ using a…

Numerical Analysis · Mathematics 2024-10-02 Abdulmajeed Alsubhi , Rosemary Renaut

Randomized iterative methods, such as the randomized Kaczmarz method, have gained significant attention for solving large-scale linear systems due to their simplicity and efficiency. Meanwhile, Krylov subspace methods have emerged as a…

Numerical Analysis · Mathematics 2025-05-28 Yonghan Sun , Deren Han , Jiaxin Xie

This paper studies the Craig variant of the Golub-Kahan bidiagonalization algorithm as an iterative solver for linear systems with saddle point structure. Such symmetric indefinite systems in 2x2 block form arise in many applications, but…

Computational Engineering, Finance, and Science · Computer Science 2018-08-24 Mario Arioli , Carola Kruse , Ulrich Ruede , Nicolas Tardieu

In the numerical treatment of large-scale Sylvester and Lyapunov equations, projection methods require solving a reduced problem to check convergence. As the approximation space expands, this solution takes an increasing portion of the…

Numerical Analysis · Mathematics 2017-02-03 Davide Palitta , Valeria Simoncini

With the emergence of mixed precision capabilities in hardware, iterative refinement schemes for solving linear systems $Ax=b$ have recently been revisited and reanalyzed in the context of three or more precisions. These new analyses show…

Numerical Analysis · Mathematics 2022-02-17 Eda Oktay , Erin Carson