English
Related papers

Related papers: GMRES with randomized sketching and deflated resta…

200 papers

Randomized sketching is currently introduced into every area of numerical linear algebra. In Krylov subspace methods, it allows runtime savings at the cost of small accuracy reductions. This work offers a different view on sketching in…

Numerical Analysis · Mathematics 2026-04-09 Kai Bergermann

For many applications involving a sequence of linear systems with slowly changing system matrices, subspace recycling, which exploits relationships among systems and reuses search space information, can achieve huge gains in iterations…

Numerical Analysis · Mathematics 2023-06-28 Misha E. Kilmer , Eric de Sturler

The discretization of convection-diffusion equations by implicit or semi-implicit methods leads to a sequence of linear systems usually solved by iterative linear solvers such as GMRES. Many techniques bearing the name of \emph{recycling…

Numerical Analysis · Mathematics 2018-07-26 Giuseppe Pitton , Luca Heltai

Thanks to its great potential in reducing both computational cost and memory requirements, combining sketching and Krylov subspace techniques has attracted a lot of attention in the recent literature on projection methods for linear…

Numerical Analysis · Mathematics 2024-06-12 Davide Palitta , Marcel Schweitzer , Valeria Simoncini

Many practical imaging systems suffer from uncertainty in acquisition geometry -- such as projection angles in computed tomography or sensor positions in photoacoustic tomography -- leading to nonlinear inverse problems that require joint…

Numerical Analysis · Mathematics 2026-05-08 Toluwani Okunola , Mirjeta Pasha , Misha E. Kilmer , James G. Nagy , Eric de Sturler

Randomized Krylov subspace methods that employ the sketch-and-solve paradigm to substantially reduce orthogonalization cost have recently shown great promise in speeding up computations for many core linear algebra tasks (e.g., solving…

Numerical Analysis · Mathematics 2026-03-13 Emil Krieger , Marcel Schweitzer

This paper presents two new augmented flexible (AF)-Krylov subspace methods, AF-GMRES and AF-LSQR, to compute solutions of large-scale linear discrete ill-posed problems that can be modeled as the sum of two independent random variables,…

Numerical Analysis · Mathematics 2023-10-10 Malena Sabate Landman , Jiahua Jiang , Jianru Zhang , Wuwei Ren

In this paper, we develop a new Randomized Global Generalized Minimum Residual (RGlGMRES) algorithm for efficiently computing solutions to large scale linear systems with multiple right hand sides.The proposed method builds on a recently…

Numerical Analysis · Mathematics 2026-02-17 Achraf Badahmane , Xian-Ming GU

One of the limitations of recycled GCRO methods is the large amount of computation required to orthogonalize the basis vectors of the newly generated Krylov subspace for the approximate solution when combined with those of the recycle…

Numerical Analysis · Mathematics 2023-06-12 Stephen Thomas , Alison Baker , Stephane Gaudreault

We consider solution of multiply shifted systems of nonsymmetric linear equations, possibly also with multiple right-hand sides. First, for a single right-hand side, the matrix is shifted by several multiples of the identity. Such problems…

Mathematical Physics · Physics 2008-11-26 Dean Darnell , Ronald B. Morgan , Walter Wilcox

An approach is given for solving large linear systems that combines Krylov methods with use of two different grid levels. Eigenvectors are computed on the coarse grid and used to deflate eigenvalues on the fine grid. GMRES-type methods are…

Numerical Analysis · Mathematics 2020-05-08 Ronald B. Morgan , Travis Whyte , Walter Wilcox , Zhao Yang

We derive an augmented Krylov subspace method with subspace recycling for computing a sequence of matrix function applications on a set of vectors. The matrix is either fixed or changes as the sequence progresses. We assume consecutive…

Numerical Analysis · Mathematics 2025-08-21 Liam Burke , Andreas Frommer , Gustavo Ramirez-Hidalgo , Kirk M. Soodhalter

This survey concerns subspace recycling methods, a popular class of iterative methods that enable effective reuse of subspace information in order to speed up convergence and find good initial guesses over a sequence of linear systems with…

Numerical Analysis · Mathematics 2020-07-30 Kirk M. Soodhalter , Eric de Sturler , Misha Kilmer

Model-based reconstruction plays a key role in compressed sensing (CS) MRI, as it incorporates effective image regularizers to improve the quality of reconstruction. The Plug-and-Play and Regularization-by-Denoising frameworks leverage…

Image and Video Processing · Electrical Eng. & Systems 2026-01-13 Tao Hong , Umberto Villa , Jeffrey A. Fessler

Krylov subspace recycling is a process for accelerating the convergence of sequences of linear systems. Based on this technique, the recycling BiCG algorithm has been developed recently. Here, we now generalize and extend this recycling…

Numerical Analysis · Mathematics 2015-01-27 Kapil Ahuja , Peter Benner , Eric de Sturler , Lihong Feng

We present two minimum residual methods for solving sequences of shifted linear systems, the right-preconditioned shifted GMRES and shifted recycled GMRES algorithms which use a seed projection strategy often employed to solve multiple…

Numerical Analysis · Mathematics 2016-02-04 Kirk M. Soodhalter

In this paper, two efficient iterative algorithms based on the simpler GMRES method are proposed for solving shifted linear systems. To make full use of the shifted structure, the proposed algorithms utilizing the deflated restarting…

Numerical Analysis · Mathematics 2021-07-26 Hong-Xiu Zhong , Xian-Ming Gu

In this paper we develop randomized Krylov subspace methods for efficiently computing regularized solutions to large-scale linear inverse problems. Building on the recently developed randomized Gram-Schmidt process, where sketched inner…

Numerical Analysis · Mathematics 2025-08-29 Julianne Chung , Silvia Gazzola

Many optimization problems require hyperparameters, i.e., parameters that must be pre-specified in advance, such as regularization parameters and parametric regularizers in variational regularization methods for inverse problems, and…

Optimization and Control · Mathematics 2025-10-09 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

We present a new short-recurrence reaidual-optimal Krylov subspace recycling method for sequences of Hermitian systems of linear equations with a fixed system matrix and changing right-hand sides. Such sequences of linear systems occur…

Numerical Analysis · Mathematics 2016-04-15 Martin Peter Neuenhofen , Sven Groß