English
Related papers

Related papers: Krylov Subspace Recycling With Randomized Sketchin…

200 papers

Krylov subspace recycling is a process for accelerating the convergence of sequences of linear systems. Based on this technique, the recycling BiCG algorithm has been developed recently. Here, we now generalize and extend this recycling…

Numerical Analysis · Mathematics 2015-01-27 Kapil Ahuja , Peter Benner , Eric de Sturler , Lihong Feng

Thanks to its great potential in reducing both computational cost and memory requirements, combining sketching and Krylov subspace techniques has attracted a lot of attention in the recent literature on projection methods for linear…

Numerical Analysis · Mathematics 2024-06-12 Davide Palitta , Marcel Schweitzer , Valeria Simoncini

This paper describes practical randomized algorithms for low-rank matrix approximation that accommodate any budget for the number of views of the matrix. The presented algorithms, which are aimed at being as pass efficient as needed, expand…

Numerical Analysis · Mathematics 2018-05-25 Elvar K. Bjarkason

This work presents a new Krylov-subspace-recycling method for efficiently solving sequences of linear systems of equations characterized by varying right-hand sides and symmetric-positive-definite matrices. As opposed to typical truncation…

Numerical Analysis · Mathematics 2016-01-22 Kevin Carlberg , Virginia Forstall , Ray Tuminaro

We present a new short-recurrence reaidual-optimal Krylov subspace recycling method for sequences of Hermitian systems of linear equations with a fixed system matrix and changing right-hand sides. Such sequences of linear systems occur…

Numerical Analysis · Mathematics 2016-04-15 Martin Peter Neuenhofen , Sven Groß

Randomized block Krylov subspace methods form a powerful class of algorithms for computing the extreme eigenvalues of a symmetric matrix or the extreme singular values of a general matrix. The purpose of this paper is to develop new…

Numerical Analysis · Mathematics 2021-10-05 Joel A. Tropp

We propose an acceleration scheme for first-order methods (FOMs) for convex quadratic programs (QPs) that is analogous to Anderson acceleration and the Generalized Minimal Residual algorithm for linear systems. We motivate our proposed…

Optimization and Control · Mathematics 2026-04-09 Gabriel Berk Pereira , Paul J. Goulart

Rational Krylov subspaces have become a reference tool in dimension reduction procedures for several application problems. When data matrices are symmetric, a short-term recurrence can be used to generate an associated orthonormal basis. In…

Numerical Analysis · Mathematics 2021-12-21 Davide Palitta , Stefano Pozza , Valeria Simoncini

This work is concerned with the computation of the action of a matrix function f(A), such as the matrix exponential or the matrix square root, on a vector b. For a general matrix A, this can be done by computing the compression of A onto a…

Numerical Analysis · Mathematics 2023-06-06 Alice Cortinovis , Daniel Kressner , Yuji Nakatsukasa

We propose a fast algorithm for computing the entire ridge regression regularization path in nearly linear time. Our method constructs a basis on which the solution of ridge regression can be computed instantly for any value of the…

Optimization and Control · Mathematics 2022-10-25 Yifei Wang , Mert Pilanci

Bivariate matrix functions provide a unified framework for various tasks in numerical linear algebra, including the solution of linear matrix equations and the application of the Fr\'echet derivative. In this work, we propose a novel…

Numerical Analysis · Mathematics 2018-02-22 Daniel Kressner

Block Krylov subspace methods (KSMs) comprise building blocks in many state-of-the-art solvers for large-scale matrix equations as they arise, e.g., from the discretization of partial differential equations. While extended and rational…

Numerical Analysis · Mathematics 2020-02-06 Daniel Kressner , Kathryn Lund , Stefano Massei , Davide Palitta

In this paper a new restarting method for Krylov subspace matrix exponential evaluations is proposed. Since our restarting technique essentially employs the residual, some convergence results for the residual are given. We also discuss how…

Numerical Analysis · Mathematics 2018-12-27 Mikhail A. Botchev , Leonid A. Knizhnerman

The randomized SVD is a method to compute an inexpensive, yet accurate, low-rank approximation of a matrix. The algorithm assumes access to the matrix through matrix-vector products (matvecs). Therefore, when we would like to apply the…

Numerical Analysis · Mathematics 2025-12-01 David Persson , Tyler Chen , Christopher Musco

Randomized orthogonal projection methods (ROPMs) can be used to speed up the computation of Krylov subspace methods in various contexts. Through a theoretical and numerical investigation, we establish that these methods produce…

Numerical Analysis · Mathematics 2023-03-14 Edouard Timsit , Laura Grigori , Oleg Balabanov

Since being analyzed by Rokhlin, Szlam, and Tygert and popularized by Halko, Martinsson, and Tropp, randomized Simultaneous Power Iteration has become the method of choice for approximate singular value decomposition. It is more accurate…

Data Structures and Algorithms · Computer Science 2015-11-02 Cameron Musco , Christopher Musco

With the emergence of mixed precision capabilities in hardware, iterative refinement schemes for solving linear systems $Ax=b$ have recently been revisited and reanalyzed in the context of three or more precisions. These new analyses show…

Numerical Analysis · Mathematics 2022-02-17 Eda Oktay , Erin Carson

We develop an algorithm for computing the solution of a large system of linear ordinary differential equations (ODEs) with polynomial inhomogeneity. This is equivalent to computing the action of a certain matrix function on the vector…

Numerical Analysis · Mathematics 2012-05-16 Jitse Niesen , Will M. Wright

In this paper we develop randomized Krylov subspace methods for efficiently computing regularized solutions to large-scale linear inverse problems. Building on the recently developed randomized Gram-Schmidt process, where sketched inner…

Numerical Analysis · Mathematics 2025-08-29 Julianne Chung , Silvia Gazzola

Many Krylov subspace methods for shifted linear systems take advantage of the invariance of the Krylov subspace under a shift of the matrix. However, exploiting this fact in the non-Hermitian case introduces restrictions; e.g., initial…

Numerical Analysis · Mathematics 2016-02-05 Kirk M. Soodhalter