English
Related papers

Related papers: Krylov Subspace Recycling With Randomized Sketchin…

200 papers

We present an overview of randomized orthogonalization techniques that construct a well-conditioned basis whose sketch is orthonormal. Randomized orthogonalization has recently emerged as a powerful paradigm for reducing the computational…

Numerical Analysis · Mathematics 2025-12-18 Jean-Guillaume de Damas , Laura Grigori , Igor Simunec , Edouard Timsit

During the past decade, Model Order Reduction (MOR) has become key enabler for the efficient simulation of large circuit models. MOR techniques based on moment-matching are well established due to their simplicity and computational…

Iterative Krylov projection methods have become widely used for solving large-scale linear inverse problems. However, methods based on orthogonality include the computation of inner-products, which become costly when the number of…

Numerical Analysis · Mathematics 2025-02-06 Malena Sabaté Landman , Ariana N. Brown , Julianne Chung , James G. Nagy

We propose algorithms for efficient time integration of large systems of oscillatory second order ordinary differential equations (ODEs) whose solution can be expressed in terms of trigonometric matrix functions. Our algorithms are based on…

Numerical Analysis · Mathematics 2023-04-07 M. A. Botchev , L. A. Knizhnerman , M. Schweitzer

Reconstructing high-quality images with sharp edges requires the use of edge-preserving constraints in the regularized form of the inverse problem. The use of the $\ell_q$-norm on the gradient of the image is a common such constraint. For…

Numerical Analysis · Mathematics 2023-09-28 Mirjeta Pasha , Eric de Sturler , Misha E. Kilmer

We describe a Lanczos-based algorithm for approximating the product of a rational matrix function with a vector. This algorithm, which we call the Lanczos method for optimal rational matrix function approximation (Lanczos-OR), returns the…

Numerical Analysis · Mathematics 2023-06-01 Tyler Chen , Anne Greenbaum , Cameron Musco , Christopher Musco

Many optimization problems require hyperparameters, i.e., parameters that must be pre-specified in advance, such as regularization parameters and parametric regularizers in variational regularization methods for inverse problems, and…

Optimization and Control · Mathematics 2025-10-09 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

Randomized iterative methods, such as the randomized Kaczmarz method, have gained significant attention for solving large-scale linear systems due to their simplicity and efficiency. Meanwhile, Krylov subspace methods have emerged as a…

Numerical Analysis · Mathematics 2025-05-28 Yonghan Sun , Deren Han , Jiaxin Xie

Approximating the action of a matrix function $f(\mathbf{A})$ on a vector $\mathbf{b}$ is an increasingly important primitive in machine learning, data science, and statistics, with applications such as sampling high dimensional Gaussians,…

Numerical Analysis · Mathematics 2024-11-07 Noah Amsel , Tyler Chen , Anne Greenbaum , Cameron Musco , Chris Musco

An accurate residual--time (AccuRT) restarting for computing matrix exponential actions of nonsymmetric matrices by the shift-and-invert (SAI) Krylov subspace method is proposed. The proposed restarting method is an extension of the…

Numerical Analysis · Mathematics 2019-12-06 M. A. Botchev

In this work we introduce a memory-efficient method for computing the action of a Hermitian matrix function on a vector. Our method consists of a rational Lanczos algorithm combined with a basis compression procedure based on rational…

Numerical Analysis · Mathematics 2024-03-08 Angelo A. Casulli , Igor Simunec

A randomized Gram-Schmidt algorithm is developed for orthonormalization of high-dimensional vectors or QR factorization. The proposed process can be less computationally expensive than the classical Gram-Schmidt process while being at least…

Numerical Analysis · Mathematics 2022-01-20 Oleg Balabanov , Laura Grigori

Frequent Directions, as a deterministic matrix sketching technique, has been proposed for tackling low-rank approximation problems. This method has a high degree of accuracy and practicality, but experiences a lot of computational cost for…

Machine Learning · Computer Science 2022-03-07 Chenhao Wang , Qianxin Yi , Xiuwu Liao , Yao Wang

This work introduces a novel algorithm to solve large-scale eigenvalue problems and seek a small set of eigenpairs. The method, called randomized Krylov-Schur (rKS), has a simple implementation and benefits from fast and efficient…

Numerical Analysis · Mathematics 2025-08-08 Jean-Guillaume de Damas , Laura Grigori

For large scale electronic structure calculation, the Krylov subspace method is introduced to calculate the one-body density matrix instead of the eigenstates of given Hamiltonian. This method provides an efficient way to extract the…

Materials Science · Physics 2009-11-10 Ryu Takayama , Takeo Hoshi , Takeo Fujiwara

In this text I present a couple of new principles and thereon based iterative methods for numerical solution of sequences of systems of linear equations with fixed system matrix and changing right-hand-sides. The use of the new methods is…

Numerical Analysis · Mathematics 2015-12-17 Martin Neuenhofen

We present a class of algorithms based on rational Krylov methods to compute the action of a generalized matrix function on a vector. These algorithms incorporate existing methods based on the Golub-Kahan bidiagonalization as a special…

Numerical Analysis · Mathematics 2021-07-27 Angelo Alberto Casulli , Igor Simunec

Krylov subspace methods are a powerful tool for efficiently solving high-dimensional linear algebra problems. In this work, we study the approximation quality that a Krylov subspace provides for estimating the numerical range of a matrix.…

Numerical Analysis · Mathematics 2024-12-02 Cecilia Chen , John Urschel

Many practical imaging systems suffer from uncertainty in acquisition geometry -- such as projection angles in computed tomography or sensor positions in photoacoustic tomography -- leading to nonlinear inverse problems that require joint…

Numerical Analysis · Mathematics 2026-05-08 Toluwani Okunola , Mirjeta Pasha , Misha E. Kilmer , James G. Nagy , Eric de Sturler

Frequency-dependent correlations, such as the spectral function and the dynamical structure factor, help understand condensed matter experiments. Within the density matrix renormalization group (DMRG) framework, an accurate method for…

Strongly Correlated Electrons · Physics 2016-12-21 A. Nocera , G. Alvarez