English
Related papers

Related papers: Krylov Subspace Recycling For Matrix Functions

200 papers

Many problems in science and engineering fields require the solution of shifted linear systems. To solve such systems efficiently, the recycling BiCG (RBiCG) algorithm in [SIAM J. SCI. COMPUT, 34 (2012) 1925-1949] is extended in this paper.…

Numerical Analysis · Mathematics 2014-06-26 Jing Meng , Pei-yong Zhu , Hou-Biao Li

We introduce an algorithm for estimating the trace of a matrix function $f(\mathbf{A})$ using implicit products with a symmetric matrix $\mathbf{A}$. Existing methods for implicit trace estimation of a matrix function tend to treat…

Numerical Analysis · Mathematics 2023-08-30 Tyler Chen , Eric Hallman

In recent years two Krylov subspace methods have been proposed for solving skew symmetric linear systems, one based on the minimum residual condition, the other on the Galerkin condition. We give new, algorithm-independent proofs that in…

Numerical Analysis · Mathematics 2015-12-02 Stanley C. Eisenstat

Block and global Krylov subspace methods have been proposed as methods adapted to the situation where one iteratively solves systems with the same matrix and several right hand sides. These methods are advantageous, since they allow to cast…

Numerical Analysis · Mathematics 2015-04-20 Somaiyeh Rashedi , Sebastian Birk , Andreas Frommer , Ghodrat Ebadi

We consider the task of computing solutions of linear systems that only differ by a shift with the identity matrix as well as linear systems with several different right hand sides. In the past Krylov subspace methods have been developed…

High Energy Physics - Lattice · Physics 2012-05-03 Sebastian Birk , Andreas Frommer

The availability of efficient Krylov subspace solvers play a vital role for the solution of a variety of numerical problems in computational science. Here we consider lattice field theory. We present a new general numerical method to…

High Energy Physics - Lattice · Physics 2009-10-28 U. Glaessner , S. Guesken , Th. Lippert , G. Ritzenhoefer , K. Schilling , A. Frommer

One of the limitations of recycled GCRO methods is the large amount of computation required to orthogonalize the basis vectors of the newly generated Krylov subspace for the approximate solution when combined with those of the recycle…

Numerical Analysis · Mathematics 2023-06-12 Stephen Thomas , Alison Baker , Stephane Gaudreault

Parallel implementations of Krylov subspace methods often help to accelerate the procedure of finding an approximate solution of a linear system. However, such parallelization coupled with asynchronous and out-of-order execution often…

Mathematical Software · Computer Science 2023-02-09 Roman Iakymchuk , Jose I. Aliaga

Randomized Krylov subspace methods that employ the sketch-and-solve paradigm to substantially reduce orthogonalization cost have recently shown great promise in speeding up computations for many core linear algebra tasks (e.g., solving…

Numerical Analysis · Mathematics 2026-03-13 Emil Krieger , Marcel Schweitzer

We consider a Krylov subspace approximation method for the symmetric differential Riccati equation $\dot{X} = AX + XA^T + Q - XSX$, $X(0)=X_0$. The method we consider is based on projecting the large scale equation onto a Krylov subspace…

Numerical Analysis · Mathematics 2021-06-24 Antti Koskela , Hermann Mena

In classical frameworks as the Euclidean space, positive definite kernels as well as their analytic properties are explicitly available and can be incorporated directly in kernel-based learning algorithms. This is different if the…

Numerical Analysis · Mathematics 2023-01-18 Wolfgang Erb

Several Krylov-type procedures are introduced that generalize matrix Krylov methods for tensor computations. They are denoted minimal Krylov recursion, maximal Krylov recursion, contracted tensor product Krylov recursion. It is proved that…

Numerical Analysis · Mathematics 2010-05-07 Berkant Savas , Lars Eldén

Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time…

Machine Learning · Computer Science 2017-06-02 Filip de Roos , Philipp Hennig

New algorithms are proposed for the Tucker approximation of a 3-tensor, that access it using only the tensor-by-vector-by-vector multiplication subroutine. In the matrix case, Krylov methods are methods of choice to approximate the dominant…

Numerical Analysis · Mathematics 2012-02-06 S. A. Goreinov , I. V. Oseledets , D. V. Savostyanov

Mixed-effects models are widely used to model data with hierarchical grouping structures and high-cardinality categorical predictor variables. However, for high-dimensional crossed random effects, current standard computations relying on…

Methodology · Statistics 2026-05-15 Pascal Kündig , Fabio Sigrist

For large scale electronic structure calculation, the Krylov subspace method is introduced to calculate the one-body density matrix instead of the eigenstates of given Hamiltonian. This method provides an efficient way to extract the…

Materials Science · Physics 2009-11-10 Ryu Takayama , Takeo Hoshi , Takeo Fujiwara

Approximating the action of a matrix function $f(\mathbf{A})$ on a vector $\mathbf{b}$ is an increasingly important primitive in machine learning, data science, and statistics, with applications such as sampling high dimensional Gaussians,…

Numerical Analysis · Mathematics 2024-11-07 Noah Amsel , Tyler Chen , Anne Greenbaum , Cameron Musco , Chris Musco

A common way to approximate $F(A)b$ -- the action of a matrix function on a vector -- is to use the Arnoldi approximation. Since a new vector needs to be generated and stored in every iteration, one is often forced to rely on restart…

Numerical Analysis · Mathematics 2023-11-17 Andreas Frommer , Karsten Kahl , Marcel Schweitzer , Manuel Tsolakis

Subspace recycling techniques have been used quite successfully for the acceleration of iterative methods for solving large-scale linear systems. These methods often work by augmenting a solution subspace generated iteratively by a known…

Numerical Analysis · Mathematics 2021-05-18 Ronny Ramlau , Kirk M. Soodhalter , Victoria Hutterer

Randomized iterative methods, such as the randomized Kaczmarz method, have gained significant attention for solving large-scale linear systems due to their simplicity and efficiency. Meanwhile, Krylov subspace methods have emerged as a…

Numerical Analysis · Mathematics 2025-05-28 Yonghan Sun , Deren Han , Jiaxin Xie