English
Related papers

Related papers: Krylov-aware stochastic trace estimation

200 papers

Matrix--vector algorithms, particularly Krylov subspace methods, are widely viewed as the most effective algorithms for solving large systems of linear equations. This paper establishes lower bounds on the worst-case number of…

Data Structures and Algorithms · Computer Science 2026-02-19 Michał Dereziński , Ethan N. Epperly , Raphael A. Meyer

In this work, we propose a reduced basis method for efficient solution of parametric linear systems. The coefficient matrix is assumed to be a linear matrix-valued function that is symmetric and positive definite for admissible values of…

Numerical Analysis · Mathematics 2021-09-28 Antti Autio , Antti Hannukainen

This work is concerned with approximating matrix functions for banded matrices, hierarchically semiseparable matrices, and related structures. We develop a new divide-and-conquer method based on (rational) Krylov subspace methods for…

Numerical Analysis · Mathematics 2021-07-12 Alice Cortinovis , Daniel Kressner , Stefano Massei

This paper describes practical randomized algorithms for low-rank matrix approximation that accommodate any budget for the number of views of the matrix. The presented algorithms, which are aimed at being as pass efficient as needed, expand…

Numerical Analysis · Mathematics 2018-05-25 Elvar K. Bjarkason

Sparse matrices have recently played a significant and impactful role in scientific computing, including artificial intelligence-related fields. According to historical studies on sparse matrix--vector multiplication (SpMV), Krylov subspace…

Numerical Analysis · Mathematics 2024-12-24 Tomonori Kouya

The aim of this work is to develop a fast algorithm for approximating the matrix function $f(A)$ of a square matrix $A$ that is symmetric and has hierarchically semiseparable (HSS) structure. Appearing in a wide variety of applications,…

Numerical Analysis · Mathematics 2024-02-28 Angelo A. Casulli , Daniel Kressner , Leonardo Robol

Krylov subspace methods, such as the Conjugate Gradient (CG) and BiCGSTAB methods, are widely used in scientific computing for solving linear systems. In this study, we propose a new framework for solving large Sylvester equations in a…

Numerical Analysis · Mathematics 2026-05-28 Yuki Satake , Takeshi Fukaya , Tomohiro Sogabe , Shao-Liang Zhang

The trace of a matrix function f(A), most notably of the matrix inverse, can be estimated stochastically using samples< x,f(A)x> if the components of the random vectors x obey an appropriate probability distribution. However such a…

Numerical Analysis · Mathematics 2021-08-26 Andreas Frommer , Mostafa Nasr Khalil , Gustavo Ramirez-Hidalgo

Many scientific applications require the evaluation of the action of the matrix function over a vector and the most common methods for this task are those based on the Krylov subspace. Since the orthogonalization cost and memory requirement…

Numerical Analysis · Mathematics 2026-03-24 Nicolas L. Guidotti , Per-Gunnar Martinsson , Juan A. Acebrón , José Monteiro

We consider iterative (`turbo') algorithms for compressed sensing. First, a unified exposition of the different approaches available in the literature is given, thereby enlightening the general principles and main differences. In particular…

Information Theory · Computer Science 2017-05-22 Robert F. H. Fischer , Susanne Sparrer

In the present paper, we propose Krylov-based methods for solving large-scale differential Sylvester matrix equations having a low rank constant term. We present two new approaches for solving such differential matrix equations. The first…

Numerical Analysis · Mathematics 2017-07-10 M. Hached , K. Jbilou

Iterative Krylov projection methods have become widely used for solving large-scale linear inverse problems. However, methods based on orthogonality include the computation of inner-products, which become costly when the number of…

Numerical Analysis · Mathematics 2025-02-06 Malena Sabaté Landman , Ariana N. Brown , Julianne Chung , James G. Nagy

The resolvent Krylov subspace method builds approximations to operator functions $f(A)$ times a vector $v$. For the semigroup and related operator functions, this method is proved to possess the favorable property that the convergence is…

Numerical Analysis · Mathematics 2019-07-15 Volker Grimm , Tanja Göckler

We consider the task of approximating a matrix function $f(A)$, where $A$ is a matrix in which only a relatively small number of (not necessarily consecutive) sub- and superdiagonals contain nonzero entries. Approximating $f$ by a…

Numerical Analysis · Mathematics 2025-12-09 Majed Hamadi , Nezam Mahdavi-Amiri , Marcel Schweitzer

In classical frameworks as the Euclidean space, positive definite kernels as well as their analytic properties are explicitly available and can be incorporated directly in kernel-based learning algorithms. This is different if the…

Numerical Analysis · Mathematics 2023-01-18 Wolfgang Erb

In the numerical treatment of large-scale Sylvester and Lyapunov equations, projection methods require solving a reduced problem to check convergence. As the approximation space expands, this solution takes an increasing portion of the…

Numerical Analysis · Mathematics 2017-02-03 Davide Palitta , Valeria Simoncini

This article presents a randomized matrix-free method for approximating the trace of $f({\bf A})$, where ${\bf A}$ is a large symmetric matrix and $f$ is a function analytic in a closed interval containing the eigenvalues of ${\bf A}$. Our…

Numerical Analysis · Mathematics 2021-03-22 Eric Hallman , Devon Troester

Polynomial Krylov subspace methods are among the most widely used methods for approximating $f(A)b$, the action of a matrix function on a vector, in particular when $A$ is large and sparse. When $A$ is Hermitian positive definite, the…

Numerical Analysis · Mathematics 2025-03-07 Marcel Schweitzer

Computation of the trace of a matrix function plays an important role in many scientific computing applications, including applications in machine learning, computational physics (e.g., lattice quantum chromodynamics), network analysis and…

Data Structures and Algorithms · Computer Science 2017-03-10 Insu Han , Dmitry Malioutov , Haim Avron , Jinwoo Shin

We consider the problem of rank-$1$ low-rank approximation (LRA) in the matrix-vector product model under various Schatten norms: $$ \min_{\|u\|_2=1} \|A (I - u u^\top)\|_{\mathcal{S}_p} , $$ where $\|M\|_{\mathcal{S}_p}$ denotes the…

Data Structures and Algorithms · Computer Science 2023-04-07 Ainesh Bakshi , Shyam Narayanan