English
Related papers

Related papers: Nearly Optimal Approximation of Matrix Functions b…

200 papers

We consider the problem of rank-$1$ low-rank approximation (LRA) in the matrix-vector product model under various Schatten norms: $$ \min_{\|u\|_2=1} \|A (I - u u^\top)\|_{\mathcal{S}_p} , $$ where $\|M\|_{\mathcal{S}_p}$ denotes the…

Data Structures and Algorithms · Computer Science 2023-04-07 Ainesh Bakshi , Shyam Narayanan

We derive an augmented Krylov subspace method with subspace recycling for computing a sequence of matrix function applications on a set of vectors. The matrix is either fixed or changes as the sequence progresses. We assume consecutive…

Numerical Analysis · Mathematics 2025-08-21 Liam Burke , Andreas Frommer , Gustavo Ramirez-Hidalgo , Kirk M. Soodhalter

An efficient Krylov subspace algorithm for computing actions of the $\varphi$ matrix function for large matrices is proposed. This matrix function is widely used in exponential time integration, Markov chains and network analysis and many…

Numerical Analysis · Mathematics 2020-10-20 Mike A. Botchev , Leonid A. Knizhnerman , Eugene E. Tyrtyshnikov

This work is concerned with computing low-rank approximations of a matrix function $f(A)$ for a large symmetric positive semi-definite matrix $A$, a task that arises in, e.g., statistical learning and inverse problems. The application of…

Numerical Analysis · Mathematics 2023-06-13 David Persson , Daniel Kressner

Given a limited amount of memory and a target accuracy, we propose and compare several polynomial Krylov methods for the approximation of f(A)b, the action of a Stieltjes matrix function of a large Hermitian matrix on a vector. Using new…

Numerical Analysis · Mathematics 2020-11-04 Stefan Güttel , Marcel Schweitzer

A recently developed numerical method for the calculation of derivatives of functions of general complex matrices, which can also be combined with implicit matrix function approximations such as Krylov-Ritz type algorithms, is presented. An…

High Energy Physics - Lattice · Physics 2016-11-02 M. Puhr , P. V. Buividovich

Inhomogeneous dynamical mean-field theory has been employed to solve many interesting strongly interacting problems from transport in multilayered devices to the properties of ultracold atoms in a trap. The main computational step,…

Strongly Correlated Electrons · Physics 2011-02-17 Pierre Carrier , Jok M. Tang , Yousef Saad , James K. Freericks

Bilevel optimization, with broad applications in machine learning, has an intricate hierarchical structure. Gradient-based methods have emerged as a common approach to large-scale bilevel problems. However, the computation of the…

Optimization and Control · Mathematics 2025-02-27 Yan Yang , Bin Gao , Ya-xiang Yuan

This work is concerned with approximating matrix functions for banded matrices, hierarchically semiseparable matrices, and related structures. We develop a new divide-and-conquer method based on (rational) Krylov subspace methods for…

Numerical Analysis · Mathematics 2021-07-12 Alice Cortinovis , Daniel Kressner , Stefano Massei

This paper proposes a unique optimization approach for estimating the minimax rational approximation and its application for evaluating matrix functions. Our method enables the extension to generalized rational approximations and has the…

Numerical Analysis · Mathematics 2025-04-03 Nir Sharon , Vinesha Peiris , Nadia Sukhorukova , Julien Ugon

Krylov subspace methods are a powerful tool for efficiently solving high-dimensional linear algebra problems. In this work, we study the approximation quality that a Krylov subspace provides for estimating the numerical range of a matrix.…

Numerical Analysis · Mathematics 2024-12-02 Cecilia Chen , John Urschel

Variance reduction is a crucial idea for Monte Carlo simulation and the stochastic Lanczos quadrature method is a dedicated method to approximate the trace of a matrix function. Inspired by their advantages, we combine these two techniques…

Numerical Analysis · Mathematics 2023-07-14 Zongyuan Han , Wenhao Li , Yixuan Huang , Shengxin Zhu

We present an acceleration of the well-established Krylov-Ritz methods to compute the sign function of large complex matrices, as needed in lattice QCD simulations involving the overlap Dirac operator at both zero and nonzero baryon…

High Energy Physics - Lattice · Physics 2011-02-01 Jacques C. R. Bloch , Simon Heybrock

With the emergence of Artificial Intelligence, numerical algorithms are moving towards more approximate approaches. For methods such as PCA or diffusion maps, it is necessary to compute eigenvalues of a large matrix, which may also be dense…

Numerical Analysis · Mathematics 2023-11-17 Keerthi Gaddameedi , Severin Reiz , Tobias Neckel , Hans-Joachim Bungartz

Krylov subspace methods are a ubiquitous tool for computing near-optimal rank $k$ approximations of large matrices. While "large block" Krylov methods with block size at least $k$ give the best known theoretical guarantees, block size one…

Data Structures and Algorithms · Computer Science 2023-11-08 Raphael A. Meyer , Cameron Musco , Christopher Musco

Rational Krylov subspaces have become a reference tool in dimension reduction procedures for several application problems. When data matrices are symmetric, a short-term recurrence can be used to generate an associated orthonormal basis. In…

Numerical Analysis · Mathematics 2021-12-21 Davide Palitta , Stefano Pozza , Valeria Simoncini

A common approach to approximating quadratic forms of matrix functions is to use a quadrature rule derived from the Lanczos process, known as a Lanczos quadrature. Although symmetric quadrature rules are computationally favorable, it has…

Numerical Analysis · Mathematics 2026-01-30 Wenhao Li , Shengxin Zhu

This paper studies theoretical lower bounds for estimating the trace of a matrix function, $\text{tr}(f(A))$, focusing on methods that use Hutchinson's method along with Block Krylov techniques. These methods work by approximating…

Statistics Theory · Mathematics 2025-07-01 Shi Jie Yu

Given an $n$ by $n$ matrix $A$ and an $n$-vector $b$, along with a rational function $R(z) := D(z )^{-1} N(z)$, we show how to find the optimal approximation to $R(A) b$ from the Krylov space, $\mbox{span}( b, Ab, \ldots , A^{k-1} b)$,…

Numerical Analysis · Mathematics 2023-07-03 Tyler Chen , Anne Greenbaum , Natalie Wellen

The Lanczos method with implicit restarting is one of the most popular methods for finding a few exterior eigenpairs of a large symmetric matrix $A$. Usually based on polynomial filtering, restarting is crucial to limit memory and the cost…

Numerical Analysis · Mathematics 2026-02-25 Angelo A. Casulli , Daniel Kressner , Nian Shao