中文
相关论文

相关论文: Randomized sketching for Krylov approximations of …

200 篇论文

We study the problem of constructing a linear sketch of minimum dimension that allows approximation of a given real-valued function $f \colon \mathbb{F}_2^n \rightarrow \mathbb R$ with small expected squared error. We develop a general…

数据结构与算法 · 计算机科学 2019-07-02 Grigory Yaroslavtsev , Samson Zhou

The aim of this work is to develop a fast algorithm for approximating the matrix function $f(A)$ of a square matrix $A$ that is symmetric and has hierarchically semiseparable (HSS) structure. Appearing in a wide variety of applications,…

数值分析 · 数学 2024-02-28 Angelo A. Casulli , Daniel Kressner , Leonardo Robol

This survey explores modern approaches for computing low-rank approximations of high-dimensional matrices by means of the randomized SVD, randomized subspace iteration, and randomized block Krylov iteration. The paper compares the…

数值分析 · 数学 2023-09-25 Joel A. Tropp , Robert J. Webber

The randomized SVD is a method to compute an inexpensive, yet accurate, low-rank approximation of a matrix. The algorithm assumes access to the matrix through matrix-vector products (matvecs). Therefore, when we would like to apply the…

数值分析 · 数学 2025-12-01 David Persson , Tyler Chen , Christopher Musco

This work is concerned with the computation of the action of a matrix function f(A), such as the matrix exponential or the matrix square root, on a vector b. For a general matrix A, this can be done by computing the compression of A onto a…

数值分析 · 数学 2023-06-06 Alice Cortinovis , Daniel Kressner , Yuji Nakatsukasa

It is often desirable to reduce the dimensionality of a large dataset by projecting it onto a low-dimensional subspace. Matrix sketching has emerged as a powerful technique for performing such dimensionality reduction very efficiently. Even…

机器学习 · 计算机科学 2022-06-15 Michał Dereziński , Feynman Liang , Zhenyu Liao , Michael W. Mahoney

A methodology for using random sketching in the context of model order reduction for high-dimensional parameter-dependent systems of equations was introduced in [Balabanov and Nouy 2019, Part I]. Following this framework, we here construct…

数值分析 · 数学 2022-03-25 Oleg Balabanov , Anthony Nouy

We adapt a well known streaming algorithm for approximating item frequencies to the matrix sketching setting. The algorithm receives the rows of a large matrix $A \in \R^{n \times m}$ one after the other in a streaming fashion. It maintains…

数据结构与算法 · 计算机科学 2012-07-12 Edo Liberty

We present an approximate algorithm for matrix multiplication based on matrix sketching techniques. First one of the matrix is chosen and sparsified using the online matrix sketching algorithm, and then the matrix product is calculated…

数值分析 · 计算机科学 2014-06-12 Huan Wang , Christos Boutsidis , Edo Liberty , Daniel Hsu

Randomized Krylov subspace methods that employ the sketch-and-solve paradigm to substantially reduce orthogonalization cost have recently shown great promise in speeding up computations for many core linear algebra tasks (e.g., solving…

数值分析 · 数学 2026-03-13 Emil Krieger , Marcel Schweitzer

Given a symmetric matrix $A$, we show from the simple sketch $GAG^T$, where $G$ is a Gaussian matrix with $k = O(1/\epsilon^2)$ rows, that there is a procedure for approximating all eigenvalues of $A$ simultaneously to within $\epsilon…

数据结构与算法 · 计算机科学 2023-04-20 William Swartworth , David P. Woodruff

We present a new Krylov subspace recycling method for solving a linear system of equations, or a sequence of slowly changing linear systems. Our approach is to reduce the computational overhead of recycling techniques while still benefiting…

数值分析 · 数学 2024-09-30 Liam Burke , Stefan Güttel , Kirk M. Soodhalter

This paper studies how to sketch element-wise functions of low-rank matrices. Formally, given low-rank matrix A = [Aij] and scalar non-linear function f, we aim for finding an approximated low-rank representation of the (possibly high-rank)…

机器学习 · 计算机科学 2020-06-30 Insu Han , Haim Avron , Jinwoo Shin

We introduce an algorithm for estimating the trace of a matrix function $f(\mathbf{A})$ using implicit products with a symmetric matrix $\mathbf{A}$. Existing methods for implicit trace estimation of a matrix function tend to treat…

数值分析 · 数学 2023-08-30 Tyler Chen , Eric Hallman

The Fr\'echet derivative $L_f(A,E)$ of the matrix function $f(A)$ plays an important role in many different applications, including condition number estimation and network analysis. We present several different Krylov subspace methods for…

数值分析 · 数学 2020-09-01 Peter Kandolf , Antti Koskela , Samuel D. Relton , Marcel Schweitzer

A common way to approximate $F(A)b$ -- the action of a matrix function on a vector -- is to use the Arnoldi approximation. Since a new vector needs to be generated and stored in every iteration, one is often forced to rely on restart…

数值分析 · 数学 2023-11-17 Andreas Frommer , Karsten Kahl , Marcel Schweitzer , Manuel Tsolakis

We consider sketched approximate matrix multiplication and ridge regression in the novel setting of localized sketching, where at any given point, only part of the data matrix is available. This corresponds to a block diagonal structure on…

机器学习 · 统计学 2020-03-23 Rakshith S Srinivasa , Mark A Davenport , Justin Romberg

Many scientific applications require the evaluation of the action of the matrix function over a vector and the most common methods for this task are those based on the Krylov subspace. Since the orthogonalization cost and memory requirement…

In the last decade, tensors have shown their potential as valuable tools for various tasks in numerical linear algebra. While most of the research has been focusing on how to compress a given tensor in order to maintain information as well…

数值分析 · 数学 2024-09-17 Alberto Bucci , Davide Palitta , Leonardo Robol

We propose new approximate alternating projection methods, based on randomized sketching, for the low-rank nonnegative matrix approximation problem: find a low-rank approximation of a nonnegative matrix that is nonnegative, but whose…

数值分析 · 数学 2023-04-25 Sergey A. Matveev , Stanislav Budzinskiy