English
Related papers

Related papers: A Fast Randomized Algorithm for Computing an Appro…

200 papers

In this work we provide a new technique to design fast approximation algorithms for graph problems where the points of the graph lie in a metric space. Specifically, we present a sampling approach for such metric graphs that, using a…

Data Structures and Algorithms · Computer Science 2018-07-26 Hossein Esfandiari , Michael Mitzenmacher

A cumbersome operation in numerical analysis and linear algebra, optimization, machine learning and engineering algorithms; is inverting large full-rank matrices which appears in various processes and applications. This has both numerical…

Numerical Analysis · Mathematics 2022-06-24 Neophytos Charalambides , Mert Pilanci , Alfred O. Hero

We investigate regularized algorithms combining with projection for least-squares regression problem over a Hilbert space, covering nonparametric regression over a reproducing kernel Hilbert space. We prove convergence results with respect…

Machine Learning · Statistics 2018-10-09 Junhong Lin , Volkan Cevher

In order to compute fast approximations to the singular value decompositions (SVD) of very large matrices, randomized sketching algorithms have become a leading approach. However, a key practical difficulty of sketching an SVD is that the…

Machine Learning · Statistics 2020-03-12 Miles E. Lopes , N. Benjamin Erichson , Michael W. Mahoney

We develop a randomized Newton method capable of solving learning problems with huge dimensional feature spaces, which is a common setting in applications such as medical imaging, genomics and seismology. Our method leverages randomized…

Optimization and Control · Mathematics 2019-10-04 Robert M. Gower , Dmitry Kovalev , Felix Lieder , Peter Richtárik

We consider sketching algorithms which first compress data by multiplication with a random sketch matrix, and then apply the sketch to quickly solve an optimization problem, e.g., low-rank approximation and regression. In the learning-based…

Machine Learning · Computer Science 2024-04-12 Yi Li , Honghao Lin , Simin Liu , Ali Vakilian , David P. Woodruff

We present the first linear time complexity randomized algorithms for unbiased approximation of the celebrated family of general random walk kernels (RWKs) for sparse graphs. This includes both labelled and unlabelled instances. The…

Machine Learning · Computer Science 2024-10-16 Krzysztof Choromanski , Isaac Reid , Arijit Sehanobish , Avinava Dubey

Given (orthonormal) approximations $\tilde{U}$ and $\tilde{V}$ to the left and right subspaces spanned by the leading singular vectors of a matrix $A$, we discuss methods to approximate the leading singular values of $A$ and study their…

Numerical Analysis · Mathematics 2026-01-21 Lorenzo Lazzarino , Hussam Al Daas , Yuji Nakatsukasa

Constrained least squares problems arise in many applications. Their memory and computation costs are expensive in practice involving high-dimensional input data. We employ the so-called "sketching" strategy to project the least squares…

Optimization and Control · Mathematics 2021-09-07 Ke Chen , Ruhui Jin

We give a sketching-based iterative algorithm that computes a $1+\varepsilon$ approximate solution for the ridge regression problem $\min_x \|Ax-b\|_2^2 +\lambda\|x\|_2^2$ where $A \in R^{n \times d}$ with $d \ge n$. Our algorithm, for a…

Data Structures and Algorithms · Computer Science 2022-06-20 Praneeth Kacham , David P. Woodruff

We present a novel algorithm attaining excessively fast, the sought solution of linear systems of equations. The algorithm is short in its basic formulation and, by definition, vectorized, while the memory allocation demands are trivial,…

Machine Learning · Computer Science 2023-09-26 Nikolaos P. Bakas

The girth of a graph, i.e. the length of its shortest cycle, is a fundamental graph parameter. Unfortunately all known algorithms for computing, even approximately, the girth and girth-related structures in directed weighted $m$-edge and…

Data Structures and Algorithms · Computer Science 2018-08-14 Jakub Pachocki , Liam Roditty , Aaron Sidford , Roei Tov , Virginia Vassilevska Williams

Given an implicit $n\times n$ matrix $A$ with oracle access $x^TA x$ for any $x\in \mathbb{R}^n$, we study the query complexity of randomized algorithms for estimating the trace of the matrix. This problem has many applications in quantum…

Computational Complexity · Computer Science 2014-05-29 Karl Wimmer , Yi Wu , Peng Zhang

We propose a class of randomized quantum algorithms for the task of sampling from matrix functions, without the use of quantum block encodings or any other coherent oracle access to the matrix elements. As such, our use of qubits is purely…

Quantum Physics · Physics 2024-05-22 Samson Wang , Sam McArdle , Mario Berta

Random sketching is a dimensionality reduction technique that approximately preserves norms and singular values up to some $O(1)$ distortion factor with high probability. The most popular sketches in literature are the Gaussian sketch and…

Numerical Analysis · Mathematics 2025-08-21 Andrew J. Higgins , Erik G. Boman , Ichitaro Yamazaki

Matrix sketching is a recently developed data compression technique. An input matrix A is efficiently approximated with a smaller matrix B, so that B preserves most of the properties of A up to some guaranteed approximation ratio. In so…

Machine Learning · Statistics 2019-12-03 Roberta Falcone , Angela Montanari , Laura Anderlucci

A randomized algorithm for computing a data sparse representation of a given rank structured matrix $A$ (a.k.a. an $H$-matrix) is presented. The algorithm draws on the randomized singular value decomposition (RSVD), and operates under the…

Numerical Analysis · Mathematics 2024-06-25 James Levitt , Per-Gunnar Martinsson

Let $A(x)=A\_0+x\_1A\_1+...+x\_nA\_n$ be a linear matrix, or pencil, generated by given symmetric matrices $A\_0,A\_1,...,A\_n$ of size $m$ with rational entries. The set of real vectors x such that the pencil is positive semidefinite is a…

Optimization and Control · Mathematics 2016-09-20 Didier Henrion , Simone Naldi , Mohab Safey El Din

The purpose of this text is to provide an accessible introduction to a set of recently developed algorithms for factorizing matrices. These new algorithms attain high practical speed by reducing the dimensionality of intermediate…

Numerical Analysis · Mathematics 2019-02-08 Per-Gunnar Martinsson

Randomized subspace approximation with "matrix sketching" is an effective approach for constructing approximate partial singular value decompositions (SVDs) of large matrices. The performance of such techniques has been extensively…

Numerical Analysis · Mathematics 2024-06-28 Yijun Dong , Per-Gunnar Martinsson , Yuji Nakatsukasa