English
Related papers

Related papers: Optimal Eigenvalue Approximation via Sketching

200 papers

We study the problem of sketching an input graph, so that given the sketch, one can estimate the weight of any cut in the graph within factor $1+\epsilon$. We present lower and upper bounds on the size of a randomized sketch, focusing on…

Data Structures and Algorithms · Computer Science 2014-11-11 Alexandr Andoni , Robert Krauthgamer , David P. Woodruff

We provide faster algorithms and improved sample complexities for approximating the top eigenvector of a matrix. Offline Setting: Given an $n \times d$ matrix $A$, we show how to compute an $\epsilon$ approximate top eigenvector in time…

Data Structures and Algorithms · Computer Science 2016-05-31 Chi Jin , Sham M. Kakade , Cameron Musco , Praneeth Netrapalli , Aaron Sidford

We present a new sublinear time algorithm for approximating the spectral density (eigenvalue distribution) of an $n\times n$ normalized graph adjacency or Laplacian matrix. The algorithm recovers the spectrum up to $\epsilon$ accuracy in…

Data Structures and Algorithms · Computer Science 2022-04-18 Vladimir Braverman , Aditya Krishnan , Christopher Musco

A hypergraph spectral sparsifier of a hypergraph $G$ is a weighted subgraph $H$ that approximates the Laplacian of $G$ to a specified precision. Recent work has shown that similar to ordinary graphs, there exist $\widetilde{O}(n)$-size…

Data Structures and Algorithms · Computer Science 2025-02-07 Sanjeev Khanna , Huan Li , Aaron Putterman

This paper resolves one of the longest standing basic problems in the streaming computational model. Namely, optimal construction of quantile sketches. An $\varepsilon$ approximate quantile sketch receives a stream of items $x_1,\ldots,x_n$…

Data Structures and Algorithms · Computer Science 2016-04-07 Zohar Karnin , Kevin Lang , Edo Liberty

We consider sketched approximate matrix multiplication and ridge regression in the novel setting of localized sketching, where at any given point, only part of the data matrix is available. This corresponds to a block diagonal structure on…

Machine Learning · Statistics 2020-03-23 Rakshith S Srinivasa , Mark A Davenport , Justin Romberg

It is often desirable to reduce the dimensionality of a large dataset by projecting it onto a low-dimensional subspace. Matrix sketching has emerged as a powerful technique for performing such dimensionality reduction very efficiently. Even…

Machine Learning · Computer Science 2022-06-15 Michał Dereziński , Feynman Liang , Zhenyu Liao , Michael W. Mahoney

We resolve the space complexity of linear sketches for approximating the maximum matching problem in dynamic graph streams where the stream may include both edge insertion and deletion. Specifically, we show that for any $\epsilon > 0$,…

Data Structures and Algorithms · Computer Science 2015-05-07 Sepehr Assadi , Sanjeev Khanna , Yang Li , Grigory Yaroslavtsev

In an instance of the minimum eigenvalue problem, we are given a collection of $n$ vectors $v_1,\ldots, v_n \subset {\mathbb{R}^d}$, and the goal is to pick a subset $B\subseteq [n]$ of given vectors to maximize the minimum eigenvalue of…

Data Structures and Algorithms · Computer Science 2024-01-26 Adam Brown , Aditi Laddha , Mohit Singh

We improve upon previous oblivious sketching and turnstile streaming results for $\ell_1$ and logistic regression, giving a much smaller sketching dimension achieving $O(1)$-approximation and yielding an efficient optimization problem in…

Data Structures and Algorithms · Computer Science 2023-04-05 Alexander Munteanu , Simon Omlor , David Woodruff

This paper studies how to sketch element-wise functions of low-rank matrices. Formally, given low-rank matrix A = [Aij] and scalar non-linear function f, we aim for finding an approximated low-rank representation of the (possibly high-rank)…

Machine Learning · Computer Science 2020-06-30 Insu Han , Haim Avron , Jinwoo Shin

We study the problem of efficiently summarizing a short video into several keyframes, leveraging recent progress in fast graph sampling. Specifically, we first construct a similarity path graph (SPG) $\mathcal{G}$, represented by graph…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Sadid Sahami , Gene Cheung , Chia-Wen Lin

Let $G$ be an undirected graph on $n$ vertices and let $S(G)$ be the set of all $n \times n$ real symmetric matrices whose nonzero off-diagonal entries occur in exactly the positions corresponding to the edges of $G$. The inverse eigenvalue…

Spectral Theory · Mathematics 2014-01-10 Polona Oblak , Helena Šmigoc

Sketching is a dimensionality reduction technique where one compresses a matrix by linear combinations that are chosen at random. A line of work has shown how to sketch the Hessian to speed up each iteration in a second order method, but…

Machine Learning · Computer Science 2021-10-07 Yi Li , Honghao Lin , David P. Woodruff

The power method is one of the most fundamental tools for extracting top principal components from data through low-rank matrix approximation. Yet, when the target rank is large, the cost of matrix multiplication associated with this…

Numerical Analysis · Mathematics 2026-05-12 Shabarish Chenakkod , Michał Dereziński

When rows of an $n \times d$ matrix $A$ are given in a stream, we study algorithms for approximating the top eigenvector of the matrix ${A}^TA$ (equivalently, the top right singular vector of $A$). We consider worst case inputs $A$ but…

Data Structures and Algorithms · Computer Science 2024-12-17 Praneeth Kacham , David P. Woodruff

Detecting emergence of a low-rank signal from high-dimensional data is an important problem arising from many applications such as camera surveillance and swarm monitoring using sensors. We consider a procedure based on the largest…

Machine Learning · Statistics 2016-10-10 Yao Xie , Lee Seversky

We present a near-optimal polynomial-time approximation algorithm for the asymmetric traveling salesman problem for graphs of bounded orientable or non-orientable genus. Our algorithm achieves an approximation factor of O(f(g)) on graphs…

Data Structures and Algorithms · Computer Science 2013-05-14 Jeff Erickson , Anastasios Sidiropoulos

Motivated by a sampling problem basic to computational statistical inference, we develop a nearly optimal algorithm for a fundamental problem in spectral graph theory and numerical analysis. Given an $n\times n$ SDDM matrix ${\bf…

Data Structures and Algorithms · Computer Science 2014-10-21 Dehua Cheng , Yu Cheng , Yan Liu , Richard Peng , Shang-Hua Teng

In this paper we consider the problem of efficiently computing $\epsilon$-sketches for the Laplacian and its pseudoinverse. Given a Laplacian and an error tolerance $\epsilon$, we seek to construct a function $f$ such that for any vector…

Data Structures and Algorithms · Computer Science 2018-01-09 Arun Jambulapati , Aaron Sidford