English
Related papers

Related papers: Spectral Guarantees for Adversarial Streaming PCA

200 papers

Estimating the size of the maximum matching is a canonical problem in graph algorithms, and one that has attracted extensive study over a range of different computational models. We present improved streaming algorithms for approximating…

Data Structures and Algorithms · Computer Science 2016-11-15 Graham Cormode , Hossein Jowhari , Morteza Monemizadeh , S. Muthukrishnan

We prove that any semi-streaming algorithm for $(1-\epsilon)$-approximation of maximum bipartite matching requires \[ \Omega(\frac{\log{(1/\epsilon)}}{{\log{(1/\beta)}}}) \] passes, where $\beta \in (0,1)$ is the largest parameter so that…

Data Structures and Algorithms · Computer Science 2023-10-12 Sepehr Assadi , Janani Sundaresan

We consider the problem of estimating the value of MAX-CUT in a graph in the streaming model of computation. At one extreme, there is a trivial $2$-approximation for this problem that uses only $O(\log n)$ space, namely, count the number of…

Data Structures and Algorithms · Computer Science 2018-11-28 Michael Kapralov , Dmitry Krachun

We study the space complexity of solving the bias-regularized SVM problem in the streaming model. This is a classic supervised learning problem that has drawn lots of attention, including for developing fast algorithms for solving the…

Data Structures and Algorithms · Computer Science 2020-07-08 Alexandr Andoni , Collin Burns , Yi Li , Sepideh Mahabadi , David P. Woodruff

Given a graph, an edge coloring assigns colors to edges so that no pairs of adjacent edges share the same color. We are interested in edge coloring algorithms under the W-streaming model. In this model, the algorithm does not have enough…

Data Structures and Algorithms · Computer Science 2025-04-24 Shiri Chechik , Hongyi Chen , Tianyi Zhang

Problems involving the efficient arrangement of simple objects, as captured by bin packing and makespan scheduling, are fundamental tasks in combinatorial optimization. These are well understood in the traditional online and offline cases,…

Data Structures and Algorithms · Computer Science 2026-01-27 Graham Cormode , Pavel Veselý

Several fundamental tasks in data science rely on computing an extremal eigenspace of size $r \ll n$, where $n$ is the underlying problem dimension. For example, spectral clustering and PCA both require the computation of the leading…

Numerical Analysis · Mathematics 2019-09-04 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

Principal component analysis (PCA) has been widely used in analyzing high-dimensional data. It converts a set of observed data points of possibly correlated variables into a set of linearly uncorrelated variables via an orthogonal…

Optimization and Control · Mathematics 2024-03-06 Xin Liang , Zhen-Chen Guo , Li Wang , Ren-Cang Li , Wen-Wei Lin

This paper considers the problem of estimating the principal eigenvector of a covariance matrix from independent and identically distributed data samples in streaming settings. The streaming rate of data in many contemporary applications…

Machine Learning · Computer Science 2020-01-07 Haroon Raja , Waheed U. Bajwa

We consider the problem of principal component analysis (PCA) in a streaming stochastic setting, where our goal is to find a direction of approximate maximal variance, based on a stream of i.i.d. data points in $\reals^d$. A simple and…

Machine Learning · Computer Science 2016-01-05 Ohad Shamir

Adversarially robust streaming algorithms are required to process a stream of elements and produce correct outputs, even when each stream element can be chosen as a function of earlier algorithm outputs. As with classic streaming…

Data Structures and Algorithms · Computer Science 2024-07-04 Amit Chakrabarti , Manuel Stoeckl

We study the space complexity of estimating the diameter of a subset of points in an arbitrary metric space in the dynamic (turnstile) streaming model. The input is given as a stream of updates to a frequency vector $x \in \mathbb{Z}_{\geq…

Data Structures and Algorithms · Computer Science 2025-10-07 Sanjeev Khanna , Ashwin Padaki , Krish Singal , Erik Waingarten

We present a federated, asynchronous, and $(\varepsilon, \delta)$-differentially private algorithm for PCA in the memory-limited setting. Our algorithm incrementally computes local model updates using a streaming procedure and adaptively…

Machine Learning · Computer Science 2020-10-26 Andreas Grammenos , Rodrigo Mendoza-Smith , Jon Crowcroft , Cecilia Mascolo

In this paper we present improved bounds for approximating maximum matchings in bipartite graphs in the streaming model. First, we consider the question of how well maximum matching can be approximated in a single pass over the input using…

Data Structures and Algorithms · Computer Science 2021-03-18 Michael Kapralov

We develop two methods for the following fundamental statistical task: given an $\epsilon$-corrupted set of $n$ samples from a $d$-dimensional sub-Gaussian distribution, return an approximate top eigenvector of the covariance matrix. Our…

Data Structures and Algorithms · Computer Science 2020-06-15 Arun Jambulapati , Jerry Li , Kevin Tian

We present a new approach for finding matchings in dense graphs by building on Szemer\'edi's celebrated Regularity Lemma. This allows us to obtain non-trivial albeit slight improvements over longstanding bounds for matchings in streaming…

Data Structures and Algorithms · Computer Science 2022-07-20 Sepehr Assadi , Soheil Behnezhad , Sanjeev Khanna , Huan Li

We study streaming algorithms for Correlation Clustering. Given a graph as an arbitrary-order stream of edges, with each edge labeled as positive or negative, the goal is to partition the vertices into disjoint clusters, such that the…

Data Structures and Algorithms · Computer Science 2025-10-14 Yinhao Dong , Shan Jiang , Shi Li , Pan Peng

We propose two one-pass streaming algorithms for the $\mathcal{NP}$-hard hypergraph matching problem. The first algorithm stores a small subset of potential matching edges in a stack using dual variables to select edges. It has an…

Data Structures and Algorithms · Computer Science 2025-07-09 Henrik Reinstädtler , S M Ferdous , Alex Pothen , Bora Uçar , Christian Schulz

This paper addresses the challenge of efficient principal component analysis (PCA) in high-dimensional spaces by analyzing a compressively sampled variant of Oja's algorithm with adaptive sensing. Traditional PCA methods incur substantial…

Machine Learning · Computer Science 2025-05-19 Alex Saad-Falcon , Brighton Ancelin , Justin Romberg

Recent progress in (semi-)streaming algorithms for monotone submodular function maximization has led to tight results for a simple cardinality constraint. However, current techniques fail to give a similar understanding for natural…

Data Structures and Algorithms · Computer Science 2022-02-17 Moran Feldman , Paul Liu , Ashkan Norouzi-Fard , Ola Svensson , Rico Zenklusen