English
Related papers

Related papers: Spectral Guarantees for Adversarial Streaming PCA

200 papers

We introduce primed-PCA (pPCA), a two-step algorithm for speeding up the approximation of principal components. This algorithm first runs any approximate-PCA method to get an initial estimate of the principal components (priming), and then…

Machine Learning · Computer Science 2022-05-23 Bálint Máté , François Fleuret

We study the online discrepancy minimization problem for vectors in $\mathbb{R}^d$ in the oblivious setting where an adversary is allowed fix the vectors $x_1, x_2, \ldots, x_n$ in arbitrary order ahead of time. We give an algorithm that…

Data Structures and Algorithms · Computer Science 2021-02-09 David Arbour , Drew Dimmery , Tung Mai , Anup Rao

Many link prediction algorithms require the computation of a similarity metric on each vertex pair, which is quadratic in the number of vertices and infeasible for large networks. We develop a class of link prediction algorithms based on a…

Social and Information Networks · Computer Science 2017-04-10 Benjamin Pachev , Benjamin Webb

We introduce the {\em certification} of solutions to graph problems when access to the input is restricted. This topic has received a lot of attention in the distributed computing setting, and we introduce it here in the context of…

Computational Complexity · Computer Science 2025-03-18 Avinandan Das , Pierre Fraigniaud , Ami Paz , Adi Rosen

Many online learning algorithms, including classical online PCA methods, enforce explicit normalization steps that discard the evolving norm of the parameter vector. We show that this norm can in fact encode meaningful information about the…

Machine Learning · Statistics 2025-12-02 Samet Demir , Zafer Dogan

We study learning-augmented streaming algorithms for estimating the value of MAX-CUT in a graph. In the classical streaming model, while a $1/2$-approximation for estimating the value of MAX-CUT can be trivially achieved with $O(1)$ words…

Data Structures and Algorithms · Computer Science 2025-01-07 Yinhao Dong , Pan Peng , Ali Vakilian

In this paper, we study the non-bipartite maximum matching problem in the semi-streaming model. The maximum matching problem in the semi-streaming model has received a significant amount of attention lately. While the problem has been…

Data Structures and Algorithms · Computer Science 2015-03-19 Kook Jin Ahn , Sudipto Guha

We prove a lower bound on the space complexity of two-pass semi-streaming algorithms that approximate the maximum matching problem. The lower bound is parameterized by the density of Ruzsa-Szemeredi graphs: * Any two-pass semi-streaming…

Data Structures and Algorithms · Computer Science 2021-08-17 Sepehr Assadi

Robust streaming, the study of streaming algorithms that provably work when the stream is generated by an adaptive adversary, has seen tremendous progress in recent years. However, fundamental barriers remain: the best known algorithm for…

Data Structures and Algorithms · Computer Science 2025-11-04 Omri Ben-Eliezer , Krzysztof Onak , Sandeep Silwal

We consider the problem of computing a maximal matching with a distributed algorithm in the presence of batch-dynamic changes to the graph topology. We assume that a graph of $n$ nodes is vertex-partitioned among $k$ players that…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-30 Minming Li , Peter Robinson , Xianbin Zhu

In the Wishart model for sparse PCA we are given $n$ samples $Y_1,\ldots, Y_n$ drawn independently from a $d$-dimensional Gaussian distribution $N({0, Id + \beta vv^\top})$, where $\beta > 0$ and $v\in \mathbb{R}^d$ is a $k$-sparse unit…

Machine Learning · Computer Science 2023-11-10 Gleb Novikov

Principal component analysis (PCA) is fundamental to statistical machine learning. It extracts latent principal factors that contribute to the most variation of the data. When data are stored across multiple machines, however, communication…

Computation · Statistics 2018-01-11 Jianqing Fan , Dong Wang , Kaizheng Wang , Ziwei Zhu

We develop machinery to design efficiently computable and consistent estimators, achieving estimation error approaching zero as the number of observations grows, when facing an oblivious adversary that may corrupt responses in all but an…

Machine Learning · Computer Science 2021-11-05 Tommaso d'Orsi , Chih-Hung Liu , Rajai Nasser , Gleb Novikov , David Steurer , Stefan Tiegel

We optimally resolve the space complexity for the problem of finding an $\alpha$-approximate minimum vertex cover ($\alpha$MVC) in dynamic graph streams. We give a randomised algorithm for $\alpha$MVC which uses $O(n^2/\alpha^2)$ bits of…

Data Structures and Algorithms · Computer Science 2022-09-14 Kheeran K. Naidu , Vihan Shah

We study the problem of approximating the value of a Unique Game instance in the streaming model. A simple count of the number of constraints divided by $p$, the alphabet size of the Unique Game, gives a trivial $p$-approximation that can…

Computational Complexity · Computer Science 2020-11-13 Venkatesan Guruswami , Runzhou Tao

We identify a sharp separation in the streaming space complexity of Maximum Cut when the algorithm must output an approximate cut (rather than only the approximate value). For dense graphs, we show that $O(n/\varepsilon^2)$ space is…

Data Structures and Algorithms · Computer Science 2026-05-12 Yang P. Liu , Hoai-An Nguyen , Noah G. Singer , David P. Woodruff

We study high-dimensional robust statistics tasks in the streaming model. A recent line of work obtained computationally efficient algorithms for a range of high-dimensional robust estimation tasks. Unfortunately, all previous algorithms…

Data Structures and Algorithms · Computer Science 2023-05-04 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas

Due to the demand for tackling the problem of streaming data with high dimensional covariates, we propose an online sparse sliced inverse regression (OSSIR) method for online sufficient dimension reduction. The existing online sufficient…

Computation · Statistics 2021-07-05 Haoyang Cheng , Wenquan Cui , Xu Jianjun

In this paper, we introduce a new projection-free algorithm for Online Convex Optimization (OCO) with a state-of-the-art regret guarantee among separation-based algorithms. Existing projection-free methods based on the classical Frank-Wolfe…

Machine Learning · Computer Science 2024-10-08 Zakaria Mhammedi

We consider the Survivable Network Design problem (SNDP) in the single-pass insertion-only streaming model. The input to SNDP is an edge-weighted graph $G = (V, E)$ and an integer connectivity requirement $r(uv)$ for each $u, v \in V$. The…

Data Structures and Algorithms · Computer Science 2025-04-17 Chandra Chekuri , Rhea Jain , Sepideh Mahabadi , Ali Vakilian