English
Related papers

Related papers: Streaming Kernel PCA with $\tilde{O}(\sqrt{n})$ Ra…

200 papers

Recently popularized randomized methods for principal component analysis (PCA) efficiently and reliably produce nearly optimal accuracy --- even on parallel processors --- unlike the classical (deterministic) alternatives. We adapt one of…

Computation · Statistics 2011-12-23 Nathan Halko , Per-Gunnar Martinsson , Yoel Shkolnisky , Mark Tygert

We initiate the study of biological neural networks from the perspective of streaming algorithms. Like computers, human brains suffer from memory limitations which pose a significant obstacle when processing large scale and dynamically…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-06 Yael Hitron , Cameron Musco , Merav Parter

We show that both clustering and subspace embeddings can be performed in the streaming model with the same asymptotic efficiency as in the central/offline setting. For $(k, z)$-clustering in the streaming model, we achieve a number of words…

Data Structures and Algorithms · Computer Science 2025-04-24 Vincent Cohen-Addad , Liudeng Wang , David P. Woodruff , Samson Zhou

Finding dense subgraphs is a fundamental algorithmic tool in data mining, community detection, and clustering. In this problem, one aims to find an induced subgraph whose edge-to-vertex ratio is maximized. We study the directed case of this…

Data Structures and Algorithms · Computer Science 2023-11-21 Slobodan Mitrović , Theodore Pan

We present the first sample-optimal sublinear time algorithms for the sparse Discrete Fourier Transform over a two-dimensional sqrt{n} x sqrt{n} grid. Our algorithms are analyzed for /average case/ signals. For signals whose spectrum is…

Data Structures and Algorithms · Computer Science 2013-03-07 Badih Ghazi , Haitham Hassanieh , Piotr Indyk , Dina Katabi , Eric Price , Lixin Shi

We study the complexity of the following problems in the streaming model. Membership testing for \DLIN We show that every language in \DLIN\ can be recognised by a randomized one-pass $O(\log n)$ space algorithm with inverse polynomial…

Data Structures and Algorithms · Computer Science 2011-04-06 Ajesh Babu , Nutan Limaye , Jaikumar Radhakrishnan , Girish Varma

Kernel methods augmented with random features give scalable algorithms for learning from big data. But it has been computationally hard to sample random features according to a probability distribution that is optimized for the data, so as…

Quantum Physics · Physics 2021-11-02 Hayata Yamasaki , Sathyawageeswar Subramanian , Sho Sonoda , Masato Koashi

We present an efficient and elementary algorithm for computing the number of primes up to $N$ in $\tilde{O}(\sqrt N)$ time, improving upon the existing combinatorial methods that require $\tilde{O}(N ^ {2/3})$ time. Our method has a similar…

Number Theory · Mathematics 2023-08-15 Dean Hirsch , Ido Kessler , Uri Mendlovic

We study the problem of solving semidefinite programs (SDP) in the streaming model. Specifically, $m$ constraint matrices and a target matrix $C$, all of size $n\times n$ together with a vector $b\in \mathbb{R}^m$ are streamed to us…

Data Structures and Algorithms · Computer Science 2023-09-12 Zhao Song , Mingquan Ye , Lichen Zhang

Principal Component Analysis (PCA) is a ubiquitous tool with many applications in machine learning including feature construction, subspace embedding, and outlier detection. In this paper, we present an algorithm for computing the top…

Machine Learning · Computer Science 2013-10-25 Nikos Karampatziakis , Paul Mineiro

This paper is devoted to the development of highly efficient kernels performing vector operations relevant in linear system solvers. In particular, we focus on the low arithmetic intensity operations (i.e., streaming operations) performed…

Mathematical Software · Computer Science 2020-09-24 Noel Chalmers , Tim Warburton

We give an O(sqrt n log n)-query quantum algorithm for evaluating size-n AND-OR formulas. Its running time is poly-logarithmically greater after efficient preprocessing. Unlike previous approaches, the algorithm is based on a quantum walk…

Quantum Physics · Physics 2011-10-11 Ben W. Reichardt

We initiate the study of sub-linear sketching and streaming techniques for estimating the output size of common dictionary compressors such as Lempel-Ziv '77, the run-length Burrows-Wheeler transform, and grammar compression. To this end,…

Data Structures and Algorithms · Computer Science 2024-08-20 Ruben Becker , Matteo Canton , Davide Cenzato , Sung-Hwan Kim , Bojana Kodric , Nicola Prezza

We address three key challenges in learning continuous kernel representations: computational efficiency, parameter efficiency, and spectral bias. Continuous kernels have shown significant potential, but their practical adoption is often…

Machine Learning · Computer Science 2024-09-17 Clayton Harper , Luke Wood , Peter Gerstoft , Eric C. Larson

Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that…

Statistics Theory · Mathematics 2009-01-29 Iain M Johnstone , Arthur Yu Lu

We study the power of Arthur-Merlin probabilistic proof systems in the data stream model. We show a canonical $\mathcal{AM}$ streaming algorithm for a wide class of data stream problems. The algorithm offers a tradeoff between the length of…

Computational Complexity · Computer Science 2013-02-05 Tom Gur , Ran Raz

The study of stability and sensitivity of statistical methods or algorithms with respect to their data is an important problem in machine learning and statistics. The performance of the algorithm under resampling of the data is a…

Statistics Theory · Mathematics 2023-02-15 Haoyu Wang

We show how to find all $k$ marked elements in a list of size $N$ using the optimal number $O(\sqrt{N k})$ of quantum queries and only a polylogarithmic overhead in the gate complexity, in the setting where one has a small quantum memory.…

Quantum Physics · Physics 2024-03-14 Joran van Apeldoorn , Sander Gribling , Harold Nieuwboer

Principal components analysis (PCA) is a widely used dimension reduction technique with an extensive range of applications. In this paper, an online distributed algorithm is proposed for recovering the principal eigenspaces. We further…

Machine Learning · Statistics 2019-05-20 Davoud Ataee Tarzanagh , Mohamad Kazem Shirani Faradonbeh , George Michailidis

One approach to improving the running time of kernel-based machine learning methods is to build a small sketch of the input and use it in lieu of the full kernel matrix in the machine learning task of interest. Here, we describe a version…

Machine Learning · Statistics 2015-11-10 Ahmed El Alaoui , Michael W. Mahoney