English
Related papers

Related papers: History PCA: A New Algorithm for Streaming PCA

200 papers

We initiate the study of the classical Submodular Cover (SC) problem in the data streaming model which we refer to as the Streaming Submodular Cover (SSC). We show that any single pass streaming algorithm using sublinear memory in the size…

Data Structures and Algorithms · Computer Science 2016-11-28 Ashkan Norouzi-Fard , Abbas Bazzi , Marwa El Halabi , Ilija Bogunovic , Ya-Ping Hsieh , Volkan Cevher

Principal component analysis (PCA) is a widely used dimension reduction tool in the analysis of many kind of high-dimensional data. It is used in signal processing, mechanical engineering, psychometrics, and other fields under different…

Methodology · Statistics 2014-01-15 Ngoc Mai Tran , Maria Osipenko , Wolfgang Karl Haerdle

Streaming data join is a critical process in the field of near-real-time data warehousing. For this purpose, an adaptive semi-stream join algorithm called CACHEJOIN (Cache Join) focusing non-uniform stream data is provided in the…

Databases · Computer Science 2019-11-11 M. Asif Naeem , Erum Mehmood , M G Abbas , Noreen Jamil

Attention computation takes both the time complexity of $O(n^2)$ and the space complexity of $O(n^2)$ simultaneously, which makes deploying Large Language Models (LLMs) in streaming applications that involve long contexts requiring…

Machine Learning · Computer Science 2024-02-06 Raghav Addanki , Chenyang Li , Zhao Song , Chiwun Yang

Most results on coded caching focus on a static scenario, in which a fixed number of users synchronously place their requests from a content library, and the performance is measured in terms of the latency in satisfying all of these…

Information Theory · Computer Science 2018-08-16 Qianqian Yang , Mohammad Mohammadi Amiri , Deniz Gündüz

In this paper, a new method is proposed for sparse PCA based on the recursive divide-and-conquer methodology. The main idea is to separate the original sparse PCA problem into a series of much simpler sub-problems, each having a closed-form…

Computer Vision and Pattern Recognition · Computer Science 2012-12-03 Qian Zhao , Deyu Meng , Zongben Xu

We study the problem of partitioning integer sequences in the one-pass data streaming model. Given is an input stream of integers $X \in \{0, 1, \dots, m \}^n$ of length $n$ with maximum element $m$, and a parameter $p$. The goal is to…

Data Structures and Algorithms · Computer Science 2014-07-08 Christian Konrad , László Kozma

Principal component analysis (PCA), the most popular dimension-reduction technique, has been used to analyze high-dimensional data in many areas. It discovers the homogeneity within the data and creates a reduced feature space to capture as…

Methodology · Statistics 2026-03-24 Daning Bi , Le Chang , Yanrong Yang

Mining useful clusters from high dimensional data has received significant attention of the computer vision and pattern recognition community in the recent years. Linear and non-linear dimensionality reduction has played an important role…

Computer Vision and Pattern Recognition · Computer Science 2016-05-25 Nauman Shahid , Nathanael Perraudin , Vassilis Kalofolias , Gilles Puy , Pierre Vandergheynst

The study of stability and sensitivity of statistical methods or algorithms with respect to their data is an important problem in machine learning and statistics. The performance of the algorithm under resampling of the data is a…

Statistics Theory · Mathematics 2023-02-15 Haoyu Wang

Principal Component Analysis (PCA) is a popular tool for dimensionality reduction and feature extraction in data analysis. There is a probabilistic version of PCA, known as Probabilistic PCA (PPCA). However, standard PCA and PPCA are not…

Machine Learning · Computer Science 2019-04-16 Bowen Zhao , Xi Xiao , Wanpeng Zhang , Bin Zhang , Shutao Xia

Stream processing acceleration is driven by the continuously increasing volume and velocity of data generated on the Web and the limitations of storage, computation, and power consumption. Hardware solutions provide better performance and…

Databases · Computer Science 2024-08-29 Mohammadreza Najafi , Thamir M. Qadah , Mohammad Sadoghi , Hans-Arno Jacobsen

Principal components analysis (PCA) is a standard tool for identifying good low-dimensional approximations to data in high dimension. Many data sets of interest contain private or sensitive information about individuals. Algorithms which…

Machine Learning · Statistics 2013-08-09 Kamalika Chaudhuri , Anand D. Sarwate , Kaushik Sinha

We study the space complexity of estimating the diameter of a subset of points in an arbitrary metric space in the dynamic (turnstile) streaming model. The input is given as a stream of updates to a frequency vector $x \in \mathbb{Z}_{\geq…

Data Structures and Algorithms · Computer Science 2025-10-07 Sanjeev Khanna , Ashwin Padaki , Krish Singal , Erik Waingarten

Finding dense subgraphs is a fundamental problem with applications to community detection, clustering, and data mining. Our work focuses on finding approximate densest subgraphs in directed graphs in computational models for processing…

Data Structures and Algorithms · Computer Science 2025-09-29 Slobodan Mitrović , Theodore Pan , Mahdi Qaempanah , Mohammad Amin Raeisi

In this paper, we design the first streaming algorithms for the problem of multitasking scheduling on parallel machines with shared processing. In one pass, our streaming approximation schemes can provide an approximate value of the optimal…

Data Structures and Algorithms · Computer Science 2022-04-06 Bin Fu , Yumei Huo , Hairong Zhao

Principal component analysis (PCA) is widely used for feature extraction and dimensionality reduction, with documented merits in diverse tasks involving high-dimensional data. Standard PCA copes with one dataset at a time, but it is…

Machine Learning · Computer Science 2019-01-30 Jia Chen , Gang Wang , Georgios B. Giannakis

Many classical algorithms are known for computing the convex hull of a set of $n$ point in $\mathbb{R}^2$ using $O(n)$ space. For large point sets, whose size exceeds the size of the working space, these algorithms cannot be directly used.…

Computational Geometry · Computer Science 2018-10-02 Martin Farach-Colton , Meng Li , Meng-Tsung Tsai

Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional…

Statistics Theory · Mathematics 2014-01-08 T. Tony Cai , Zongming Ma , Yihong Wu

Principal component analysis (PCA) is not only a fundamental dimension reduction method, but is also a widely used network anomaly detection technique. Traditionally, PCA is performed in a centralized manner, which has poor scalability for…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-22 Ni An , Steven Weber