中文
相关论文

相关论文: Optimal Principal Component Analysis in Distribute…

200 篇论文

Principal Component Analysis (PCA) is a highly useful topic within an introductory Linear Algebra course, especially since it can be used to incorporate a number of applied projects. This method represents an essential application and…

历史与综述 · 数学 2016-04-19 Stephen Pankavich , Rebecca Swanson

Principal component analysis (PCA) has been a prominent tool for high-dimensional data analysis. Online algorithms that estimate the principal component by processing streaming data are of tremendous practical and theoretical interests.…

最优化与控制 · 数学 2017-10-09 Chris Junchi Li , Mengdi Wang , Han Liu , Tong Zhang

Principal component analysis (PCA) is a widespread technique for data analysis that relies on the covariance-correlation matrix of the analyzed data. However to properly work with high-dimensional data, PCA poses severe mathematical…

定量方法 · 定量生物学 2018-10-18 Luigi Leonardo Palese

Recently years, the attempts on distilling mobile data into useful knowledge has been led to the deployment of machine learning algorithms at the network edge. Principal component analysis (PCA) is a classic technique for extracting the…

信息论 · 计算机科学 2022-04-04 Zezhong Zhang , Guangxu Zhu , Rui Wang , Vincent K. N. Lau , Kaibin Huang

In this paper we propose a new algorithm for streaming principal component analysis. With limited memory, small devices cannot store all the samples in the high-dimensional regime. Streaming principal component analysis aims to find the…

机器学习 · 统计学 2018-02-16 Puyudi Yang , Cho-Jui Hsieh , Jane-Ling Wang

This work provides improved guarantees for streaming principle component analysis (PCA). Given $A_1, \ldots, A_n\in \mathbb{R}^{d\times d}$ sampled independently from distributions satisfying $\mathbb{E}[A_i] = \Sigma$ for $\Sigma \succeq…

机器学习 · 计算机科学 2016-03-29 Prateek Jain , Chi Jin , Sham M. Kakade , Praneeth Netrapalli , Aaron Sidford

In this brief note, we formulate Principal Component Analysis (PCA) over datasets consisting not of points but of distributions, characterized by their location and covariance. Just like the usual PCA on points can be equivalently derived…

机器学习 · 统计学 2023-06-26 Vlad Niculae

We consider principal component analysis (PCA) in decomposable Gaussian graphical models. We exploit the prior information in these models in order to distribute its computation. For this purpose, we reformulate the problem in the sparse…

机器学习 · 统计学 2015-05-13 Ami Wiesel , Alfred O. Hero

Principal component analysis (PCA), a ubiquitous dimensionality reduction technique in signal processing, searches for a projection matrix that minimizes the mean squared error between the reduced dataset and the original one. Since…

机器学习 · 计算机科学 2022-08-25 Guilherme Dean Pelegrina , Leonardo Tomazeli Duarte

We study the fundamental problem of Principal Component Analysis in a statistical distributed setting in which each machine out of $m$ stores a sample of $n$ points sampled i.i.d. from a single unknown distribution. We study algorithms for…

机器学习 · 计算机科学 2017-02-28 Dan Garber , Ohad Shamir , Nathan Srebro

Kernel principal component analysis (KPCA) provides a concise set of basis vectors which capture non-linear structures within large data sets, and is a central tool in data analysis and learning. To allow for non-linear relations, typically…

数据结构与算法 · 计算机科学 2015-12-17 Mina Ghashami , Daniel Perry , Jeff M. Phillips

Since its inception in 1982, Oja's algorithm has become an established method for streaming principle component analysis (PCA). We study the problem of streaming PCA, where the data-points are sampled from an irreducible, aperiodic, and…

统计理论 · 数学 2023-06-21 Syamantak Kumar , Purnamrita Sarkar

Principal Component Analysis (PCA) is a transform for finding the principal components (PCs) that represent features of random data. PCA also provides a reconstruction of the PCs to the original data. We consider an extension of PCA which…

统计方法学 · 统计学 2021-11-05 Pablo Soto-Quiros , Anatoli Torokhti

We present a federated, asynchronous, and $(\varepsilon, \delta)$-differentially private algorithm for PCA in the memory-limited setting. Our algorithm incrementally computes local model updates using a streaming procedure and adaptively…

机器学习 · 计算机科学 2020-10-26 Andreas Grammenos , Rodrigo Mendoza-Smith , Jon Crowcroft , Cecilia Mascolo

Principal component analysis (PCA) has been widely used in analyzing high-dimensional data. It converts a set of observed data points of possibly correlated variables into a set of linearly uncorrelated variables via an orthogonal…

最优化与控制 · 数学 2024-03-06 Xin Liang , Zhen-Chen Guo , Li Wang , Ren-Cang Li , Wen-Wei Lin

Recently popularized randomized methods for principal component analysis (PCA) efficiently and reliably produce nearly optimal accuracy --- even on parallel processors --- unlike the classical (deterministic) alternatives. We adapt one of…

统计计算 · 统计学 2011-12-23 Nathan Halko , Per-Gunnar Martinsson , Yoel Shkolnisky , Mark Tygert

The growing size of modern data sets brings many challenges to the existing statistical estimation approaches, which calls for new distributed methodologies. This paper studies distributed estimation for a fundamental statistical machine…

分布式、并行与集群计算 · 计算机科学 2021-02-04 Xi Chen , Jason D. Lee , He Li , Yun Yang

For many modern applications in science and engineering, data are collected in a streaming fashion carrying time-varying information, and practitioners need to process them with a limited amount of memory and computational resources in a…

机器学习 · 统计学 2018-06-13 Laura Balzano , Yuejie Chi , Yue M. Lu

Principal component analysis (PCA) is often used for analyzing data in the most diverse areas. In this work, we report an integrated approach to several theoretical and practical aspects of PCA. We start by providing, in an intuitive and…

计算工程、金融与科学 · 计算机科学 2021-06-09 Felipe L. Gewers , Gustavo R. Ferreira , Henrique F. de Arruda , Filipi N. Silva , Cesar H. Comin , Diego R. Amancio , Luciano da F. Costa

We study a distributed Principal Component Analysis (PCA) framework where each worker targets a distinct eigenvector and refines its solution by updating from intermediate solutions provided by peers deemed as "superior". Drawing intuition…

机器学习 · 计算机科学 2025-02-27 Fangshuo Liao , Wenyi Su , Anastasios Kyrillidis