中文
相关论文

相关论文: Diffusion approximations of Oja's online principal…

200 篇论文

We describe and analyze a simple algorithm for principal component analysis and singular value decomposition, VR-PCA, which uses computationally cheap stochastic iterations, yet converges exponentially fast to the optimal solution. In…

机器学习 · 计算机科学 2015-08-03 Ohad Shamir

We introduce a novel algorithm that computes the $k$-sparse principal component of a positive semidefinite matrix $A$. Our algorithm is combinatorial and operates by examining a discrete set of special vectors lying in a low-dimensional…

机器学习 · 统计学 2014-05-09 Dimitris S. Papailiopoulos , Alexandros G. Dimakis , Stavros Korokythakis

Since its inception in 1982, Oja's algorithm has become an established method for streaming principle component analysis (PCA). We study the problem of streaming PCA, where the data-points are sampled from an irreducible, aperiodic, and…

统计理论 · 数学 2023-06-21 Syamantak Kumar , Purnamrita Sarkar

We study the dynamics of an online algorithm for learning a sparse leading eigenvector from samples generated from a spiked covariance model. This algorithm combines the classical Oja's method for online PCA with an element-wise…

信息论 · 计算机科学 2016-09-09 Chuang Wang , Yue M. Lu

Recently years, the attempts on distilling mobile data into useful knowledge has been led to the deployment of machine learning algorithms at the network edge. Principal component analysis (PCA) is a classic technique for extracting the…

信息论 · 计算机科学 2022-04-04 Zezhong Zhang , Guangxu Zhu , Rui Wang , Vincent K. N. Lau , Kaibin Huang

Recently popularized randomized methods for principal component analysis (PCA) efficiently and reliably produce nearly optimal accuracy --- even on parallel processors --- unlike the classical (deterministic) alternatives. We adapt one of…

统计计算 · 统计学 2011-12-23 Nathan Halko , Per-Gunnar Martinsson , Yoel Shkolnisky , Mark Tygert

This study presents a scalable data-driven algorithm designed to efficiently address the challenging problem of reachability analysis. Analysis of cyber-physical systems (CPS) relies typically on parametric physical models of dynamical…

机器人学 · 计算机科学 2025-05-22 Navid Hashemi , Lars Lindemann , Jyotirmoy Deshmukh

The Principal Component Analysis (PCA) is a data dimensionality reduction technique well-suited for processing data from sensor networks. It can be applied to tasks like compression, event detection, and event recognition. This technique is…

网络与互联网体系结构 · 计算机科学 2010-03-13 Yann-Aël Le Borgne , Sylvain Raybaud , Gianluca Bontempi

Artificial neural networks that learn to perform Principal Component Analysis (PCA) and related tasks using strictly local learning rules have been previously derived based on the principle of similarity matching: similar pairs of inputs…

统计计算 · 统计学 2018-11-06 Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

We study a distributed Principal Component Analysis (PCA) framework where each worker targets a distinct eigenvector and refines its solution by updating from intermediate solutions provided by peers deemed as "superior". Drawing intuition…

机器学习 · 计算机科学 2025-02-27 Fangshuo Liao , Wenyi Su , Anastasios Kyrillidis

Sparse principal component analysis (PCA) improves interpretability of the classic PCA by introducing sparsity into the dimension-reduction process. Optimization models for sparse PCA, however, are generally non-convex, non-smooth and more…

最优化与控制 · 数学 2024-01-09 Lei Wang , Xin Liu , Yin Zhang

Principal component analysis (PCA), the most popular dimension-reduction technique, has been used to analyze high-dimensional data in many areas. It discovers the homogeneity within the data and creates a reduced feature space to capture as…

统计方法学 · 统计学 2026-03-24 Daning Bi , Le Chang , Yanrong Yang

Principal Component Analysis (PCA) is a very successful dimensionality reduction technique, widely used in predictive modeling. A key factor in its widespread use in this domain is the fact that the projection of a dataset onto its first…

机器学习 · 统计学 2017-05-19 Xianghui Luo , Robert J. Durrant

Low-precision streaming PCA estimates the top principal component in a streaming setting under limited precision. We establish an information-theoretic lower bound on the quantization resolution required to achieve a target accuracy for the…

机器学习 · 计算机科学 2025-10-28 Sanjoy Dasgupta , Syamantak Kumar , Shourya Pandey , Purnamrita Sarkar

Principal component analysis (PCA) is a widely employed statistical tool used primarily for dimensionality reduction. However, it is known to be adversely affected by the presence of outlying observations in the sample, which is quite…

统计方法学 · 统计学 2023-09-26 Subhrajyoty Roy , Ayanendranath Basu , Abhik Ghosh

In this paper, we develop an algorithm for federated principal component analysis (PCA) with emphases on both communication efficiency and data privacy. Generally speaking, federated PCA algorithms based on direct adaptations of classic…

最优化与控制 · 数学 2024-10-29 Lei Wang , Xin Liu , Yin Zhang

Classical Principal Component Analysis (PCA) approximates data in terms of projections on a small number of orthogonal vectors. There are simple procedures to efficiently compute various functions of the data from the PCA approximation. The…

机器学习 · 统计学 2019-07-26 Guihong Wan , Crystal Maung , Haim Schweitzer

The proximal point algorithm plays a central role in non-smooth convex programming. The Augmented Lagrangian Method, one of the most famous optimization algorithms, has been found to be closely related to the proximal point algorithm. Due…

最优化与控制 · 数学 2024-12-13 Ya-xiang Yuan , Yi Zhang

Principal Component Analysis (PCA) is a ubiquitous tool with many applications in machine learning including feature construction, subspace embedding, and outlier detection. In this paper, we present an algorithm for computing the top…

机器学习 · 计算机科学 2013-10-25 Nikos Karampatziakis , Paul Mineiro

We propose a new high dimensional semiparametric principal component analysis (PCA) method, named Copula Component Analysis (COCA). The semiparametric model assumes that, after unspecified marginally monotone transformations, the…

机器学习 · 统计学 2014-02-20 Fang Han , Han Liu