English
Related papers

Related papers: Spatial Sign based Principal Component Analysis fo…

200 papers

Given a sample covariance matrix, we examine the problem of maximizing the variance explained by a linear combination of the input variables while constraining the number of nonzero coefficients in this combination. This is known as sparse…

Optimization and Control · Mathematics 2010-12-24 Youwei Zhang , Alexandre d'Aspremont , Laurent El Ghaoui

Discovering dominant patterns and exploring dynamic behaviors especially critical state transitions and tipping points in high-dimensional time-series data are challenging tasks in study of real-world complex systems, which demand…

Machine Learning · Statistics 2025-01-23 Pei Chen , Yaofang Suo , Rui Liu , Luonan Chen

Motivated by risk assessment of coastal flooding, we consider time-consuming simulators with a spatial output. The aim is to perform sensitivity analysis (SA), quantifying the influence of input parameters on the output. There are three…

Principal component analysis (PCA) is possibly one of the most widely used statistical tools to recover a low-rank structure of the data. In the high-dimensional settings, the leading eigenvector of the sample covariance can be nearly…

Statistics Theory · Mathematics 2015-04-06 Chao Gao , Harrison H. Zhou

Sparse Principal Component Analysis (sparse PCA) is a fundamental dimension-reduction tool that enhances interpretability in various high-dimensional settings. An important variant of sparse PCA studies the scenario when samples are…

Optimization and Control · Mathematics 2024-11-11 Yuqing He , Guanyi Wang , Yu Yang

Principal component analysis (PCA) has achieved great success in unsupervised learning by identifying covariance correlations among features. If the data collection fails to capture the covariance information, PCA will not be able to…

Computational Physics · Physics 2021-08-24 Ziming Liu , Sitian Qian , Yixuan Wang , Yuxuan Yan , Tianyi Yang

Principal Component Analysis (PCA) is a commonly used tool for dimension reduction in analyzing high dimensional data; Multilinear Principal Component Analysis (MPCA) has the potential to serve the similar function for analyzing tensor…

Statistics Theory · Mathematics 2011-04-29 Hung Hung , Pei-Shien Wu , I-Ping Tu , Su-Yun Huang

Dimension reduction is useful for exploratory data analysis. In many applications, it is of interest to discover variation that is enriched in a "foreground" dataset relative to a "background" dataset. Recently, contrastive principal…

Methodology · Statistics 2021-05-04 Didong Li , Andrew Jones , Barbara Engelhardt

We study the distributed computing setting in which there are multiple servers, each holding a set of points, who wish to compute functions on the union of their point sets. A key task in this setting is Principal Component Analysis (PCA),…

Machine Learning · Computer Science 2014-12-24 Maria-Florina Balcan , Vandana Kanchanapally , Yingyu Liang , David Woodruff

We consider the dimensionality-reduction problem (finding a subspace approximation of observed data) for contaminated data in the high dimensional regime, where the number of observations is of the same magnitude as the number of variables…

Machine Learning · Statistics 2010-05-14 Huan Xu , Constantine Caramanis , Shie Mannor

Previous versions of sparse principal component analysis (PCA) have presumed that the eigen-basis (a $p \times k$ matrix) is approximately sparse. We propose a method that presumes the $p \times k$ matrix becomes approximately sparse after…

Machine Learning · Statistics 2023-08-07 Fan Chen , Karl Rohe

Principal component analysis (PCA) is widely used for dimensionality reduction, with well-documented merits in various applications involving high-dimensional data, including computer vision, preference measurement, and bioinformatics. In…

Machine Learning · Statistics 2013-10-01 Gonzalo Mateos , Georgios B. Giannakis

Principal component analysis (PCA) is a fundamental tool in multivariate statistics, yet its sensitivity to outliers and limitations in distributed environments restrict its effectiveness in modern large-scale applications. To address these…

Methodology · Statistics 2025-10-16 Hung Hung , Zhi-Yu Jou , Su-Yun Huang , Shinto Eguchi

Sparse principal component analysis (sparse PCA) aims at finding a sparse basis to improve the interpretability over the dense basis of PCA, meanwhile the sparse basis should cover the data subspace as much as possible. In contrast to most…

Machine Learning · Computer Science 2014-05-02 Zhenfang Hu , Gang Pan , Yueming Wang , Zhaohui Wu

Principal component analysis (PCA) frequently suffers from the disturbance of outliers and thus a spectrum of robust extensions and variations of PCA have been developed. However, existing extensions of PCA treat all samples equally even…

Machine Learning · Computer Science 2021-03-23 Rui Zhang , Hongyuan Zhang , Xuelong Li

We develop a new principal components analysis (PCA) type dimension reduction method for binary data. Different from the standard PCA which is defined on the observed data, the proposed PCA is defined on the logit transform of the success…

Applications · Statistics 2010-11-17 Seokho Lee , Jianhua Z. Huang , Jianhua Hu

The study of stability and sensitivity of statistical methods or algorithms with respect to their data is an important problem in machine learning and statistics. The performance of the algorithm under resampling of the data is a…

Statistics Theory · Mathematics 2023-02-15 Haoyu Wang

Recently years, the attempts on distilling mobile data into useful knowledge has been led to the deployment of machine learning algorithms at the network edge. Principal component analysis (PCA) is a classic technique for extracting the…

Information Theory · Computer Science 2022-04-04 Zezhong Zhang , Guangxu Zhu , Rui Wang , Vincent K. N. Lau , Kaibin Huang

Principal components analysis (PCA) is a well-known technique for approximating a tabular data set by a low rank matrix. Here, we extend the idea of PCA to handle arbitrary data sets consisting of numerical, Boolean, categorical, ordinal,…

Machine Learning · Statistics 2015-05-06 Madeleine Udell , Corinne Horn , Reza Zadeh , Stephen Boyd

Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional…

Statistics Theory · Mathematics 2014-01-08 T. Tony Cai , Zongming Ma , Yihong Wu