English
Related papers

Related papers: Principal Model Analysis Based on Partial Least Sq…

200 papers

Principal component analysis (PCA) frequently suffers from the disturbance of outliers and thus a spectrum of robust extensions and variations of PCA have been developed. However, existing extensions of PCA treat all samples equally even…

Machine Learning · Computer Science 2021-03-23 Rui Zhang , Hongyuan Zhang , Xuelong Li

When the dimension of data is comparable to or larger than the number of data samples, Principal Components Analysis (PCA) may exhibit problematic high-dimensional noise. In this work, we propose an Empirical Bayes PCA method that reduces…

Methodology · Statistics 2021-09-07 Xinyi Zhong , Chang Su , Zhou Fan

We discuss the problem of estimating the number of principal components in Principal Com- ponents Analysis (PCA). Despite of the importance of the problem and the multitude of solutions proposed in the literature, it comes as a surprise…

Methodology · Statistics 2016-07-06 Piotr Sobczyk , Malgorzata Bogdan , Julie Josse

Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional…

Statistics Theory · Mathematics 2014-01-08 T. Tony Cai , Zongming Ma , Yihong Wu

In this paper we propose a new iterative algorithm to solve the fair PCA (FPCA) problem. We start with the max-min fair PCA formulation originally proposed in [1] and derive a simple and efficient iterative algorithm which is based on the…

Machine Learning · Statistics 2023-05-11 Prabhu Babu , Petre Stoica

Network data are commonly collected in a variety of applications, representing either directly measured or statistically inferred connections between features of interest. In an increasing number of domains, these networks are collected…

Machine Learning · Statistics 2022-09-05 Michael Weylandt , George Michailidis

We propose a new high dimensional semiparametric principal component analysis (PCA) method, named Copula Component Analysis (COCA). The semiparametric model assumes that, after unspecified marginally monotone transformations, the…

Machine Learning · Statistics 2014-02-20 Fang Han , Han Liu

Partial least squares, as a dimension reduction method, has become increasingly important for its ability to deal with problems with a large number of variables. Since noisy variables may weaken the performance of the model, the sparse…

Methodology · Statistics 2020-06-08 Weijuan Liang , Shuangge Ma , Qingzhao Zhang , Tingyu Zhu

Dimensionality reduction is a fundamental technique in machine learning and data analysis, enabling efficient representation and visualization of high-dimensional data. This paper explores five key methods: Principal Component Analysis…

Other Statistics · Statistics 2025-02-19 Yuan-chin Ivan Chang

Incorporating covariates into functional principal component analysis (PCA) can substantially improve the representation efficiency of the principal components and predictive performance. However, many existing functional PCA methods do not…

Methodology · Statistics 2023-08-22 Fei Ding , Shiyuan He , David E. Jones , Jianhua Z. Huang

Joint analysis of multiple phenotypes can increase statistical power in genetic association studies. Principal component analysis, as a popular dimension reduction method, especially when the number of phenotypes is high-dimensional, has…

Applications · Statistics 2018-06-18 Zhonghua Liu , Xihong Lin

High-dimensional data common in genomics, proteomics, and chemometrics often contains complicated correlation structures. Recently, partial least squares (PLS) and Sparse PLS methods have gained attention in these areas as dimension…

Machine Learning · Statistics 2012-04-19 Genevera I. Allen , Christine Peterson , Marina Vannucci , Mirjana Maletic-Savatic

Data integration, or the strategic analysis of multiple sources of data simultaneously, can often lead to discoveries that may be hidden in individualistic analyses of a single data source. We develop a new unsupervised data integration…

Methodology · Statistics 2021-04-06 Tiffany M. Tang , Genevera I. Allen

We present a novel algorithm (Principal Sensitivity Analysis; PSA) to analyze the knowledge of the classifier obtained from supervised machine learning techniques. In particular, we define principal sensitivity map (PSM) as the direction on…

Machine Learning · Statistics 2015-09-22 Sotetsu Koyamada , Masanori Koyama , Ken Nakae , Shin Ishii

Sparse PCA is a widely used technique for high-dimensional data analysis. In this paper, we propose a new method called low-rank principal eigenmatrix analysis. Different from sparse PCA, the dominant eigenvectors are allowed to be dense…

Machine Learning · Statistics 2019-04-30 Krishna Balasubramanian , Elynn Y. Chen , Jianqing Fan , Xiang Wu

In the literature, there are a few researches to design some parameters in the Proximal Point Algorithm (PPA), especially for the multi-objective convex optimizations. Introducing some parameters to PPA can make it more flexible and…

Optimization and Control · Mathematics 2018-12-11 Jianchao Bai , Jicheng Li , Pingfan Dai , Jiaofen Li

An improved mixture of probabilistic principal component analysis (PPCA) has been introduced for nonlinear data-driven process monitoring in this paper. To realize this purpose, the technique of a mixture of probabilistic principal…

Methodology · Statistics 2020-12-15 Jingxin Zhang , Hao Chen , Songhang Chen , Xia Hong

In this work, we consider the application of model-based deep learning in nonlinear principal component analysis (PCA). Inspired by the deep unfolding methodology, we propose a task-based deep learning approach, referred to as Deep-RLS,…

Signal Processing · Electrical Eng. & Systems 2020-11-19 Zahra Esmaeilbeig , Shahin Khobahi , Mojtaba Soltanalian

We demonstrate that Principal Component Analysis (PCA), when applied in a structured manner, either to polar-transformed images or segment-wise to token sequences, enables extreme compression of neural models without sacrificing…

Computational Engineering, Finance, and Science · Computer Science 2025-08-07 Magnus Bengtsson

In our previous work, a reduced order model (ROM) for a stochastic system was made, where noisy data was projected onto principal component analysis (PCA)-derived basis vectors to obtain an accurate reconstruction of the noise-free data.…

Numerical Analysis · Mathematics 2017-02-07 Indika Udagedara , Brian Helenbrook , Aaron Luttman , Jared Catenacci