English
Related papers

Related papers: Correlation Based Principal Loading Analysis

200 papers

We study the meta-learning for support (i.e. the set of non-zero entries) recovery in high-dimensional Principal Component Analysis. We reduce the sufficient sample complexity in a novel task with the information that is learned from…

Machine Learning · Statistics 2022-08-22 Imon Banerjee , Jean Honorio

Dimension reduction is crucial in functional data analysis (FDA). The key tool to reduce the dimension of the data is functional principal component analysis. Existing approaches for functional principal component analysis usually involve…

Methodology · Statistics 2024-06-21 Steven Golovkine , Edward Gunning , Andrew J. Simpkin , Norma Bargary

Multivariate binary data is becoming abundant in current biological research. Logistic principal component analysis (PCA) is one of the commonly used tools to explore the relationships inside a multivariate binary data set by exploiting the…

Methodology · Statistics 2020-10-15 Yipeng Song , Johan A. Westerhuis , Age K. Smilde

Principal component analysis (PCA) is a standard tool for dimensional reduction of a set of $n$ observations (samples), each with $p$ variables. In this paper, using a matrix perturbation approach, we study the nonasymptotic relation…

Statistics Theory · Mathematics 2009-01-22 Boaz Nadler

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise, Sigma = (sigma^2)*I. The maximum likelihood solution for the model is an…

Machine Learning · Statistics 2011-06-23 Alfredo A. Kalaitzis , Neil D. Lawrence

Generalized correlation analysis (GCA) is concerned with uncovering linear relationships across multiple datasets. It generalizes canonical correlation analysis that is designed for two datasets. We study sparse GCA when there are…

Machine Learning · Statistics 2023-02-07 Sheng Gao , Zongming Ma

Principal Component Analysis (PCA) and K-means constitute fundamental techniques in multivariate analysis. Although they are frequently applied independently or sequentially to cluster observations, the relationship between them, especially…

Machine Learning · Statistics 2025-12-02 Victor Saquicela , Kenneth Palacio-Baus , Mario Chifla

Having a large number of covariates can have a negative impact on the quality of causal effect estimation since confounding adjustment becomes unreliable when the number of covariates is large relative to the samples available. Propensity…

Methodology · Statistics 2020-09-15 Debo Cheng , Jiuyong Li , Lin Liu , Jixue Liu

A general framework for principal component analysis (PCA) in the presence of heteroskedastic noise is introduced. We propose an algorithm called HeteroPCA, which involves iteratively imputing the diagonal entries of the sample covariance…

Statistics Theory · Mathematics 2021-04-02 Anru R. Zhang , T. Tony Cai , Yihong Wu

Sensitivity analysis is an important tool used in many domains of computational science to either gain insight into the mathematical model and interaction of its parameters or study the uncertainty propagation through the input-output…

Methodology · Statistics 2023-06-02 Juraj Kardos , Wouter Edeling , Diana Suleimenova , Derek Groen , Olaf Schenk

Principal components analysis (PCA) is a well-known technique for approximating a tabular data set by a low rank matrix. Here, we extend the idea of PCA to handle arbitrary data sets consisting of numerical, Boolean, categorical, ordinal,…

Machine Learning · Statistics 2015-05-06 Madeleine Udell , Corinne Horn , Reza Zadeh , Stephen Boyd

Factor Analysis is a popular method for modeling dependence in multivariate data. However, determining the number of factors and obtaining a sparse orientation of the loadings are still major challenges. In this paper, we propose a…

Methodology · Statistics 2021-07-27 Henrique Bolfarine , Carlos M. Carvalho , Hedibert F. Lopes , Jared S. Murray

The principal support vector machines method (Li et al., 2011) is a powerful tool for sufficient dimension reduction that replaces original predictors with their low-dimensional linear combinations without loss of information. However, the…

Machine Learning · Statistics 2019-12-02 Jun Jin , Chao Ying , Zhou Yu

Canonical correlation analysis (CCA) is a method for reducing the dimension of data represented using two views. It has been previously used to derive word embeddings, where one view indicates a word, and the other view indicates its…

Computation and Language · Computer Science 2016-07-28 Dominique Osborne , Shashi Narayan , Shay B. Cohen

Principal component analysis is a useful dimension reduction and data visualization method. However, in high dimension, low sample size asymptotic contexts, where the sample size is fixed and the dimension goes to infinity,a paradox has…

Applications · Statistics 2012-11-21 Dan Shen , Haipeng Shen , Hongtu Zhu , J. S. Marron

In the era of big data, reducing data dimensionality is critical in many areas of science. Widely used Principal Component Analysis (PCA) addresses this problem by computing a low dimensional data embedding that maximally explain variance…

Machine Learning · Statistics 2017-02-24 Soheil Feizi , David Tse

The principal component analysis (PCA), a mathematical tool commonly used in statistics, has recently been employed to interpret the $p_T$-dependent fluctuations of harmonic flow $v_n$ in terms of leading and subleading flow modes in heavy…

Nuclear Experiment · Physics 2020-08-26 Ziming Liu , Arabinda Behera , Huichao Song , Jiangyong Jia

Block Principal Component Analysis (Block PCA) of a data matrix A, where loadings Z are determined by maximization of AZ 2 over unit norm orthogonal loadings, is difficult to use for the design of sparse PCA by 1 regularization, due to the…

Machine Learning · Statistics 2024-02-08 Marie Chavent , Guy Chavent

Principal component analysis (PCA) frequently suffers from the disturbance of outliers and thus a spectrum of robust extensions and variations of PCA have been developed. However, existing extensions of PCA treat all samples equally even…

Machine Learning · Computer Science 2021-03-23 Rui Zhang , Hongyuan Zhang , Xuelong Li

In epidemiology, obtaining accurate individual exposure measurements can be costly and challenging. Thus, these measurements are often subject to error. Regression calibration with a validation study is widely employed as a study design and…

Methodology · Statistics 2026-02-24 Zexiang Li , Donna Spiegelman , Molin Wang , Zuoheng Wang , Xin Zhou