English
Related papers

Related papers: Metric-Aware Principal Component Analysis (MAPCA):…

200 papers

When modeling multivariate data, one might have an extra parameter of contextual information that could be used to treat some observations as more similar to others. For example, images of faces can vary by age, and one would expect the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Ajay Gupta , Adrian Barbu

Principal component analysis (PCA) frequently suffers from the disturbance of outliers and thus a spectrum of robust extensions and variations of PCA have been developed. However, existing extensions of PCA treat all samples equally even…

Machine Learning · Computer Science 2021-03-23 Rui Zhang , Hongyuan Zhang , Xuelong Li

Principal Component Analysis (PCA) finds the best linear representation of data, and is an indispensable tool in many learning and inference tasks. Classically, principal components of a dataset are interpreted as the directions that…

Optimization and Control · Mathematics 2019-12-24 Raphael A. Hauser , Armin Eftekhari

In recent years, Artificial Intelligence techniques have proved to be very successful when applied to problems in physical sciences. Here we apply an unsupervised Machine Learning (ML) algorithm called Principal Component Analysis (PCA) as…

Materials Science · Physics 2021-05-26 T. Tula , G. Möller , J. Quintanilla , S. R. Giblin , A. D. Hillier , E. E. McCabe , S. Ramos , D. S. Barker , S. Gibson

Principal component analysis (PCA) is a tool to capture factors that explain variation in data. Across domains, data are now collected across multiple contexts (for example, individuals with different diseases, cells of different types, or…

Machine Learning · Statistics 2026-01-22 Kexin Wang , Salil Bhate , João M. Pereira , Joe Kileel , Matylda Figlerowicz , Anna Seigal

We present a new straightforward principal component analysis (PCA) method based on the diagonalization of the weighted variance-covariance matrix through two spectral decomposition methods: power iteration and Rayleigh quotient iteration.…

Instrumentation and Methods for Astrophysics · Physics 2014-12-16 Ludovic Delchambre

We present a technique to perform dimensionality reduction on data that is subject to uncertainty. Our method is a generalization of traditional principal component analysis (PCA) to multivariate probability distributions. In comparison to…

Machine Learning · Computer Science 2019-10-14 Jochen Görtler , Thilo Spinner , Dirk Streeb , Daniel Weiskopf , Oliver Deussen

Principal Component Analysis (PCA) is a very successful dimensionality reduction technique, widely used in predictive modeling. A key factor in its widespread use in this domain is the fact that the projection of a dataset onto its first…

Machine Learning · Statistics 2017-05-19 Xianghui Luo , Robert J. Durrant

Matrix factor model has been growing popular in scientific fields such as econometrics, which serves as a two-way dimension reduction tool for matrix sequences. In this article, we for the first time propose the matrix elliptical factor…

Methodology · Statistics 2022-03-29 ZeYu Li , Yong He , Xinbing Kong , Xinsheng Zhang

Understanding the inverse equivalent width - luminosity relationship (Baldwin Effect), the topic of this meeting, requires extracting information on continuum and emission line parameters from samples of AGN. We wish to discover whether,…

Astrophysics · Physics 2007-05-23 Paul J. Francis , Beverley J. Wills

Machine Learning models are prone to fail when test data are different from training data, a situation often encountered in real applications known as distribution shift. While still valid, the training-time knowledge becomes less…

Machine Learning · Computer Science 2022-09-14 Thomas Cordier , Victor Bouvier , Gilles Hénaff , Céline Hudelot

Capturing patterns of variation present in a dataset is important in exploratory data analysis and unsupervised learning. Contrastive dimension reduction methods, such as contrastive principal component analysis (cPCA), find patterns unique…

Machine Learning · Computer Science 2021-04-19 Robin Tu , Alexander H. Foss , Sihai D. Zhao

Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that…

Statistics Theory · Mathematics 2009-01-29 Iain M Johnstone , Arthur Yu Lu

Principal Component Analysis (PCA) has been widely used for dimensionality reduction and feature extraction. Robust PCA (RPCA), under different robust distance metrics, such as l1-norm and l2, p-norm, can deal with noise or outliers to some…

Machine Learning · Computer Science 2021-06-29 Zhao Kang , Hongfei Liu , Jiangxin Li , Xiaofeng Zhu , Ling Tian

Principal component analysis (PCA) is arguably the most widely used approach for large-dimensional factor analysis. While it is effective when the factors are sufficiently strong, it can be inconsistent when the factors are weak and/or the…

Methodology · Statistics 2025-08-22 Zhongyuan Lyu , Ming Yuan

Sparse principal component analysis (sparse PCA) is a widely used technique for dimensionality reduction in multivariate analysis, addressing two key limitations of standard PCA. First, sparse PCA can be implemented in high-dimensional low…

Methodology · Statistics 2025-10-07 Jan O. Bauer

Principal component analysis (PCA) is a widely used technique for dimension reduction. As datasets continue to grow in size, distributed-PCA (DPCA) has become an active research area. A key challenge in DPCA lies in efficiently aggregating…

Machine Learning · Statistics 2024-10-02 Zhi-Yu Jou , Su-Yun Huang , Hung Hung , Shinto Eguchi

The first order behavior of multivariate heavy-tailed random vectors above large radial thresholds is ruled by a limit measure in a regular variation framework. For a high dimensional vector, a reasonable assumption is that the support of…

Statistics Theory · Mathematics 2019-06-27 Holger Drees , Anne Sabourin

This study utilizes Independent Component Analysis (ICA) to unveil a consistent semantic structure within embeddings of words or images. Our approach extracts independent semantic components from the embeddings of a pre-trained model by…

Computation and Language · Computer Science 2023-11-03 Hiroaki Yamagiwa , Momose Oyama , Hidetoshi Shimodaira

Spectral methods have been the mainstay in several domains such as machine learning and scientific computing. They involve finding a certain kind of spectral decomposition to obtain basis functions that can capture important structures for…

Machine Learning · Computer Science 2020-04-20 Majid Janzamin , Rong Ge , Jean Kossaifi , Anima Anandkumar