English
Related papers

Related papers: Revisiting PCA for time series reduction in tempor…

200 papers

Principal Component Analysis (PCA) is a transform for finding the principal components (PCs) that represent features of random data. PCA also provides a reconstruction of the PCs to the original data. We consider an extension of PCA which…

Methodology · Statistics 2021-11-05 Pablo Soto-Quiros , Anatoli Torokhti

Principal component analysis (PCA) is a classical dimension reduction method which projects data onto the principal subspace spanned by the leading eigenvectors of the covariance matrix. However, it behaves poorly when the number of…

Statistics Theory · Mathematics 2013-05-27 Zongming Ma

In this paper we analyze approximate methods for undertaking a principal components analysis (PCA) on large data sets. PCA is a classical dimension reduction method that involves the projection of the data onto the subspace spanned by the…

Machine Learning · Statistics 2017-08-16 Darren Homrighausen , Daniel J. McDonald

Tensor classification has become increasingly crucial in statistics and machine learning, with applications spanning neuroimaging, computer vision, and recommendation systems. However, the high dimensionality of tensors presents significant…

Methodology · Statistics 2024-09-24 Elynn Chen , Yuefeng Han , Jiayu Li

Principal component analysis (PCA) is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix. However, PCA is well known to behave poorly in the ``large $p$, small $n$''…

Statistics Theory · Mathematics 2009-08-26 Arash A. Amini , Martin J. Wainwright

Principal Component Analysis (PCA) is a method for estimating a subspace given noisy samples. It is useful in a variety of problems ranging from dimensionality reduction to anomaly detection and the visualization of high dimensional data.…

Statistics Theory · Mathematics 2019-06-14 David Hong , Laura Balzano , Jeffrey A. Fessler

In medical image segmentation, limited external validity remains a critical obstacle when models are deployed across unseen datasets, an issue particularly pronounced in the ultrasound image domain. Existing solutions-such as domain…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Christian Schmidt , Heinrich Martin Overhoff

Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that…

Statistics Theory · Mathematics 2009-01-29 Iain M Johnstone , Arthur Yu Lu

Linear dimensionality reduction methods are commonly used to extract low-dimensional structure from high-dimensional data. However, popular methods disregard temporal structure, rendering them prone to extracting noise rather than…

Information Theory · Computer Science 2021-06-10 David G. Clark , Jesse A. Livezey , Kristofer E. Bouchard

These notes are an overview of some classical linear methods in Multivariate Data Analysis. This is a good old domain, well established since the 60's, and refreshed timely as a key step in statistical learning. It can be presented as part…

Numerical Analysis · Mathematics 2023-05-25 Alain Franc

Even with the rise in popularity of over-parameterized models, simple dimensionality reduction and clustering methods, such as PCA and k-means, are still routinely used in an amazing variety of settings. A primary reason is the combination…

Methodology · Statistics 2020-09-08 Debolina Paul , Saptarshi Chakraborty , Didong Li , David Dunson

Principal component analysis (PCA) is widely used for dimensionality reduction, with well-documented merits in various applications involving high-dimensional data, including computer vision, preference measurement, and bioinformatics. In…

Machine Learning · Statistics 2013-10-01 Gonzalo Mateos , Georgios B. Giannakis

Principal component analysis (PCA) is arguably the most widely used approach for large-dimensional factor analysis. While it is effective when the factors are sufficiently strong, it can be inconsistent when the factors are weak and/or the…

Methodology · Statistics 2025-08-22 Zhongyuan Lyu , Ming Yuan

In the era of big data, reducing data dimensionality is critical in many areas of science. Widely used Principal Component Analysis (PCA) addresses this problem by computing a low dimensional data embedding that maximally explain variance…

Machine Learning · Statistics 2017-02-24 Soheil Feizi , David Tse

Principal component analysis (PCA) is one of the most widely used dimension reduction and multivariate statistical techniques. From a probabilistic perspective, PCA seeks a low-dimensional representation of data in the presence of…

Machine Learning · Computer Science 2021-01-06 Chihao Zhang , Kuo Gai , Shihua Zhang

Principal component analysis (PCA) is a most frequently used statistical tool in almost all branches of data science. However, like many other statistical tools, there is sometimes the risk of misuse or even abuse. In this paper, we…

Methodology · Statistics 2021-08-12 Xinyu Zhang , Howell Tong

Principal Component Analysis (PCA) is a well known procedure to reduce intrinsic complexity of a dataset, essentially through simplifying the covariance structure or the correlation structure. We introduce a novel algebraic, model-based…

Methodology · Statistics 2021-12-09 Martin Schlather , Felix Reinbott

Network data are commonly collected in a variety of applications, representing either directly measured or statistically inferred connections between features of interest. In an increasing number of domains, these networks are collected…

Machine Learning · Statistics 2022-09-05 Michael Weylandt , George Michailidis

In this paper, we consider the alignment between an upstream dimensionality reduction task of learning a low-dimensional representation of a set of high-dimensional data and a downstream optimization task of solving a stochastic program…

Machine Learning · Computer Science 2024-03-13 Long He , Ho-Yin Mak

Stochastic optimization naturally arises in machine learning. Efficient algorithms with provable guarantees, however, are still largely missing, when the objective function is nonconvex and the data points are dependent. This paper studies…

Machine Learning · Computer Science 2018-10-02 Minshuo Chen , Lin Yang , Mengdi Wang , Tuo Zhao