English
Related papers

Related papers: Rate-optimal posterior contraction for sparse PCA

200 papers

Sparse principal component analysis (PCA), an important variant of PCA, attempts to find sparse loading vectors when conducting dimension reduction. This paper considers the nonsmooth Riemannian optimization problem associated with the…

Optimization and Control · Mathematics 2021-09-03 Wen Huang , Ke Wei

In datasets where the number of parameters is fixed and the number of samples is large, principal component analysis (PCA) is a powerful dimension reduction tool. However, in many contemporary datasets, when the number of parameters is…

Probability · Mathematics 2019-02-14 Enrico Au-Yeung , Greg Zanotti

Due to the rapid growth of smart agents such as weakly connected computational nodes and sensors, developing decentralized algorithms that can perform computations on local agents becomes a major research direction. This paper considers the…

Machine Learning · Computer Science 2021-02-09 Haishan Ye , Tong Zhang

Canonical correlation analysis is a classical technique for exploring the relationship between two sets of variables. It has important applications in analyzing high dimensional datasets originated from genomics, imaging and other fields.…

Methodology · Statistics 2016-04-05 Chao Gao , Zongming Ma , Harrison H. Zhou

We revisit the problem of fair principal component analysis (PCA), where the goal is to learn the best low-rank linear approximation of the data that obfuscates demographic information. We propose a conceptually simple approach that allows…

Machine Learning · Statistics 2023-02-28 Matthäus Kleindessner , Michele Donini , Chris Russell , Muhammad Bilal Zafar

We study the problem of high-dimensional Principal Component Analysis (PCA) with missing observations. In simple, homogeneous missingness settings with a noise level of constant order, we show that an existing inverse-probability weighted…

Methodology · Statistics 2019-07-01 Ziwei Zhu , Tengyao Wang , Richard J. Samworth

We study the basic problem of robust subspace recovery. That is, we assume a data set that some of its points are sampled around a fixed subspace and the rest of them are spread in the whole ambient space, and we aim to recover the fixed…

Machine Learning · Statistics 2015-03-19 Teng Zhang , Gilad Lerman

We study the problem of sparse tensor principal component analysis: given a tensor $\pmb Y = \pmb W + \lambda x^{\otimes p}$ with $\pmb W \in \otimes^p\mathbb{R}^n$ having i.i.d. Gaussian entries, the goal is to recover the $k$-sparse unit…

Machine Learning · Computer Science 2021-11-03 Davin Choo , Tommaso d'Orsi

Principal component analysis (PCA) is a well-established method commonly used to explore and visualise data. A classical PCA model is the fixed effect model where data are generated as a fixed structure of low rank corrupted by noise. Under…

Methodology · Statistics 2013-05-13 Marie Verbanck , Julie Josse , François Husson

Sparse principal component analysis addresses the problem of finding a linear combination of the variables in a given data set with a sparse coefficients vector that maximizes the variability of the data. This model enhances the ability to…

Optimization and Control · Mathematics 2017-03-09 Amir Beck , Yakov Vaisbourd

Principal component regression (PCR) is a two-stage procedure: the first stage performs principal component analysis (PCA) and the second stage constructs a regression model whose explanatory variables are replaced by principal components…

Machine Learning · Statistics 2021-11-22 Shuichi Kawano

Principal component regression (PCR) is a two-stage procedure that selects some principal components and then constructs a regression model regarding them as new explanatory variables. Note that the principal components are obtained from…

Machine Learning · Statistics 2015-05-12 Shuichi Kawano , Hironori Fujisawa , Toyoyuki Takada , Toshihiko Shiroishi

We describe and analyze a simple algorithm for principal component analysis and singular value decomposition, VR-PCA, which uses computationally cheap stochastic iterations, yet converges exponentially fast to the optimal solution. In…

Machine Learning · Computer Science 2015-08-03 Ohad Shamir

We consider an online version of the robust Principle Component Analysis (PCA), which arises naturally in time-varying source separations such as video foreground-background separation. This paper proposes a compressive online robust PCA…

Information Theory · Computer Science 2017-05-30 Huynh Van Luong , Nikos Deligiannis , Jurgen Seiler , Soren Forchhammer , Andre Kaup

Sparse principal component analysis (SPCA) methods have proven to efficiently analyze high-dimensional data. Among them, threshold-based SPCA (TSPCA) is computationally more cost-effective than regularized SPCA, based on L1 penalties. We…

Methodology · Statistics 2023-05-29 Kazuyoshi Yata , Makoto Aoshima

Principal Component Analysis (PCA) is a transform for finding the principal components (PCs) that represent features of random data. PCA also provides a reconstruction of the PCs to the original data. We consider an extension of PCA which…

Methodology · Statistics 2021-11-05 Pablo Soto-Quiros , Anatoli Torokhti

Robust principal component analysis (RPCA) has drawn significant attentions due to its powerful capability in recovering low-rank matrices as well as successful appplications in various real world problems. The current state-of-the-art…

Machine Learning · Computer Science 2019-04-17 Chong Peng , Chenglizhao Chen , Zhao Kang , Jianbo Li , Qiang Cheng

Principal Component Analysis (PCA) is a commonly used tool for dimension reduction in analyzing high dimensional data; Multilinear Principal Component Analysis (MPCA) has the potential to serve the similar function for analyzing tensor…

Statistics Theory · Mathematics 2011-04-29 Hung Hung , Pei-Shien Wu , I-Ping Tu , Su-Yun Huang

Principal component analysis (PCA) is a standard tool for dimensional reduction of a set of $n$ observations (samples), each with $p$ variables. In this paper, using a matrix perturbation approach, we study the nonasymptotic relation…

Statistics Theory · Mathematics 2009-01-22 Boaz Nadler

Principal component regression (PCR) is a useful method for regularizing linear regression. Although conceptually simple, straightforward implementations of PCR have high computational costs and so are inappropriate when learning with large…

Numerical Analysis · Mathematics 2019-03-08 Liron Mor-Yosef , Haim Avron