English
Related papers

Related papers: Sparse principal component regression with adaptiv…

200 papers

We propose a principal components regression method based on maximizing a joint pseudo-likelihood for responses and predictors. Our method uses both responses and predictors to select linear combinations of the predictors relevant for the…

Methodology · Statistics 2021-08-10 Karl Oskar Ekvall

We study sparse principal component analysis for high dimensional vector autoregressive time series under a doubly asymptotic framework, which allows the dimension $d$ to scale with the series length $T$. We treat the transition matrix of…

Machine Learning · Statistics 2013-07-02 Zhaoran Wang , Fang Han , Han Liu

Principal component analysis (PCA) is an exploratory tool widely used in data analysis to uncover dominant patterns of variability within a population. Despite its ability to represent a data set in a low-dimensional space, the…

This work studies the recursive robust principal components analysis (PCA) problem. If the outlier is the signal-of-interest, this problem can be interpreted as one of recursively recovering a time sequence of sparse vectors, $S_t$, in the…

Information Theory · Computer Science 2014-03-28 Chenlu Qiu , Namrata Vaswani , Brian Lois , Leslie Hogben

The regression of principal component scores (RPCS) on covariates is a widely used analytic approach to detect and test for associations between functional measurements and study participant characteristics. Here we show that: (1) RPCS…

Methodology · Statistics 2026-05-26 Yu Lu , Nidhi Pai , Erjia Cui , Ciprian Crainiceanu

We consider the sparse principal component analysis for high-dimensional stationary processes. The standard principal component analysis performs poorly when the dimension of the process is large. We establish the oracle inequalities for…

Statistics Theory · Mathematics 2021-09-17 Kou Fujimori , Yuichi Goto , Yan Liu , Masanobu Taniguchi

With the rise of high-dimensional correlated data, multicollinearity poses a significant challenge to model stability, often leading to unstable estimation and reduced predictive accuracy. This work proposes the Single-Parametric Principal…

Machine Learning · Statistics 2026-03-09 Ying Hu , Hu Yang

Principal Component Analysis (PCA) is a very successful dimensionality reduction technique, widely used in predictive modeling. A key factor in its widespread use in this domain is the fact that the projection of a dataset onto its first…

Machine Learning · Statistics 2017-05-19 Xianghui Luo , Robert J. Durrant

Sparse ridge regression is widely utilized in modern data analysis and machine learning. However, computing globally optimal solutions for sparse ridge regression is challenging, particularly when samples are arbitrarily given or generated…

Optimization and Control · Mathematics 2025-05-05 Haozhe Tan , Guanyi Wang

We analyze principal component regression (PCR) in a high-dimensional error-in-variables setting with fixed design. Under suitable conditions, we show that PCR consistently identifies the unique model with minimum $\ell_2$-norm. These…

Statistics Theory · Mathematics 2023-08-28 Anish Agarwal , Devavrat Shah , Dennis Shen

A first proposal of a sparse and cellwise robust PCA method is presented. Robustness to single outlying cells in the data matrix is achieved by substituting the squared loss function for the approximation error by a robust version. The…

Computation · Statistics 2024-08-29 Pia Pfeiffer , Laura Vana-Gür , Peter Filzmoser

This work is devoted to the finite sample prediction risk analysis of a class of linear predictors of a response $Y\in \mathbb{R}$ from a high-dimensional random vector $X\in \mathbb{R}^p$ when $(X,Y)$ follows a latent factor regression…

Machine Learning · Statistics 2021-04-26 Xin Bing , Florentina Bunea , Seth Strimas-Mackey , Marten Wegkamp

Multi-cellular programs (MCPs) are coordinated patterns of gene expression across interacting cell types that collectively drive complex biological processes such as tissue development and immune responses. While MCPs are typically…

Methodology · Statistics 2026-02-05 Qi Xu , Jing Lei , Kathryn Roeder

In this paper, we address strongly convex programming for princi- pal component pursuit with reduced linear measurements, which decomposes a superposition of a low-rank matrix and a sparse matrix from a small set of linear measurements. We…

Information Theory · Computer Science 2012-09-21 Qingshan You , Qun Wan , Yipeng Liu

In this paper, we consider a new variant for principal component analysis (PCA), aiming to capture the grouping and/or sparse structures of factor loadings simultaneously. To achieve these goals, we employ a non-convex truncated…

Methodology · Statistics 2022-09-14 Haiyan Jiang , Shanshan Qin , Oscar Hernan Madrid Padilla

Since the introduction of the lasso in regression, various sparse methods have been developed in an unsupervised context like sparse principal component analysis (s-PCA), sparse canonical correlation analysis (s-CCA) and sparse singular…

Methodology · Statistics 2020-12-09 Ruiping Liu , Ndeye Niang , Gilbert Saporta , Huiwen Wang

We propose a supervised principal component regression method for relating functional responses with high dimensional predictors. Unlike the conventional principal component analysis, the proposed method builds on a newly defined expected…

Methodology · Statistics 2023-08-17 Xinyi Zhang , Qiang Sun , Dehan Kong

Sparse Principal Component Analysis (SPCA) is a fundamental technique for dimensionality reduction, and is NP-hard. In this paper, we introduce a randomized approximation algorithm for SPCA, which is based on the basic SDP relaxation. Our…

Machine Learning · Statistics 2026-05-19 Alberto Del Pia , Dekun Zhou

In this paper, we study the problem of decomposing a superposition of a low-rank matrix and a sparse matrix when a relatively few linear measurements are available. This problem arises in many data processing tasks such as aligning multiple…

Information Theory · Computer Science 2012-03-01 Arvind Ganesh , Kerui Min , John Wright , Yi Ma

Convex regression (CR) problem deals with fitting a convex function to a finite number of observations. It has many applications in various disciplines, such as statistics, economics, operations research, and electrical engineering.…

Optimization and Control · Mathematics 2014-09-24 Necdet Serhat Aybat , Zi Wang
‹ Prev 1 4 5 6 7 8 10 Next ›