中文
相关论文

相关论文: The High-Dimensional Asymptotics of Principal Comp…

200 篇论文

Principal component analysis (PCA) is one of the most popular dimension reduction techniques in statistics and is especially powerful when a multivariate distribution is concentrated near a lower-dimensional subspace. Multivariate extreme…

统计方法学 · 统计学 2025-07-15 Felix Reinbott , Anja Janßen

Meta-learning involves training models on a variety of training tasks in a way that enables them to generalize well on new, unseen test tasks. In this work, we consider meta-learning within the framework of high-dimensional multivariate…

统计理论 · 数学 2024-04-01 Yanhao Jin , Krishnakumar Balasubramanian , Debashis Paul

In this paper, we propose a computationally simple estimator of the asymptotic covariance matrix of the Principal Components (PC) factors valid in the presence of cross-correlated idiosyncratic components. The proposed estimator of the…

计量经济学 · 经济学 2024-07-10 Diego Fresoli , Pilar Poncela , Esther Ruiz

This paper considers the estimation and inference of the low-rank components in high-dimensional matrix-variate factor models, where each dimension of the matrix-variates ($p \times q$) is comparable to or greater than the number of…

统计理论 · 数学 2022-10-20 Elynn Y. Chen , Jianqing Fan

Principal component regression (PCR) is a widely used two-stage procedure: principal component analysis (PCA), followed by regression in which the selected principal components are regarded as new explanatory variables in the model. Note…

机器学习 · 统计学 2018-04-03 Shuichi Kawano , Hironori Fujisawa , Toyoyuki Takada , Toshihiko Shiroishi

We propose a novel estimator for the principal component (PC) subspace tailored to the high-dimension, low-sample size (HDLSS) context. The method, termed Adaptive Reference-Guided (ARG) estimator, is designed for data exhibiting spiked…

统计理论 · 数学 2025-08-12 Dongsun Yoon , Sungkyu Jung

We study the problem of treatment effect estimation in randomized experiments with high-dimensional covariate information, and show that essentially any risk-consistent regression adjustment can be used to obtain efficient estimates of the…

统计方法学 · 统计学 2022-06-08 Stefan Wager , Wenfei Du , Jonathan Taylor , Robert Tibshirani

Datasets from the fields of bioinformatics, chemometrics, and face recognition are typically characterized by small samples of high-dimensional data. Among the many variants of linear discriminant analysis that have been proposed in order…

This paper deals with the estimation of a high-dimensional covariance with a conditional sparsity structure and fast-diverging eigenvalues. By assuming sparse error covariance matrix in an approximate factor model, we allow for the presence…

统计理论 · 数学 2013-01-15 Jianqing Fan , Yuan Liao , Martina Mincheva

The paper considers linear regression problems where the number of predictor variables is possibly larger than the sample size. The basic motivation of the study is to combine the points of view of model selection and functional regression…

统计理论 · 数学 2012-02-24 Alois Kneip , Pascal Sarda

We study the problem of high-dimensional Principal Component Analysis (PCA) with missing observations. In simple, homogeneous missingness settings with a noise level of constant order, we show that an existing inverse-probability weighted…

统计方法学 · 统计学 2019-07-01 Ziwei Zhu , Tengyao Wang , Richard J. Samworth

We study high-dimensional regression in principal components space when the predictors are observed with additive measurement error and the response errors may be heavy-tailed. The starting point is the $\ell_1$-penalized…

统计方法学 · 统计学 2026-04-07 Long Feng , Xiaoyi Wang , Le Zhou

Principal Component Analysis (PCA) is one of the most used tools for extracting low-dimensional representations of data, in particular for time series. Performances are known to strongly depend on the quality (amount of noise) and the…

应用统计 · 统计学 2024-12-16 Mariia Legenkaia , Laurent Bourdieu , Rémi Monasson

The spectra of random feature matrices provide essential information on the conditioning of the linear system used in random feature regression problems and are thus connected to the consistency and generalization of random feature models.…

机器学习 · 统计学 2022-12-13 Zhijun Chen , Hayden Schaeffer , Rachel Ward

We consider the problem of decomposing a large covariance matrix into the sum of a low-rank matrix and a diagonally dominant matrix, and we call this problem the "Diagonally-Dominant Principal Component Analysis (DD-PCA)". DD-PCA is an…

统计方法学 · 统计学 2019-06-04 Zheng Tracy Ke , Lingzhou Xue , Fan Yang

We introduce a new approach to variable selection, called Predictive Correlation Screening, for predictor design. Predictive Correlation Screening (PCS) implements false positive control on the selected variables, is well suited to small…

机器学习 · 统计学 2013-04-11 Hamed Firouzi , Bala Rajaratnam , Alfred Hero

For very large datasets, random projections (RP) have become the tool of choice for dimensionality reduction. This is due to the computational complexity of principal component analysis. However, the recent development of randomized…

机器学习 · 统计学 2019-01-04 Michael Wojnowicz , Di Zhang , Glenn Chisholm , Xuan Zhao , Matt Wolff

Often the relation between the variables constituting a multivariate data space might be characterized by one or more of the terms: ``nonlinear'', ``branched'', ``disconnected'', ``bended'', ``curved'', ``heterogeneous'', or, more general,…

天体物理学 · 物理学 2007-09-12 Jochen Einbeck , Ludger Evers , Coryn Bailer-Jones

In the era of big data, reducing data dimensionality is critical in many areas of science. Widely used Principal Component Analysis (PCA) addresses this problem by computing a low dimensional data embedding that maximally explain variance…

机器学习 · 统计学 2017-02-24 Soheil Feizi , David Tse

Based on some new robust estimators of the covariance matrix, we propose stable versions of Principal Component Analysis (PCA) and we qualify it independently of the dimension of the ambient space. We first provide a robust estimator of the…

统计理论 · 数学 2015-11-20 Ilaria Giulini