English
Related papers

Related papers: High dimensional PCA: a new model selection criter…

200 papers

Principal component analysis (PCA) is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix. However, PCA is well known to behave poorly in the ``large $p$, small $n$''…

Statistics Theory · Mathematics 2009-08-26 Arash A. Amini , Martin J. Wainwright

Information of interest can often only be extracted from data by model fitting. When the functional form of such a model can not be deduced from first principles, one has to make a choice between different possible models. A common approach…

Methodology · Statistics 2022-06-22 Jens Thomas , Mathias Lipka

Principal component analysis (PCA) is a standard tool for dimensional reduction of a set of $n$ observations (samples), each with $p$ variables. In this paper, using a matrix perturbation approach, we study the nonasymptotic relation…

Statistics Theory · Mathematics 2009-01-22 Boaz Nadler

Model selection is a ubiquitous problem that arises in the application of many statistical and machine learning methods. In the likelihood and related settings, it is typical to use the method of information criteria (IC) to choose the most…

Statistics Theory · Mathematics 2024-08-13 Hien Duy Nguyen

Model-based component-wise gradient boosting is a popular tool for data-driven variable selection. In order to improve its prediction and selection qualities even further, several modifications of the original algorithm have been developed,…

Methodology · Statistics 2023-02-28 Sophie Potts , Elisabeth Bergherr , Constantin Reinke , Colin Griesbach

Popular statistical software provides Bayesian information criterion (BIC) for multilevel models or linear mixed models. However, it has been observed that the combination of statistical literature and software documentation has led to…

Methodology · Statistics 2022-06-24 Sun-Joo Cho , Hao Wu , Matthew Naveiras

Akaike's information criterion (AIC) is a measure of the quality of a statistical model for a given set of data. We can determine the best statistical model for a particular data set by the minimization of the AIC. Since we need to evaluate…

Optimization and Control · Mathematics 2019-11-21 Keiji Kimura , Hayato Waki

A popular model selection approach for generalized linear mixed-effects models is the Akaike information criterion, or AIC. Among others, \cite{vaida05} pointed out the distinction between the marginal and conditional inference depending on…

Methodology · Statistics 2008-10-14 Heng Lian

We consider general high-dimensional spiked sample covariance models and show that their leading sample spiked eigenvalues and their linear spectral statistics are asymptotically independent when the sample size and dimension are…

Statistics Theory · Mathematics 2020-09-25 Zhixiang Zhang , Shurong Zheng , Guangming Pan , Pingshou Zhong

How do statistical dependencies in measurement noise influence high-dimensional inference? To answer this, we study the paradigmatic spiked matrix model of principal components analysis (PCA), where a rank-one matrix is corrupted by…

Information Theory · Computer Science 2023-06-05 Jean Barbier , Francesco Camilli , Marco Mondelli , Manuel Saenz

Recently, inference about high-dimensional integrated covariance matrices (ICVs) based on noisy high-frequency data has emerged as a challenging problem. In the literature, a pre-averaging estimator (PA-RCov) is proposed to deal with the…

Methodology · Statistics 2017-02-14 Keren Shen , Jianfeng Yao , Wai Keung Li

A central problem of random matrix theory is to understand the eigenvalues of spiked random matrix models, in which a prominent eigenvector is planted into a random matrix. These distributions form natural statistical models for principal…

Statistics Theory · Mathematics 2016-12-26 Amelia Perry , Alexander S. Wein , Afonso S. Bandeira , Ankur Moitra

We consider estimation of large approximate factor models in high-dimensional panels of stationary time series using Principal Component Analysis (PCA). We review the key results establishing the necessary and sufficient conditions for…

Econometrics · Economics 2026-02-13 Matteo Barigozzi

A bias correction to Akaike's information criterion (AIC) is derived for seemingly unrelated regressions models. The correction is of particular use when the sample size is not much larger than the number of fitted parameters. A…

Methodology · Statistics 2009-06-05 J. L. van Velsen

Principal component analysis (PCA) is a classical dimension reduction method which projects data onto the principal subspace spanned by the leading eigenvectors of the covariance matrix. However, it behaves poorly when the number of…

Statistics Theory · Mathematics 2013-05-27 Zongming Ma

Principal component analysis (PCA) is arguably the most widely used approach for large-dimensional factor analysis. While it is effective when the factors are sufficiently strong, it can be inconsistent when the factors are weak and/or the…

Methodology · Statistics 2025-08-22 Zhongyuan Lyu , Ming Yuan

We introduce a new criterion to determine the order of an autoregressive model fitted to time series data. It has the benefits of the two well-known model selection techniques, the Akaike information criterion and the Bayesian information…

Statistics Theory · Mathematics 2016-08-25 Jie Ding , Vahid Tarokh , Yuhong Yang

This paper considers the estimation and inference of the low-rank components in high-dimensional matrix-variate factor models, where each dimension of the matrix-variates ($p \times q$) is comparable to or greater than the number of…

Statistics Theory · Mathematics 2022-10-20 Elynn Y. Chen , Jianqing Fan

Model selection and order selection problems frequently arise in statistical practice. A popular approach to addressing these problems in the frequentist setting involves information criteria based on penalised maxima of log-likelihoods for…

Statistics Theory · Mathematics 2025-10-29 Hien Duy Nguyen , Mayetri Gupta , Jacob Westerhout , TrungTin Nguyen

In high-dimensional principal component analysis, important inferential targets include both leading spikes and the associated principal eigenspaces. Such problems arise naturally in high-dimensional factor models, where leading principal…

Statistics Theory · Mathematics 2026-03-26 Yanqing Yin , Wang Zhou