English
Related papers

Related papers: High dimensional PCA: a new model selection criter…

200 papers

Deep learning is renowned for its theory-practice gap, whereby principled theory typically fails to provide much beneficial guidance for implementation in practice. This has been highlighted recently by the benign overfitting phenomenon:…

Machine Learning · Statistics 2023-11-14 Liam Hodgkinson , Chris van der Heide , Robert Salomone , Fred Roosta , Michael W. Mahoney

In this paper, we analyze the asymptotic behavior of the main characteristics of the mean-variance efficient frontier employing random matrix theory. Our particular interest covers the case when the dimension $p$ and the sample size $n$…

Statistical Finance · Quantitative Finance 2024-09-24 Taras Bodnar , Nikolaus Hautsch , Yarema Okhrin , Nestor Parolya

This paper proposes the asymmetric linear double autoregression, which jointly models the conditional mean and conditional heteroscedasticity characterized by asymmetric effects. A sufficient condition is established for the existence of a…

Methodology · Statistics 2021-04-22 Songhua Tan , Qianqian Zhu

Bayesian model averaging is a practical method for dealing with uncertainty due to model specification. Use of this technique requires the estimation of model probability weights. In this work, we revisit the derivation of estimators for…

Methodology · Statistics 2024-02-05 Ethan T. Neil , Jacob W. Sitison

A general framework for principal component analysis (PCA) in the presence of heteroskedastic noise is introduced. We propose an algorithm called HeteroPCA, which involves iteratively imputing the diagonal entries of the sample covariance…

Statistics Theory · Mathematics 2021-04-02 Anru R. Zhang , T. Tony Cai , Yihong Wu

Many real-world datasets contain hidden structure that cannot be detected by simple linear correlations between input features. For example, latent factors may influence the data in a coordinated way, even though their effect is invisible…

Estimating intrinsic dimensionality of data is a classic problem in pattern recognition and statistics. Principal Component Analysis (PCA) is a powerful tool in discovering dimensionality of data sets with a linear structure; it, however,…

Computer Vision and Pattern Recognition · Computer Science 2010-02-11 Mingyu Fan , Nannan Gu , Hong Qiao , Bo Zhang

Traditional variable selection methods could fail to be sign consistent when irrepresentable conditions are violated. This is especially critical in high-dimensional settings when the number of predictors exceeds the sample size. In this…

Methodology · Statistics 2022-04-26 Fei Xue , Annie Qu

The growing size of modern data sets brings many challenges to the existing statistical estimation approaches, which calls for new distributed methodologies. This paper studies distributed estimation for a fundamental statistical machine…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-04 Xi Chen , Jason D. Lee , He Li , Yun Yang

Vine copulas allow to build flexible dependence models for an arbitrary number of variables using only bivariate building blocks. The number of parameters in a vine copula model increases quadratically with the dimension, which poses new…

Methodology · Statistics 2018-11-20 Thomas Nagler , Christian Bumann , Claudia Czado

Sparse Principal Component Analysis (sPCA) is a cardinal technique for obtaining combinations of features, or principal components (PCs), that explain the variance of high-dimensional datasets in an interpretable manner. This involves…

Optimization and Control · Mathematics 2025-12-02 Ryan Cory-Wright , Jean Pauphilet

Sparse Principal Component Analysis (PCA) is a dimensionality reduction technique wherein one seeks a low-rank representation of a data matrix with additional sparsity constraints on the obtained representation. We consider two…

Information Theory · Computer Science 2014-05-06 Yash Deshpande , Andrea Montanari

Bound-to-Bound Data Collaboration (B2BDC) provides a natural framework for addressing both forward and inverse uncertainty quantification problems. In this approach, QOI (quantity of interest) models are constrained by related experimental…

Optimization and Control · Mathematics 2019-04-02 Arun Hegde , Wenyu Li , James Oreluk , Andrew Packard , Michael Frenklach

In this paper, we propose a price staleness factor model that accounts for pervasive market friction across assets and incorporates relevant covariates. Using large-panel high-frequency data, we derive the maximum likelihood estimators of…

Statistics Theory · Mathematics 2026-04-07 Xinbing Kong , Bin Wu , Wuyi Ye

This article establishes a new and comprehensive estimation and inference theory for principal component analysis (PCA) under the weak factor model that allow for cross-sectional dependent idiosyncratic components under the nearly minimal…

Methodology · Statistics 2024-10-02 Jianqing Fan , Yuling Yan , Yuheng Zheng

Sample covariance matrices from multi-population typically exhibit several large spiked eigenvalues, which stem from differences between population means and are crucial for inference on the underlying data structure. This paper…

Statistics Theory · Mathematics 2024-09-16 Weiming Li , Zeng Li , Junpeng Zhu

For predictive evaluation based on quasi-posterior distributions, we develop a new information criterion, the posterior covariance information criterion (PCIC. PCIC generalises the widely applicable information criterion WAIC so as to…

Methodology · Statistics 2023-01-26 Yukito Iba , Keisuke Yano

In the context of principal components analysis (PCA), the bootstrap is commonly applied to solve a variety of inference problems, such as constructing confidence intervals for the eigenvalues of the population covariance matrix $\Sigma$.…

Statistics Theory · Mathematics 2022-02-17 Junwen Yao , Miles E. Lopes

Quantitative assessment of the growth of biological organisms has produced many mathematical equations. Many efforts have been given on statistical identification of the correct growth model from experimental data. Every growth equation is…

Methodology · Statistics 2021-02-17 Md Aktar Ul Karim , Supriya Ramdas Bhagat , Amiya Ranjan Bhowmick

Estimating the eigenvalues of a population covariance matrix from a sample covariance matrix is a problem of fundamental importance in multivariate statistics; the eigenvalues of covariance matrices play a key role in many widely…

Statistics Theory · Mathematics 2007-06-13 Noureddine El Karoui