English
Related papers

Related papers: Order Determination for Spiked Models

200 papers

Variable selection, also known as feature selection in machine learning, plays an important role in modeling high dimensional data and is key to data-driven scientific discoveries. We consider here the problem of detecting influential…

Methodology · Statistics 2014-09-24 Bo Jiang , Jun S. Liu

A common approach to statistical learning with big-data is to randomly split it among $m$ machines and learn the parameter of interest by averaging the $m$ individual estimates. In this paper, focusing on empirical risk minimization, or…

Machine Learning · Statistics 2016-06-14 Jonathan Rosenblatt , Boaz Nadler

We consider general high-dimensional spiked sample covariance models and show that their leading sample spiked eigenvalues and their linear spectral statistics are asymptotically independent when the sample size and dimension are…

Statistics Theory · Mathematics 2020-09-25 Zhixiang Zhang , Shurong Zheng , Guangming Pan , Pingshou Zhong

Consider the $p\times p$ matrix that is the product of a population covariance matrix and the inverse of another population covariance matrix. Suppose that their difference has a divergent rank with respect to $p$, when two samples of sizes…

Statistics Theory · Mathematics 2020-09-23 Junshan Xie , Yicheng Zeng , Lixing Zhu

In this paper, we investigate the asymptotic behaviors of the extreme eigenvectors in a general spiked covariance matrix, where the dimension and sample size increase proportionally. We eliminate the restrictive assumption of the block…

Statistics Theory · Mathematics 2024-05-15 Zhangni Pu , Xiaozhuo Zhang , Jiang Hu , Zhidong Bai

The spiked covariance model has gained increasing popularity in high-dimensional data analysis. A fundamental problem is determination of the number of spiked eigenvalues, $K$. For estimation of $K$, most attention has focused on the use of…

Methodology · Statistics 2021-01-07 Zheng Tracy Ke , Yucong Ma , Xihong Lin

The spiked model is an important special case of the Wishart ensemble, and a natural generalization of the white Wishart ensemble. Mathematically, it can be defined on three kinds of variables: the real, the complex and the quaternion. For…

Probability · Mathematics 2008-04-08 Dong Wang

This paper investigates a statistical procedure for testing the equality of two independent estimated covariance matrices when the number of potentially dependent data vectors is large and proportional to the size of the vectors, that is,…

Statistics Theory · Mathematics 2020-06-01 Rémy Mariétan , Stephan Morgenthaler

While the SLIM approach obtained high ranking-accuracy in many experiments in the literature, it is also known for its high computational cost of learning its parameters from data. For this reason, we focus in this paper on variants of…

Information Retrieval · Computer Science 2019-05-01 Harald Steck

In genetic studies, not only can the number of predictors obtained from microarray measurements be extremely large, there can also be multiple response variables. Motivated by such a situation, we consider semiparametric dimension reduction…

Methodology · Statistics 2013-09-25 Heng Lian , Shujie Ma

For multivariate regularly random vectors of dimension $d$, the dependence structure of the extremes is modeled by the so-called angular measure. When the dimension $d$ is high, estimating the angular measure is challenging because of its…

Methodology · Statistics 2025-05-29 Lucas Butsch , Vicky Fasen-Hartmann

This paper considers sparse spiked covariance matrix models in the high-dimensional setting and studies the minimax estimation of the covariance matrix and the principal subspace as well as the minimax rank detection. The optimal rate of…

Statistics Theory · Mathematics 2016-03-29 Tony Cai , Zongming Ma , Yihong Wu

We prove large deviations principles for spectral measures of perturbed (or spiked) matrix models in the direction of an eigenvector of the perturbation. In each model under study, we provide two approaches, one of which relying on large…

Probability · Mathematics 2021-09-24 Nathan Noiry , Alain Rouault

The Stepped Wedge Design (SWD) is a form of cluster randomized trial, usually comparing two treatments, which is divided into time periods and sequences, with clusters allocated to sequences. Typically all sequences start with the standard…

Methodology · Statistics 2020-11-06 John N. S. Matthews

We study principal components analyses in multivariate random and mixed effects linear models, assuming a spherical-plus-spikes structure for the covariance matrix of each random effect. We characterize the behavior of outlier sample…

Statistics Theory · Mathematics 2018-06-26 Zhou Fan , Iain M. Johnstone , Yi Sun

Model selection aims to identify a sufficiently well performing model that is possibly simpler than the most complex model among a pool of candidates. However, the decision-making process itself can inadvertently introduce non-negligible…

Methodology · Statistics 2024-08-08 Yann McLatchie , Aki Vehtari

We consider the multivariate response regression problem with a regression coefficient matrix of low, unknown rank. In this setting, we analyze a new criterion for selecting the optimal reduced rank. This criterion differs notably from the…

Methodology · Statistics 2018-10-30 Xin Bing , Marten Wegkamp

Statistical learning evolves quickly with more and more sophisticated models proposed to incorporate the complicated data structure from modern scientific and business problems. Varying index coefficient models extend varying coefficient…

Statistics Theory · Mathematics 2019-03-05 Li Jialiang , Lv Jing

Recently, inference about high-dimensional integrated covariance matrices (ICVs) based on noisy high-frequency data has emerged as a challenging problem. In the literature, a pre-averaging estimator (PA-RCov) is proposed to deal with the…

Methodology · Statistics 2017-02-14 Keren Shen , Jianfeng Yao , Wai Keung Li

Recently, deep neural networks have been found to nearly interpolate training data but still generalize well in various applications. To help understand such a phenomenon, it has been of interest to analyze the ridge estimator and its…

Statistics Theory · Mathematics 2024-05-03 Libin Liang , Zhiqiang Tan