English
Related papers

Related papers: Order Determination for Spiked Models

200 papers

This paper aims to derive asymptotical distributions of the spiked eigenvalues of the large-dimensional spiked Fisher matrices without Gaussian assumption and the restrictive assumptions on covariance matrices. We first establish invariance…

Statistics Theory · Mathematics 2022-03-29 Dandan Jiang , Zhiqiang Hou , Zhidong Bai , Runze Li

Consider the following dynamic factor model: $\mathbf{R}_t=\sum_{i=0}^q \mathbf{\Lambda}_i \mathbf{f}_{t-i}+\mathbf{e}_t,t=1,...,T$, where $\mathbf{\Lambda}_i$ is an $n\times k$ loading matrix of full rank, $\{\mathbf{f}_t\}$ are i.i.d.…

Statistics Theory · Mathematics 2017-04-03 Z. D. Bai , Chen Wang , Ya Xue , Matthew Harding

The size and complexity of software and hardware systems have significantly increased in the past years. As a result, it is harder to guarantee their correct behavior. One of the most successful methods for automated verification of…

Artificial Intelligence · Computer Science 2011-07-04 O. Grumberg , S. Livne , S. Markovitch

Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings…

Methodology · Statistics 2022-06-06 Huiqin Xin , Sihai Dave Zhao

Varying coefficient model is often used in statistical modeling since it is more flexible than the parametric model. However, model detection and variable selection of varying coefficient model are poorly understood in mode regression.…

Methodology · Statistics 2020-09-23 Xuejun Ma , Yue Du , Jingli Wang

Random matrix theory has become a widely useful tool in high-dimensional statistics and theoretical machine learning. However, random matrix theory is largely focused on the proportional asymptotics in which the number of columns grows…

Statistics Theory · Mathematics 2025-06-23 Chen Cheng , Andrea Montanari

We show that in a common high-dimensional covariance model, the choice of loss function has a profound effect on optimal estimation. In an asymptotic framework based on the Spiked Covariance model and use of orthogonally invariant…

Statistics Theory · Mathematics 2017-06-06 David L. Donoho , Matan Gavish , Iain M. Johnstone

Identifying groups of variables that may be large simultaneously amounts to finding out which joint tail dependence coefficients of a multivariate distribution are positive. The asymptotic distribution of a vector of nonparametric,…

Methodology · Statistics 2018-02-28 Maël Chiapino , Anne Sabourin , Johan Segers

Quadratic discriminant analysis (QDA) is a widely used classification technique that generalizes the linear discriminant analysis (LDA) classifier to the case of distinct covariance matrices among classes. For the QDA classifier to yield…

Machine Learning · Computer Science 2020-06-26 Houssem Sifaou , Abla Kammoun , Mohamed-Slim Alouini

This paper investigates the asymptotics of eigenstructure of sample covariance matrix under the spiked covariance matrix model in ultra-high-dimensional settings, where the dimensionality can grow much faster than the sample size with $ p…

Statistics Theory · Mathematics 2026-04-30 Wonjun Seo

Variable selection in ultrahigh-dimensional linear regression is challenging due to its high computational cost. Therefore, a screening step is usually conducted before variable selection to significantly reduce the dimension. Here we…

Methodology · Statistics 2025-04-29 Run Wang , An Nguyen , Somak Dutta , Vivekananda Roy

We investigate high-dimensional nonconvex penalized regression, where the number of covariates may grow at an exponential rate. Although recent asymptotic theory established that there exists a local minimum possessing the oracle property…

Statistics Theory · Mathematics 2013-11-21 Lan Wang , Yongdai Kim , Runze Li

Ordinal regression (OR) is a special multiclass classification problem where an order relation exists among the labels. Recent years, people share their opinions and sentimental judgments conveniently with social networks and E-Commerce so…

Machine Learning · Computer Science 2018-12-21 Yong Shi , Huadong Wang , Xin Shen , Lingfeng Niu

For high-dimensional classification, it is well known that naively performing the Fisher discriminant rule leads to poor results due to diverging spectra and noise accumulation. Therefore, researchers proposed independence rules to…

Machine Learning · Statistics 2011-11-10 Jianqing Fan , Yang Feng , Xin Tong

This paper focuses on variable selection for a partially linear single-index varying-coefficient model. A regularized variable selection procedure by combining basis function approximations with SCAD penalty is proposed. It can…

Statistics Theory · Mathematics 2024-12-19 Lijuan Han , Liugen Xue , Junshan Xie

In this paper, we focus on stochastic comparisons of extreme order statistics stemming from multiple-outlier scale models with dependence. Archimedean copula is used to model dependence structure among nonnegative random variables.…

Statistics Theory · Mathematics 2020-12-16 Sangita Das , Suchandan Kayal

A generalized spiked Fisher matrix is considered in this paper. We establish a criterion for the description of the support of the limiting spectral distribution of high-dimensional generalized Fisher matrix and study the almost sure limits…

Statistics Theory · Mathematics 2019-12-09 Dandan Jiang , Jiang Hu , Zhiqiang Hou

Statistical shape models enhance machine learning algorithms providing prior information about deformation. A Point Distribution Model (PDM) is a popular landmark-based statistical shape model for segmentation. It requires choosing a model…

Machine Learning · Computer Science 2018-08-02 Alma Eguizabal , Peter J. Schreier , David Ramírez

Matrix valued data has become increasingly prevalent in many applications. Most of the existing clustering methods for this type of data are tailored to the mean model and do not account for the dependence structure of the features, which…

Machine Learning · Statistics 2023-12-07 Inbeom Lee , Siyi Deng , Yang Ning

We study ridge estimation of the precision matrix in the high-dimensional setting where the number of variables is large relative to the sample size. We first review two archetypal ridge estimators and note that their utilized penalties do…

Methodology · Statistics 2016-06-17 Wessel N. van Wieringen , Carel F. W. Peeters