English
Related papers

Related papers: Classification of high-dimensional data with spike…

200 papers

We address high dimensional covariance estimation for elliptical distributed samples, which are also known as spherically invariant random vectors (SIRV) or compound-Gaussian processes. Specifically we consider shrinkage methods that are…

Methodology · Statistics 2015-05-20 Yilun Chen , Ami Wiesel , Alfred O. Hero

Clinical research often focuses on complex traits in which many variables play a role in mechanisms driving, or curing, diseases. Clinical prediction is hard when data is high-dimensional, but additional information, like domain knowledge…

Methodology · Statistics 2020-05-21 Mirrelijn M. van Nee , Lodewyk F. A. Wessels , Mark A. van de Wiel

We provide a novel -- and to the best of our knowledge, the first -- algorithm for high dimensional sparse regression with constant fraction of corruptions in explanatory and/or response variables. Our algorithm recovers the true sparse…

Machine Learning · Computer Science 2019-05-31 Liu Liu , Yanyao Shen , Tianyang Li , Constantine Caramanis

We study the problem of change point detection for covariance matrices in high dimensions. We assume that we observe a sequence {X_i}_{i=1,...,n} of independent and centered p-dimensional sub-Gaussian random vectors whose covariance…

Statistics Theory · Mathematics 2018-08-22 Daren Wang , Yi Yu , Alessandro Rinaldo

We consider the problem of estimation of a covariance matrix for Gaussian data in a high dimensional setting. Existing approaches include maximum likelihood estimation under a pre-specified sparsity pattern, l_1-penalized loglikelihood…

Methodology · Statistics 2024-10-04 Luca Cibinel , Alberto Roverato , Veronica Vinciotti

Consider a linear model $Y=X\beta+z$, where $X=X_{n,p}$ and $z\sim N(0,I_n)$. The vector $\beta$ is unknown but is sparse in the sense that most of its coordinates are $0$. The main interest is to separate its nonzero coordinates from the…

Statistics Theory · Mathematics 2015-03-20 Zheng Tracy Ke , Jiashun Jin , Jianqing Fan

We consider classifiers for high-dimensional data under the strongly spiked eigenvalue (SSE) model. We first show that high-dimensional data often have the SSE model. We consider a distance-based classifier using eigenstructures for the SSE…

Machine Learning · Statistics 2017-10-31 Makoto Aoshima , Kazuyoshi Yata

While covariance matrices have been widely studied in many scientific fields, relatively limited progress has been made on estimating conditional covariances that permits a large covariance matrix to vary with high-dimensional subject-level…

Methodology · Statistics 2025-05-28 Rakheon Kim , Jingfei Zhang

High-dimensional clustering analysis is a challenging problem in statistics and machine learning, with broad applications such as the analysis of microarray data and RNA-seq data. In this paper, we propose a new clustering procedure called…

Methodology · Statistics 2022-10-31 Tianqi Liu , Yu Lu , Biqing Zhu , Hongyu Zhao

Linear discriminant analysis (LDA) is an important classification tool in statistics and machine learning. This paper investigates the varying coefficient LDA model for dynamic data, with Bayes' discriminant direction being a function of…

Methodology · Statistics 2022-10-11 Yajie Bao , Yuyang Liu

Background: High-throughput proteomics techniques, such as mass spectrometry (MS)-based approaches, produce very high-dimensional data-sets. In a clinical setting one is often interested in how mass spectra differ between patients of…

In high-dimensional data analysis, regularization methods pursuing sparsity and/or low rank have received a lot of attention recently. To provide a proper amount of shrinkage, it is typical to use a grid search and a model comparison…

Methodology · Statistics 2019-01-01 Yiyuan She , Hoang Tran

Because of the advance in technologies, modern statistical studies often encounter linear models with the number of explanatory variables much larger than the sample size. Estimation and variable selection in these high-dimensional problems…

Statistics Theory · Mathematics 2012-06-06 Jun Shao , Xinwei Deng

High-dimensional compositional data arise naturally in many applications such as metagenomic data analysis. The observed data lie in a high-dimensional simplex, and conventional statistical methods often fail to produce sensible results due…

Methodology · Statistics 2016-01-19 Yuanpei Cao , Wei Lin , Hongzhe Li

We consider streaming, one-pass principal component analysis (PCA), in the high-dimensional regime, with limited memory. Here, $p$-dimensional samples are presented sequentially, and the goal is to produce the $k$-dimensional subspace that…

Machine Learning · Statistics 2013-07-02 Ioannis Mitliagkas , Constantine Caramanis , Prateek Jain

Consider the normal linear regression setup when the number of covariates p is much larger than the sample size n, and the covariates form correlated groups. The response variable y is not related to an entire group of covariates in all or…

Methodology · Statistics 2023-09-06 Pranay Agarwal , Subhajit Dutta , Minerva Mukhopadhyay

We consider the inference problem for high-dimensional linear models, when covariates have an underlying spatial organization reflected in their correlation. A typical example of such a setting is high-resolution imaging, in which…

Methodology · Statistics 2021-06-07 Jérôme-Alexis Chevalier , Tuan-Binh Nguyen , Bertrand Thirion , Joseph Salmon

This paper studies the related problems of prediction, covariance estimation, and principal component analysis for the spiked covariance model with heteroscedastic noise. We consider an estimator of the principal components based on…

Other Statistics · Statistics 2021-09-21 William Leeb , Elad Romanov

We introduce a new sparse estimator of the covariance matrix for high-dimensional models in which the variables have a known ordering. Our estimator, which is the solution to a convex optimization problem, is equivalently expressed as an…

Statistics Theory · Mathematics 2014-05-27 Jacob Bien , Florentina Bunea , Luo Xiao

Hilbert-Schmidt Independence Criterion (HSIC) has recently been used in the field of single-index models to estimate the directions. Compared with some other well-established methods, it requires relatively weaker conditions. However, its…

Methodology · Statistics 2021-05-19 Runxiong Wu , Chang Deng , Xin Chen