English
Related papers

Related papers: High-Dimensional Block Diagonal Covariance Structu…

200 papers

We study the universality property of estimators for high-dimensional linear models, which implies that the distribution of estimators is independent of whether the covariates follow a Gaussian distribution. Recent developments in…

Statistics Theory · Mathematics 2025-10-14 Toshiki Tsuda , Masaaki Imaizumi

In this paper, we study the asymptotic behavior of the extreme eigenvalues and eigenvectors of the high dimensional spiked sample covariance matrices, in the supercritical case when a reliable detection of spikes is possible. Especially, we…

Statistics Theory · Mathematics 2020-09-04 Zhigang Bao , Xiucai Ding , Jingming Wang , Ke Wang

High-dimensional vector autoregressive (VAR) models provide a flexible framework for characterizing dynamic dependence in multivariate spatio-temporal systems, but their unrestricted estimation becomes infeasible when multiple variables are…

Methodology · Statistics 2026-05-04 Peiliang Bai

Identifying the number of factors in a high-dimensional factor model has attracted much attention in recent years and a general solution to the problem is still lacking. A promising ratio estimator based on the singular values of the lagged…

Methodology · Statistics 2018-01-23 Zeng Li , Qinwen Wang , Jianfeng Yao

We study the problem of estimating the leading eigenvectors of a high-dimensional population covariance matrix based on independent Gaussian observations. We establish lower bounds on the rates of convergence of the estimators of the…

Statistics Theory · Mathematics 2012-02-07 Debashis Paul , Iain M. Johnstone

Community detection is the task of clustering objects based on their pairwise relationships. Most of the model-based community detection methods, such as the stochastic block model and its variants, are designed for networks with binary…

Machine Learning · Statistics 2024-12-06 Xiang Li , Yunpeng Zhao , Qing Pan , Ning Hao

Diagonalizing a matrix $A$, that is finding two matrices $P$ and $D$ such that $A = PDP^{-1}$ with $D$ being a diagonal matrix needs two steps: first find the eigenvalues and then find the corresponding eigenvectors. We show that we do not…

History and Overview · Mathematics 2020-02-18 Udita N. Katugampola

We consider testing the equality of two high-dimensional covariance matrices by carrying out a multi-level thresholding procedure, which is designed to detect sparse and faint differences between the covariances. A novel U-statistic…

Statistics Theory · Mathematics 2019-10-30 Song Xi Chen , Bin Guo , Yumou Qiu

DAG models with hidden variables present many difficulties that are not present when all nodes are observed. In particular, fully observed DAG models are identified and correspond to well-defined sets ofdistributions, whereas this is not…

Machine Learning · Computer Science 2013-01-14 Jacob A. Wegelin , Thomas S. Richardson

We propose a general, modular method for significance testing of groups (or clusters) of variables in a high-dimensional linear model. In presence of high correlations among the covariables, due to serious problems of identifiability, it is…

Statistics Theory · Mathematics 2015-02-12 Jacopo Mandozzi , Peter Bühlmann

Motivated by an application in high-throughput genomics and metabolomics, we propose a novel, efficient and fully data-driven approach for estimating large block structured sparse covariance matrices in the case where the number of…

Methodology · Statistics 2019-12-09 Marie Perrot-Dockès , Céline Lévy-Leduc , Loïc Rajjou

Distance multivariance is a multivariate dependence measure, which can detect dependencies between an arbitrary number of random vectors each of which can have a distinct dimension. Here we discuss several new aspects, present a concise…

Statistics Theory · Mathematics 2020-04-17 Björn Böttcher

Covariance matrices of random vectors contain information that is crucial for modelling. Specific structures and patterns of the covariances (or correlations) may be used to justify parametric models, e.g., autoregressive models. Until now,…

Methodology · Statistics 2025-02-11 Paavo Sattler , Dennis Dobler

High-dimensional feature vectors are likely to contain sets of measurements that are approximate replicates of one another. In complex applications, or automated data collection, these feature sets are not known a priori, and need to be…

Methodology · Statistics 2020-10-07 Xin Bing , Florentina Bunea , Marten Wegkamp

Statistical inference of the dependence between objects often relies on covariance matrices. Unless the number of features (e.g. data points) is much larger than the number of objects, covariance matrix cleaning is necessary to reduce…

Risk Management · Quantitative Finance 2021-06-09 Christian Bongiorno , Damien Challet

The paper considers variable selection in linear regression models where the number of covariates is possibly much larger than the number of observations. High dimensionality of the data brings in many complications, such as (possibly…

Methodology · Statistics 2016-11-29 Haeran Cho , Piotr Fryzlewicz

Modern network data analysis often involves analyzing network structures alongside covariate features to gain deeper insights into underlying patterns. However, traditional covariate-assisted statistical network models may not adequately…

Methodology · Statistics 2025-05-07 Peng Zhao , Yabo Niu

We study the covariance of the cross-power spectrum of different tracers for the large-scale structure. We develop the counts-in-cells framework for the multi-tracer approach, and use this to derive expressions for the full non-Gaussian…

Astrophysics · Physics 2015-05-13 Robert E. Smith

In many application domains, networks are observed with node-level features. In such settings, a common problem is to assess whether or not nodal covariates are correlated with the network structure itself. Here, we present four novel…

Machine Learning · Statistics 2025-09-05 Alexander Fuchs-Kreiss , Keith Levin

Nonsingular estimation of high dimensional covariance matrices is an important step in many statistical procedures like classification, clustering, variable selection an future extraction. After a review of the essential background…

Statistics Theory · Mathematics 2015-03-19 Deniz Akdemir