English
Related papers

Related papers: Testing High Dimensional Covariance Matrices, with…

200 papers

This paper deals with the estimation of a high-dimensional covariance with a conditional sparsity structure and fast-diverging eigenvalues. By assuming sparse error covariance matrix in an approximate factor model, we allow for the presence…

Statistics Theory · Mathematics 2013-01-15 Jianqing Fan , Yuan Liao , Martina Mincheva

Covariance and Hessian matrices have been analyzed separately in the literature for classification problems. However, integrating these matrices has the potential to enhance their combined power in improving classification performance. We…

Machine Learning · Computer Science 2024-10-10 Agus Hartoyo , Jan Argasiński , Aleksandra Trenk , Kinga Przybylska , Anna Błasiak , Alessandro Crimi

Estimation of covariance matrices is a fundamental problem in multivariate statistics. Recently, growing efforts have focused on incorporating covariate effects into these matrices, facilitating subject-specific estimation. Despite these…

Methodology · Statistics 2026-04-10 Rakheon Kim , Emma Jingfei Zhang

We develop tests for high-dimensional covariance matrices under a generalized elliptical model. Our tests are based on a central limit theorem (CLT) for linear spectral statistics of the sample covariance matrix based on self-normalized…

Statistics Theory · Mathematics 2019-12-17 Xinxin Yang , Xinghua Zheng , Jiaqi Chen

Schizophrenia (SZ) is a prevalent mental disorder characterized by cognitive, emotional, and behavioral changes. Symptoms of SZ include hallucinations, illusions, delusions, lack of motivation, and difficulties in concentration. Diagnosing…

In genetic studies, not only can the number of predictors obtained from microarray measurements be extremely large, there can also be multiple response variables. Motivated by such a situation, we consider semiparametric dimension reduction…

Methodology · Statistics 2013-09-25 Heng Lian , Shujie Ma

Factor and sparse models are two widely used methods to impose a low-dimensional structure in high-dimensions. However, they are seemingly mutually exclusive. We propose a lifting method that combines the merits of these two models in a…

Econometrics · Economics 2022-09-07 Jianqing Fan , Ricardo Masini , Marcelo C. Medeiros

Big data applications, such as medical imaging and genetics, typically generate datasets that consist of few observations n on many more variables p, a scenario that we denote as p>>n. Traditional data processing methods are often…

Data Analysis, Statistics and Probability · Physics 2016-05-18 Magnus O. Ulfarsson , Frosti Palsson , Jakob Sigurdsson , Johannes R. Sveinsson

In this paper, we propose a new test for testing the equality of two population covariance matrices in the ultra-high dimensional setting that the dimension is much larger than the sizes of both of the two samples. Our proposed methodology…

Methodology · Statistics 2023-12-19 Xiucai Ding , Yichen Hu , Zhenggang Wang

This paper proposes a novel testing procedure for selecting a sparse set of covariates that explains a large dimensional panel. Our selection method provides correct false detection control while having higher power than existing…

Econometrics · Economics 2023-03-09 Markus Pelger , Jiacheng Zou

Controlling false positives (Type I errors) through statistical hypothesis testing is a foundation of modern scientific data analysis. Existing causal structure discovery algorithms either do not provide Type I error control or cannot scale…

Methodology · Statistics 2025-12-29 James Leiner , Brian Manzo , Aaditya Ramdas , Wesley Tansey

In this paper, we consider the problem of testing equality of the covariance matrices of L complex Gaussian multivariate time series of dimension $M$ . We study the special case where each of the L covariance matrices is modeled as a rank K…

Statistics Theory · Mathematics 2024-04-11 Rémi Beisson , Pascal Vallet , Audrey Giremus , Guillaume Ginolhac

Linear discriminant analysis (LDA) is a typical method for classification problems with large dimensions and small samples. There are various types of LDA methods that are based on the different types of estimators for the covariance…

Methodology · Statistics 2023-03-07 Jaehoan Kim , Hoyoung Park , Junyong Park

Causal inference plays an important role in under standing the underlying mechanisation of the data generation process across various domains. It is challenging to estimate the average causal effect and individual causal effects from…

Data Structures and Algorithms · Computer Science 2023-01-05 Haoran Zhao , Yinghao Zhang , Debo Cheng , Chen Li , Zaiwen Feng

Due to their parsimony, separable covariance models have been popular in modeling matrix-variate data. However, the inference from such a model may be misleading if the population covariance matrix $\Sigma$ is actually non-separable,…

Statistics Theory · Mathematics 2026-05-05 Bongjung Sung , Peter D. Hoff

Self-supervised pre-training methods have brought remarkable breakthroughs in the understanding of text, image, and speech. Recent developments in genomics has also adopted these pre-training methods for genome understanding. However, they…

Machine Learning · Computer Science 2022-04-15 Samuel Cahyawijaya , Tiezheng Yu , Zihan Liu , Tiffany T. W. Mak , Xiaopu Zhou , Nancy Y. Ip , Pascale Fung

A fundamental approach in neuroscience research is to test hypotheses based on neuropsychological and behavioral measures, i.e., whether certain factors (e.g., related to life events) are associated with an outcome (e.g., depression). In…

Machine Learning · Computer Science 2022-08-01 Magdalini Paschali , Qingyu Zhao , Ehsan Adeli , Kilian M. Pohl

The variance--covariance matrix plays a central role in the inferential theories of high-dimensional factor models in finance and economics. Popular regularization methods of directly exploiting sparsity are not directly applicable to many…

Methodology · Statistics 2012-03-15 Jianqing Fan , Yuan Liao , Martina Mincheva

The boom of DL technology leads to massive DL models built and shared, which facilitates the acquisition and reuse of DL models. For a given task, we encounter multiple DL models available with the same functionality, which are considered…

Software Engineering · Computer Science 2021-03-10 Linghan Meng , Yanhui Li , Lin Chen , Zhi Wang , Di Wu , Yuming Zhou , Baowen Xu

Maximum eigenvalue detection (MED) is an important application of random matrix theory in spectrum sensing and signal detection. However, in small signal-to-noise ratio environment, the maximum eigenvalue of the representative signal is at…

Signal Processing · Electrical Eng. & Systems 2018-03-28 Lin Zheng , Robert C. Qiu , Qing Feng , Xuebin Li