English
Related papers

Related papers: A robust covariance testing approach for high-thro…

200 papers

The product moment covariance is a cornerstone of multivariate data analysis, from which one can derive correlations, principal components, Mahalanobis distances and many other results. Unfortunately the product moment covariance and the…

Methodology · Statistics 2021-05-21 Jakob Raymaekers , Peter J. Rousseeuw

Permutation tests enable testing statistical hypotheses in situations when the distribution of the test statistic is complicated or not available. In some situations, the test statistic under investigation is multivariate, with the multiple…

Methodology · Statistics 2023-11-08 Zdeněk Hlávka , Daniel Hlubinka , Šárka Hudecová

High-dimensional k-sample comparison is a common applied problem. We construct a class of easy-to-implement nonparametric distribution-free tests based on new tools and unexplored connections with spectral graph theory. The test is shown to…

Methodology · Statistics 2019-08-12 Subhadeep , Mukhopadhyay , Kaijun Wang

The non-parametric estimation of covariance lies at the heart of functional data analysis, whether for curve or surface-valued data. The case of a two-dimensional domain poses both statistical and computational challenges, which are…

Statistics Theory · Mathematics 2022-01-19 Tomas Masak , Soham Sarkar , Victor M. Panaretos

Covariate-adaptive randomization (CAR) procedures are frequently used in comparative studies to increase the covariate balance across treatment groups. However, because randomization inevitably uses the covariate information when forming…

Statistics Theory · Mathematics 2022-07-08 Wei Ma , Yichen Qin , Yang Li , Feifang Hu

A default assumption in many machine learning scenarios is that the training and test samples are drawn from the same probability distribution. However, such an assumption is often violated in the real world due to non-stationarity of the…

Machine Learning · Computer Science 2021-05-04 Tianyi Zhang , Ikko Yamane , Nan Lu , Masashi Sugiyama

Assessing agreement between two instruments is crucial in clinical studies to evaluate the similarity between two methods measuring the same subjects. This paper introduces a novel coefficient, termed rho1, to measure agreement between…

Methodology · Statistics 2025-07-11 Ronny Vallejos , Felipe Osorio , Clemente Ferrer

Standard high-dimensional factor models assume that the comovements in a large set of variables could be modeled using a small number of latent factors that affect all variables. In many relevant applications in economics and finance,…

Econometrics · Economics 2022-02-08 Antoine Djogbenou , Razvan Sufana

We study the problems of sequential nonparametric two-sample and independence testing. Sequential tests process data online and allow using observed data to decide whether to stop and reject the null hypothesis or to collect more data,…

Machine Learning · Statistics 2023-07-21 Aleksandr Podkopaev , Aaditya Ramdas

Covariate adjustment is widely recommended to improve statistical efficiency in randomized clinical trials (RCTs), yet empirical evidence comparing available strategies remains limited. This lack of real-world evaluation leaves unresolved…

Applications · Statistics 2026-02-03 Yulin Shao , Liangbo Lyu , Menggang Yu , Bingkai Wang

Variable selection is of increasing importance to address the difficulties of high dimensionality in many scientific areas. In this paper, we demonstrate a property for distance covariance, which is incorporated in a novel feature screening…

Methodology · Statistics 2014-09-03 Jing Kong , Sijian Wang , Grace Wahba

It has been proposed that complex populations, such as those that arise in genomics studies, may exhibit dependencies among observations as well as among variables. This gives rise to the challenging problem of analyzing unreplicated…

Machine Learning · Statistics 2018-06-08 Michael Hornstein , Roger Fan , Kerby Shedden , Shuheng Zhou

In this article, we study tests of independence for data with arbitrary distributions in the non-serial case, i.e., for independent and identically distributed random vectors, as well as in the serial case, i.e., for time series. These…

Methodology · Statistics 2023-06-13 Bouchra R. Nasri , Bruno N. Remillard

Many multivariate statistical methods rely heavily on the sample covariance matrix. It is well known though that the sample covariance matrix is highly non-robust. One popular alternative approach for "robustifying" the multivariate method…

Methodology · Statistics 2015-12-21 Klaus Nordhausen , David E. Tyler

How can we discern whether the covariance operator of a stochastic process is of reduced rank, and if so, what its precise rank is? And how can we do so at a given level of confidence? This question is central to a great deal of methods for…

Methodology · Statistics 2020-08-11 Anirvan Chakraborty , Victor M. Panaretos

We consider the hypothesis testing problem of detecting a shift between the means of two multivariate normal distributions in the high-dimensional setting, allowing for the data dimension p to exceed the sample size n. Specifically, we…

Statistics Theory · Mathematics 2015-09-15 Miles E. Lopes , Laurent J. Jacob , Martin J. Wainwright

We describe an approximate statistical model for the sample variance distribution of the non-linear matter power spectrum that can be calibrated from limited numbers of simulations. Our model retains the common assumption of a multivariate…

Variable selection plays a fundamental role in high-dimensional data analysis. Various methods have been developed for variable selection in recent years. Well-known examples are forward stepwise regression (FSR) and least angle regression…

Methodology · Statistics 2018-02-01 Siliang Gong , Kai Zhang , Yufeng Liu

In the big data era, the need to reevaluate traditional statistical methods is paramount due to the challenges posed by vast datasets. While larger samples theoretically enhance accuracy and hypothesis testing power without increasing false…

Methodology · Statistics 2026-01-09 Xuekui Zhang , Li Xing , Jing Zhang , Soojeong Kim

Precision matrix, which is the inverse of covariance matrix, plays an important role in statistics, as it captures the partial correlation between variables. Testing the equality of two precision matrices in high dimensional setting is a…

Methodology · Statistics 2018-10-23 Mingjuan Zhang , Yong He , Cheng Zhou , Xinsheng Zhang