English
Related papers

Related papers: Hotelling's test for highly correlated data

200 papers

Hotelling's $T^2$ test is a classical approach for discriminating the means of two multivariate normal samples that share a population covariance matrix. Hotelling's test is not ideal for high-dimensional samples because the eigenvalues of…

Statistics Theory · Mathematics 2022-06-07 Benjamin D. Robinson , Robert Malinas , Van Latimer , Beth Bjorkman Morrison , Alfred O. Hero

The paper considers variable selection in linear regression models where the number of covariates is possibly much larger than the number of observations. High dimensionality of the data brings in many complications, such as (possibly…

Methodology · Statistics 2016-11-29 Haeran Cho , Piotr Fryzlewicz

Hotelling's T-squared test is a classical tool to test if the normal mean of a multivariate normal distribution is a specified one or the means of two multivariate normal means are equal. When the population dimension is higher than the…

Statistics Theory · Mathematics 2021-08-17 Tiefeng Jiang , Ping Li

Nonparametric two sample testing is a decision theoretic problem that involves identifying differences between two random variables without making parametric assumptions about their underlying distributions. We refer to the most common…

Statistics Theory · Mathematics 2015-08-05 Aaditya Ramdas , Sashank J. Reddi , Barnabas Poczos , Aarti Singh , Larry Wasserman

High-dimensional phenotypes hold promise for richer findings in association studies, but testing of several phenotype traits aggravates the grand challenge of association studies, that of multiple testing. Several methods have recently been…

Methodology · Statistics 2013-05-14 Pekka Marttinen , Jussi Gillberg , Aki Havulinna , Jukka Corander , Samuel Kaski

In the search for genetic factors that are associated with complex heritable human traits, considerable attention is now being focused on rare variants that individually have small effects. In response, numerous recent papers have proposed…

Methodology · Statistics 2014-09-10 Andriy Derkach , Jerry F. Lawless , Lei Sun

It is well known that correlations in microarray data represent a serious nuisance deteriorating the performance of gene selection procedures. This paper is intended to demonstrate that the correlation structure of microarray data provides…

Applications · Statistics 2007-12-18 Lev Klebanov , Andrei Yakovlev

We study hypothesis testing under communication constraints, where each sample is quantized before being revealed to a statistician. Without communication constraints, it is well known that the sample complexity of simple binary hypothesis…

Statistics Theory · Mathematics 2023-12-19 Ankit Pensia , Varun Jog , Po-Ling Loh

In high dimensions, the classical Hotelling's $T^2$ test tends to have low power or becomes undefined due to singularity of the sample covariance matrix. In this paper, this problem is overcome by projecting the data matrix onto lower…

Methodology · Statistics 2014-05-09 Radhendushka Srivastava , Ping Li , David Ruppert

In the presence of weak overall correlation, it may be useful to investigate if the correlation is significantly and substantially more pronounced over a subpopulation. Two different testing procedures are compared. Both are based on the…

Machine Learning · Statistics 2015-04-22 Stephen Bamattre , Rex Hu , Joseph S. Verducci

In this paper, the defining properties of a valid measure of the dependence between two random variables are reviewed and complemented with two original ones, shown to be more fundamental than other usual postulates. While other popular…

Methodology · Statistics 2019-12-03 Gery Geenens , Pierre Lafaye de Micheaux

It has been a long history in testing whether a mean vector with a fixed dimension has a specified value. Some well-known tests include the Hotelling $T^2$-test and the empirical likelihood ratio test proposed by Owen [Biometrika 75 (1988)…

Methodology · Statistics 2014-05-21 Liang Peng , Yongcheng Qi , Fang Wang

Designed gene expression micro-array experiments, consisting of several treatment levels with a number of replicates per level, are analyzed by applying simple tests for group differences at the per gene level. The gene level statistics are…

Methodology · Statistics 2017-12-11 Grant Izmirlian

Testing the equality of two high-dimensional mean vectors is a fundamental problem in multivariate analysis. While the classical Hotelling's $T^2$ test is optimal in low-dimensional settings, it fails when the dimension $p$ is comparable to…

Methodology · Statistics 2026-05-22 Minsub Shin , Kwangok Seo , Sang Han Lee , Johan Lim

Standard high-dimensional factor models assume that the comovements in a large set of variables could be modeled using a small number of latent factors that affect all variables. In many relevant applications in economics and finance,…

Econometrics · Economics 2022-02-08 Antoine Djogbenou , Razvan Sufana

In this article, we propose some two-sample tests based on ball divergence and investigate their high dimensional behavior. First, we study their behavior for High Dimension, Low Sample Size (HDLSS) data, and under appropriate regularity…

Statistics Theory · Mathematics 2024-10-08 Bilol Banerjee , Anil K. Ghosh

We are interested in investigating the statistical properties of extreme values for strongly correlated variables. The starting motivation is to understand how the strong-correlation properties of power-law distributed processes affect the…

Computational Physics · Physics 2024-05-21 Salvatore Miccichè

We propose a method for detecting differential gene expression that exploits the correlation between genes. Our proposal averages the univariate scores of each feature with the scores in correlation neighborhoods. In a number of real and…

Statistics Theory · Mathematics 2007-06-13 Robert Tibshirani , Larry Wasserman

Power-enhanced tests with high-dimensional data have received growing attention in theoretical and applied statistics in recent years. Existing tests possess their respective high-power regions, and we may lack prior knowledge about the…

Methodology · Statistics 2021-10-01 Xiufan Yu , Danning Li , Lingzhou Xue , Runze Li

The test of independence is a crucial component of modern data analysis. However, traditional methods often struggle with the complex dependency structures found in high-dimensional data. To overcome this challenge, we introduce a novel…

Methodology · Statistics 2024-09-13 Mingshuo Liu , Doudou Zhou , Hao Chen