English
Related papers

Related papers: independence: Fast Rank Tests

200 papers

We are concerned with the detection of associations between random vectors of any dimension. Few tests of independence exist that are consistent against all dependent alternatives. We propose a powerful test that is applicable in all…

Methodology · Statistics 2013-08-08 Ruth Heller , Yair Heller , Malka Gorfine

We study the problem of testing \emph{conditional independence} for discrete distributions. Specifically, given samples from a discrete random variable $(X, Y, Z)$ on domain $[\ell_1]\times[\ell_2] \times [n]$, we want to distinguish, with…

Data Structures and Algorithms · Computer Science 2018-07-03 Clément L. Canonne , Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

This paper provides parametric and rank-based optimal tests for eigenvectors and eigenvalues of covariance or scatter matrices in elliptical families. The parametric tests extend the Gaussian likelihood ratio tests of Anderson (1963) and…

Statistics Theory · Mathematics 2012-11-12 Marc Hallin , Davy Paindaveine , Thomas Verdebout

We study the problem of independence testing given independent and identically distributed pairs taking values in a $\sigma$-finite, separable measure space. Defining a natural measure of dependence $D(f)$ as the squared $L^2$-distance…

Statistics Theory · Mathematics 2020-11-09 Thomas B. Berrett , Ioannis Kontoyiannis , Richard J. Samworth

This paper proposes a new mutual independence test for a large number of high dimensional random vectors. The test statistic is based on the characteristic function of the empirical spectral distribution of the sample covariance matrix. The…

Statistics Theory · Mathematics 2012-05-31 G. M. Pan , J. Gao , Y. Yang , M. Guo

Many relations of scientific interest are nonlinear, and even in linear systems distributions are often non-Gaussian, for example in fMRI BOLD data. A class of search procedures for causal relations in high dimensional data relies on sample…

Artificial Intelligence · Computer Science 2014-01-30 Joseph D. Ramsey

We present a test for independence of two strictly stationary time series based on a bootstrap procedure for the distance covariance. Our test detects any kind of dependence between the two time series within an arbitrary maximum lag $L$.…

Statistics Theory · Mathematics 2024-02-06 Annika Betken , Herold Dehling , Marius Kroll

Temporal data are increasingly prevalent in modern data science. A fundamental question is whether two time series are related or not. Existing approaches often have limitations, such as relying on parametric assumptions, detecting only…

Machine Learning · Statistics 2024-05-29 Cencheng Shen , Jaewon Chung , Ronak Mehta , Ting Xu , Joshua T. Vogelstein

In this paper we present a method ofcomputing the posterior probability ofconditional independence of two or morecontinuous variables from data,examined at several resolutions. Ourapproach is motivated by theobservation that the appearance…

Artificial Intelligence · Computer Science 2013-01-14 Dimitris Margaritis , Sebastian Thrun

The test of independence is a crucial component of modern data analysis. However, traditional methods often struggle with the complex dependency structures found in high-dimensional data. To overcome this challenge, we introduce a novel…

Methodology · Statistics 2024-09-13 Mingshuo Liu , Doudou Zhou , Hao Chen

Identifying independence between two random variables or correlated given their samples has been a fundamental problem in Statistics. However, how to do so in a space-efficient way if the number of states is large is not quite well-studied.…

Data Structures and Algorithms · Computer Science 2022-11-21 Zhenhao Gu , Hao Zhang

We build a context-free, comprehensive, flexible, and sound footing for measuring the dependence of two variables based on three new axioms, updating Renyi's (1959) seven postulates. We illustrate the superior footing of axioms by Vinod's…

Methodology · Statistics 2025-10-01 Hrishikesh D Vinod

This paper deals with the problem of nonparametric independence testing, a fundamental decision-theoretic problem that asks if two arbitrary (possibly multivariate) random variables $X,Y$ are independent or not, a question that comes up in…

Machine Learning · Statistics 2015-09-04 Aaditya Ramdas , Leila Wehbe

We propose a new method to test conditional independence of two real random variables $Y$ and $Z$ conditionally on an arbitrary third random variable $X$. %with $F_{.|.}$ representing conditional distribution functions, The partial copula…

Statistics Theory · Mathematics 2011-01-25 Wicher Bergsma

The most popular ways to test for independence of two ordinal random variables are by means of Kendall's tau and Spearman's rho. However, such tests are not consistent, only having power for alternatives with ``monotonic'' association. In…

Statistics Theory · Mathematics 2014-03-17 Wicher Bergsma , Angelos Dassios

Optimal transport and Wasserstein distances are flourishing in many scientific fields as a means for comparing and connecting random structures. Here we pioneer the use of an optimal transport distance between L\'{e}vy measures to solve a…

Statistics Theory · Mathematics 2023-09-18 Marta Catalano , Hugo Lavenant , Antonio Lijoi , Igor Prünster

Given a random sample of size $n$ from a $p$ dimensional random vector, where both $n$ and $p$ are large, we are interested in testing whether the $p$ components of the random vector are mutually independent. This is the so-called complete…

Statistics Theory · Mathematics 2022-01-24 Yongcheng Qi , Yingchao Zhou

We consider a linear regression model and propose an omnibus test to simultaneously check the assumption of independence between the error and the predictor variables, and the goodness-of-fit of the parametric model. Our approach is based…

Methodology · Statistics 2014-05-06 Arnab Sen , Bodhisattva Sen

Measuring the (causal) direction and strength of dependence between two variables (events), Xi and Xj , is fundamental for all science. Our survey of decades-long literature on statistical dependence reveals that most assume symmetry in the…

Methodology · Statistics 2022-12-01 Hrishikesh Vinod

Attempts to quantify dependence between random elements X and Y via maximal correlation go back to Gebelein (1941) and R\'{e}nyi (1959). After summarizing properties (including some new) of the R\'{e}nyi measure of dependence, a calibrated…

Probability · Mathematics 2019-03-13 Abram M. Kagan , Gabor J. Székely