English
Related papers

Related papers: On independence testing using the (partial) distan…

200 papers

Testing two potentially multivariate variables for statistical dependence on the basis finite samples is a fundamental statistical challenge. Here we explore a family of tests that adapt to the complexity of the relationship between the…

Machine Learning · Statistics 2020-10-23 Baihan Lin , Nikolaus Kriegeskorte

This paper investigates the utilization of maximum and average distance correlations for multivariate independence testing. We characterize their consistency properties in high-dimensional settings with respect to the number of marginally…

Machine Learning · Statistics 2025-06-11 Cencheng Shen , Yuexiao Dong

For testing two random vectors for independence, we consider testing whether the distance of one vector from a center point is independent from the distance of the other vector from a center point by a univariate test. In this paper we…

Methodology · Statistics 2016-03-11 Ruth Heller , Yair Heller

This paper proposes a new statistic to test independence between two high dimensional random vectors ${\mathbf{X}}:p_1\times1$ and ${\mathbf{Y}}:p_2\times1$. The proposed statistic is based on the sum of regularized sample canonical…

Statistics Theory · Mathematics 2015-03-19 Yanrong Yang , Guangming Pan

We consider testing marginal independence versus conditional independence in a trivariate Gaussian setting. The two models are non-nested and their intersection is a union of two marginal independences. We consider two sequences of such…

Statistics Theory · Mathematics 2020-10-23 F. Richard Guo , Thomas S. Richardson

Distance correlation has gained much recent attention in the data science community: the sample statistic is straightforward to compute and asymptotically equals zero if and only if independence, making it an ideal choice to discover any…

Machine Learning · Statistics 2024-06-27 Cencheng Shen , Sambit Panda , Joshua T. Vogelstein

A random coefficient autoregressive process is deeply investigated in which the coefficients are correlated. First we look at the existence of a strictly stationary causal solution, we give the second-order stationarity conditions and the…

Statistics Theory · Mathematics 2018-03-29 Frédéric Proïa , Marius Soltane

A coefficient is introduced that quantifies the extent of separation of a random variable $Y$ relative to a number of variables $\mathbf{X} = (X_1, \dots, X_p)$ by skillfully assessing the sensitivity of the relative effects of the…

Methodology · Statistics 2025-03-27 Sebastian Fuchs , Carsten Limbach , Patrick B. Langthaler

We demonstrate how to test for conditional independence of two variables with categorical data using Poisson log-linear models. The size of the conditioning set of variables can vary from 0 (simple independence) up to many variables. We…

Methodology · Statistics 2017-06-08 Michail Tsagris

The correlation distance quantifies the statistical independence of two classical or quantum systems, via the distance from their joint state to the product of the marginal states. Tight lower bounds are given for the mutual information…

Quantum Physics · Physics 2013-09-23 Michael J. W. Hall

It is well known that the dependence structure for jointly Gaussian variables can be fully captured using correlations, and that the conditional dependence structure in the same way can be described using partial correlations. The partial…

Methodology · Statistics 2019-09-24 Håkon Otneim , Dag Tjøstheim

In this paper, we study distance covariance, Hilbert-Schmidt covariance (aka Hilbert-Schmidt independence criterion [Gretton et al. (2008)]) and related independence tests under the high dimensional scenario. We show that the sample…

Statistics Theory · Mathematics 2019-02-12 Changbo Zhu , Shun Yao , Xianyang Zhang , Xiaofeng Shao

In his seminal work, Chatterjee (2021) introduced a novel correlation measure which is distribution-free, asymptotically normal, and consistent against all alternatives. In this paper, we study the probabilistic relationships between…

Methodology · Statistics 2023-02-21 Qingyang Zhang

For testing the independence of two vectors with respective dimensions $p_1$ and $p_2$, the existing literature in high-dimensional statistics all assume that both dimensions $p_1$ and $p_2$ grow to infinity with the sample size. However,…

Methodology · Statistics 2018-01-23 Weiming Li , Jiaqi Chen , Jianfeng Yao

Testing conditional independence between two random vectors given a third is a fundamental and challenging problem in statistics, particularly in multivariate nonparametric settings due to the complexity of conditional structures. We…

Machine Learning · Statistics 2025-07-28 Chenxuan He , Yuan Gao , Liping Zhu , Jian Huang

Understanding epistasis (genetic interaction) may shed some light on the genomic basis of common diseases, including disorders of maximum interest due to their high socioeconomic burden, like schizophrenia. Distance correlation is an…

The problem of measuring conditional dependence between two random phenomena arises when a third one (a confounder) has a potential influence on the amount of information between them. A typical issue in this challenging problem is the…

Machine Learning · Statistics 2025-03-12 Ferran de Cabrera , Marc Vilà-Insa , Jaume Riba

In this paper we propose several variants to perform the independence test between two random elements based on recurrence rates. We will show how to calculate the test statistic in each one of these cases. From simulations we obtain that…

Methodology · Statistics 2020-09-21 Juan Kalemkerian , Diego Fernández

Measuring and quantifying dependencies between random variables (RV's) can give critical insights into a data-set. Typical questions are: `Do underlying relationships exist?', `Are some variables redundant?', and `Is some target variable…

Machine Learning · Statistics 2022-03-24 Guus Berkelmans , Joris Pries , Sandjai Bhulai , Rob van der Mei

Is it possible to define a coefficient of correlation which is (a) as simple as the classical coefficients like Pearson's correlation or Spearman's correlation, and yet (b) consistently estimates some simple and interpretable measure of the…

Statistics Theory · Mathematics 2020-04-30 Sourav Chatterjee