English
Related papers

Related papers: Improved distance correlation estimation

200 papers

Testing independence among a number of (ultra) high-dimensional random samples is a fundamental and challenging problem. By arranging $n$ identically distributed $p$-dimensional random vectors into a $p \times n$ data matrix, we investigate…

Statistics Theory · Mathematics 2017-03-28 Xi Chen , Weidong Liu

The use of empirical characteristic functions for inference problems, including estimation in some special parametric settings and testing for goodness of fit, has a long history dating back to the 70s (see for example, Feuerverger and…

Statistics Theory · Mathematics 2016-06-20 Richard A. Davis , Muneya Matsui , Thomas Mikosch , Phyllis Wan

This work considers the problem of estimating the distance between two covariance matrices directly from the data. Particularly, we are interested in the family of distances that can be expressed as sums of traces of functions that are…

Machine Learning · Computer Science 2024-09-19 Roberto Pereira , Xavier Mestre , Davig Gregoratti

The extension of bivariate measures of dependence to non-Euclidean spaces is a challenging problem. The non-linear nature of these spaces makes the generalisation of classical measures of linear dependence (such as the covariance) not…

Statistics Theory · Mathematics 2024-10-10 Meshal Abuqrais , Davide Pigoli

The covariance of two random variables measures the average joint deviations from their respective means. We generalise this well-known measure by replacing the means with other statistical functionals such as quantiles, expectiles, or…

Methodology · Statistics 2023-09-22 Tobias Fissler , Marc-Oliver Pohle

Not a matter of serious contention, Pearson's correlation coefficient is still the most important statistical association measure. Restricted to just two variables, this measure sometimes doesn't live up to users' needs and expectations.…

Mathematical Finance · Quantitative Finance 2024-02-02 Reza Salimi , Kamran Pakizeh

We propose new statistical tests, in high-dimensional settings, for testing the independence of two random vectors and their conditional independence given a third random vector. The key idea is simple, i.e., we first transform each…

Methodology · Statistics 2026-01-28 Jinyuan Chang , Yue Du , Jing He , Qiwei Yao

We are concerned with the detection of associations between random vectors of any dimension. Few tests of independence exist that are consistent against all dependent alternatives. We propose a powerful test that is applicable in all…

Methodology · Statistics 2013-08-08 Ruth Heller , Yair Heller , Malka Gorfine

Detecting dependence between variables is a crucial issue in statistical science. In this paper, we propose a novel metric called label projection correlation to measure the dependence between numerical and categorical variables. The…

Methodology · Statistics 2025-06-24 Yixiao Liu , Pengjian Shang

Pearson's Chi-squared test, though widely used for detecting association between categorical variables, exhibits low statistical power in large sparse contingency tables. To address this limitation, two novel permutation tests have been…

Methodology · Statistics 2024-03-27 Qingyang Zhang

Is it possible to define a coefficient of correlation which is (a) as simple as the classical coefficients like Pearson's correlation or Spearman's correlation, and yet (b) consistently estimates some simple and interpretable measure of the…

Statistics Theory · Mathematics 2020-04-30 Sourav Chatterjee

Distance covariance is a popular dependence measure for two random vectors $X$ and $Y$ of possibly different dimensions and types. Recent years have witnessed concentrated efforts in the literature to understand the distributional…

Statistics Theory · Mathematics 2024-08-05 Qiyang Han , Yandi Shen

In data science, it is often required to estimate dependencies between different data sources. These dependencies are typically calculated using Pearson's correlation, distance correlation, and/or mutual information. However, none of these…

Statistics Theory · Mathematics 2015-06-03 Rahul Agarwal , Pierre Sacre , Sridevi V. Sarma

Understanding epistasis (genetic interaction) may shed some light on the genomic basis of common diseases, including disorders of maximum interest due to their high socioeconomic burden, like schizophrenia. Distance correlation is an…

Through computer simulations, we research several different measures of dependence, including Pearson's and Spearman's correlation coefficients, the maximal correlation, the distance correlation, a function of the mutual information called…

Methodology · Statistics 2023-03-16 Oona Rainio

The purpose of this paper is twofold. First, we provide a novel characterization of independence of random vectors based on the checkerboard approximation to a multivariate copula. Using this result, we then propose a new family of tests of…

Statistics Theory · Mathematics 2019-06-07 José M. González-Barrios , Eduardo Gutiérrez-Peña , Juan D. Nieves , Raúl Rueda

Recently, the first author proposed a measure to calculate Pearson correlations for node values expressed in a network, by taking into account distances or metrics defined on the network. In this technical note, we show that using an…

Social and Information Networks · Computer Science 2024-02-16 Michele Coscia , Karel Devriendt

In this paper, the defining properties of a valid measure of the dependence between two random variables are reviewed and complemented with two original ones, shown to be more fundamental than other usual postulates. While other popular…

Methodology · Statistics 2019-12-03 Gery Geenens , Pierre Lafaye de Micheaux

Quantum systems generally exhibit different kinds of correlations. In order to compare them on equal footing, one uses the so-called distance-based approach where different types of correlations are captured by the distance to different…

Quantum Physics · Physics 2022-02-25 Ray Ganardi , Marek Miller , Tomasz Paterek , Marek Żukowski

We treat the problem of testing independence between m continuous variables when m can be larger than the available sample size n. We consider three types of test statistics that are constructed as sums or sums of squares of pairwise rank…

Statistics Theory · Mathematics 2016-12-05 Dennis Leung , Mathias Drton