English
Related papers

Related papers: A fast algorithm for computing distance correlatio…

200 papers

The need to test whether two random vectors are independent has spawned a large number of competing measures of dependence. We are interested in nonparametric measures that are invariant under strictly increasing transformations, such as…

Statistics Theory · Mathematics 2017-08-21 Luca Weihs , Mathias Drton , Nicolai Meinshausen

The product moment covariance is a cornerstone of multivariate data analysis, from which one can derive correlations, principal components, Mahalanobis distances and many other results. Unfortunately the product moment covariance and the…

Methodology · Statistics 2021-05-21 Jakob Raymaekers , Peter J. Rousseeuw

The "maximum similarity correlation" definition introduced in this study is motivated by the seminal work of Szekely et al on "distance covariance" (Ann. Statist. 2007, 35: 2769-2794; Ann. Appl. Stat. 2009, 3: 1236-1265). Instead of using…

To quantify the dependence between two random vectors of possibly different dimensions, we propose to rely on the properties of the 2-Wasserstein distance. We first propose two coefficients that are based on the Wasserstein distance between…

Statistics Theory · Mathematics 2021-10-19 Gilles Mordant , Johan Segers

Application of the minimum distance method to the linear regression model for estimating regression parameters is a difficult and time-consuming process due to the complexity of its distance function, and hence, it is computationally…

Computation · Statistics 2017-02-15 Jiwoong Kim

We study the problem of estimating the covariance matrix of a high-dimensional distribution when a small constant fraction of the samples can be arbitrarily corrupted. Recent work gave the first polynomial time algorithms for this problem…

Machine Learning · Computer Science 2019-06-12 Yu Cheng , Ilias Diakonikolas , Rong Ge , David Woodruff

The most popular ways to test for independence of two ordinal random variables are by means of Kendall's tau and Spearman's rho. However, such tests are not consistent, only having power for alternatives with ``monotonic'' association. In…

Statistics Theory · Mathematics 2014-03-17 Wicher Bergsma , Angelos Dassios

We apply the concept of distance covariance for testing independence of two long-range dependent time series. As test statistic we propose a linear combination of empirical distance cross-covariances. We derive the asymptotic distribution…

Statistics Theory · Mathematics 2026-01-28 Annika Betken , Herold Dehling

Simple correlation coefficients between two variables have been generalized to measure association between two matrices in many ways. Coefficients such as the RV coefficient, the distance covariance (dCov) coefficient and kernel based…

Methodology · Statistics 2014-08-19 Julie Josse , Susan Holmes

In an extension of Kendall's $\tau$, Bergsma and Dassios (2014) introduced a covariance measure $\tau^*$ for two ordinal random variables that vanishes if and only if the two variables are independent. For a sample of size $n$, a direct…

Computation · Statistics 2015-12-31 Luca Weihs , Mathias Drton , Dennis Leung

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

We present a method for fast evaluation of the covariance matrix for a two-point galaxy correlation function (2PCF) measured with the Landy-Szalay estimator. The standard way of evaluating the covariance matrix consists in running the…

Cosmology and Nongalactic Astrophysics · Physics 2022-10-26 E. Keihanen , V. Lindholm , P. Monaco , L. Blot , C. Carbone , K. Kiiveri , A. G. Sánchez , A. Viitanen , J. Valiviita , A. Amara , N. Auricchio , M. Baldi , D. Bonino , E. Branchini , M. Brescia , J. Brinchmann , S. Camera , V. Capobianco , J. Carretero , M. Castellano , S. Cavuoti , A. Cimatti , R. Cledassou , G. Congedo , L. Conversi , Y. Copin , L. Corcione , M. Cropper , A. Da Silva , H. Degaudenzi , M. Douspis , F. Dubath , C. A. J. Duncan , X. Dupac , S. Dusini , A. Ealet , S. Farrens , S. Ferriol , M. Frailis , E. Franceschi , M. Fumana , B. Gillis , C. Giocoli , A. Grazian , F. Grupp , L. Guzzo , S. V. H. Haugan , H. Hoekstra , W. Holmes , F. Hormuth , K. Jahnke , M. Kümmel , S. Kermiche , A. Kiessling , T. Kitching , M. Kunz , H. Kurki-Suonio , S. Ligori , P. B. Lilje , I. Lloro , E. Maiorano , O. Mansutti , O. Marggraf , F. Marulli , R. Massey , M. Melchior , M. Meneghetti , G. Meylan , M. Moresco , B. Morin , L. Moscardini , E. Munari , S. M. Niemi , C. Padilla , S. Paltani , F. Pasian , K. Pedersen , V. Pettorino , S. Pires , G. Polenta , M. Poncet , L. Popa , F. Raison , A. Renzi , J. Rhodes , E. Romelli , R. Saglia , B. Sartoris , P. Schneider , T. Schrabback , A. Secroun , G. Seidel , C. Sirignano , G. Sirri , L. Stanco , C. Surace , P. Tallada-Crespí , D. Tavagnacco , A. N. Taylor , I. Tereno , R. Toledo-Moreo , F. Torradeflot , E. A. Valentijn , L. Valenziano , T. Vassallo , Y. Wang , J. Weller , G. Zamorani , J. Zoubian , S. Andreon , D. Maino , S. de la Torre

A common goal in observational research is to estimate marginal causal effects in the presence of confounding variables. One solution to this problem is to use the covariate distribution to weight the outcomes such that the data appear…

Methodology · Statistics 2020-08-18 Kevin P. Josey , Elizabeth Juarez-Colunga , Fan Yang , Debashis Ghosh

Detecting dependence between variables is a crucial issue in statistical science. In this paper, we propose a novel metric called label projection correlation to measure the dependence between numerical and categorical variables. The…

Methodology · Statistics 2025-06-24 Yixiao Liu , Pengjian Shang

We introduce a novel measure of dependence that captures the extent to which a random variable $Y$ is determined by a random vector $X$. The measure equals zero precisely when $Y$ and $X$ are independent, and it attains one exactly when $Y$…

Statistics Theory · Mathematics 2026-01-14 Mona Azadkia , Pouya Roudaki

The paper contains results in three areas: First we present a general estimate for tail probabilities of Gaussian quadratic forms with known expectation and variance. Thereafter we analyze the distribution of norms of complex Gaussian…

Probability · Mathematics 2019-03-20 Georg Berschneider , Björn Böttcher

We present a test for independence of two strictly stationary time series based on a bootstrap procedure for the distance covariance. Our test detects any kind of dependence between the two time series within an arbitrary maximum lag $L$.…

Statistics Theory · Mathematics 2024-02-06 Annika Betken , Herold Dehling , Marius Kroll

Distance covariance is a popular dependence measure for two random vectors $X$ and $Y$ of possibly different dimensions and types. Recent years have witnessed concentrated efforts in the literature to understand the distributional…

Statistics Theory · Mathematics 2024-08-05 Qiyang Han , Yandi Shen

Nonparametric correlations such as Spearman's rank correlation and Kendall's tau correlation are widely applied in scientific and engineering fields. This paper investigates the problem of computing nonparametric correlations on the fly for…

Applications · Statistics 2017-12-06 Wei Xiao

The covariance matrix of a $p$-dimensional random variable is a fundamental quantity in data analysis. Given $n$ i.i.d. observations, it is typically estimated by the sample covariance matrix, at a computational cost of $O(np^{2})$…

Computation · Statistics 2018-11-13 Ofer Shwartz , Boaz Nadler