English
Related papers

Related papers: Improved distance correlation estimation

200 papers

We consider a classical problem in choice theory -- vote aggregation -- using novel distance measures between permutations that arise in several practical applications. The distance measures are derived through an axiomatic approach, taking…

Computer Science and Game Theory · Computer Science 2012-12-10 Farzad Farnoud , Olgica Milenkovic , Behrouz Touri

Optimal transport and Wasserstein distances are flourishing in many scientific fields as a means for comparing and connecting random structures. Here we pioneer the use of an optimal transport distance between L\'{e}vy measures to solve a…

Statistics Theory · Mathematics 2023-09-18 Marta Catalano , Hugo Lavenant , Antonio Lijoi , Igor Prünster

Discovering a correlation from one variable to another variable is of fundamental scientific and practical interest. While existing correlation measures are suitable for discovering average correlation, they fail to discover hidden or…

Machine Learning · Statistics 2017-11-22 Hyeji Kim , Weihao Gao , Sreeram Kannan , Sewoong Oh , Pramod Viswanath

Cosine similarity is a popular distance measure that measures the similarity between two vectors in the inner product space. It is widely used in many data classification algorithms like K-Nearest Neighbors, Clustering etc. This study…

Machine Learning · Statistics 2025-02-05 Satyajeet Sahoo , Jhareswar Maiti

The maximum mean discrepancy (MMD) is a kernel-based distance between probability distributions useful in many applications (Gretton et al. 2012), bearing a simple estimator with pleasing computational and statistical properties. Being able…

Machine Learning · Statistics 2022-11-16 Danica J. Sutherland , Namrata Deka

This paper proposes an estimator that relaxes the conventional relevance condition in instrumental variable (IV) analyses. The method allows endogenous covariates to be weakly correlated, uncorrelated, or even mean-independent -- though not…

Econometrics · Economics 2025-11-04 Emmanuel Selorm Tsyawo , Abdul-Nasah Soale

A class of improved estimators is proposed for N-point correlation functions of galaxy clustering, and for discrete spatial random processes in general. In the limit of weak clustering, the variance of the unbiased estimator converges to…

Astrophysics · Physics 2007-05-23 István Szapudi , Alexander S. Szalay

Little attention has been given to the correlation coefficient when data come from discrete or continuous non-normal populations. In this article, we consider the efficiency of two correlation coefficients which are from the same family,…

Methodology · Statistics 2015-11-06 Michael Tsagris , Ioannis Elmatzoglou , Christos C. Frangos

We present a weighted estimator of the covariance and correlation in bipartite complex systems with a double layer of heterogeneity. The advantage provided by the weighted estimators lies in the fact that the unweighted sample covariance…

Data Analysis, Statistics and Probability · Physics 2016-12-22 Elena Puccio , Jyrki Piilo , Michele Tumminello

A distance measure is presented between two unitary propagators of quantum systems of differing dimensions along with a corresponding method of computation. A typical application is to compare the propagator of the actual (real) process…

Quantum Physics · Physics 2007-05-23 Robert L. Kosut , Matthew Grace , Constantin Brif , Herschel Rabitz

We generalize an integral which arises in several areas in probability and statistics and which is at the core of the field of distance correlation, a concept developed by Sz\'ekely, Rizzo and Bakirov (2007) to measure dependence between…

Statistics Theory · Mathematics 2014-12-02 Johannes Dueck , Dominic Edelmann , Donald Richards

For many optimization problems it is possible to define a distance metric between problem variables that correlates with the likelihood and strength of interactions between the variables. For example, one may define a metric so that the…

Neural and Evolutionary Computing · Computer Science 2012-01-12 Martin Pelikan , Mark W. Hauschild

In the present paper, we discuss the Pearson, Spearman, Kendall correlation coefficients and their statistical analogues. We propose a new correlation coefficient r and its statistical analogue. The coefficient r is based on Kendal's and…

Statistics Theory · Mathematics 2024-05-28 Alexei Stepanov

The invariants of an attractor have been the most used resource to characterize a nonlinear dynamics. Their estimation is a challenging endeavor in short-time series and/or in presence of noise. In this article we present two new…

Chaotic Dynamics · Physics 2017-12-13 Juan F. Restrepo , Gastón Schlotthauer

Divergence functions are interesting discrepancy measures. Even though they are not true distances, we can use them to measure how separated two points are. Curiously enough, when they are applied to random variables, they lead to a notion…

Statistics Theory · Mathematics 2018-09-21 Henryk Gzyl

This paper introduces a new way to calculate distance-based statistics, particularly when the data are multivariate. The main idea is to pre-calculate the optimal projection directions given the variable dimension, and to project…

Computation · Statistics 2019-11-11 Chuanping Yu , Xiaoming Huo

We describe a set of new estimators for the N-point correlation functions of point processes. The variance of these estimators is calculated for the Poisson and binomial cases. It is shown that the variance of the unbiased estimator…

Astrophysics · Physics 2007-05-23 Istvan Szapudi , Alexander S. Szalay

A prescription is presented for a new and practical correlation coefficient, $\phi_K$, based on several refinements to Pearson's hypothesis test of independence of two variables. The combined features of $\phi_K$ form an advantage over…

Methodology · Statistics 2019-03-12 M. Baak , R. Koopman , H. Snoek , S. Klous

We discuss a class of difference-based estimators for the autocovariance in nonparametric regression when the signal is discontinuous (change-point regression), possibly highly fluctuating, and the errors form a stationary $m$-dependent…

Methodology · Statistics 2016-08-09 Inder Tecuapetla-Gómez , Axel Munk

In his seminal work, Chatterjee (2021) introduced a novel correlation measure which is distribution-free, asymptotically normal, and consistent against all alternatives. In this paper, we study the probabilistic relationships between…

Methodology · Statistics 2023-02-21 Qingyang Zhang