A family of Chatterjee's correlation coefficients and their properties
Abstract
Quantifying the strength of functional dependence between random scalars and is an important statistical problem. While many existing correlation coefficients excel in identifying linear or monotone functional dependence, they fall short in capturing general non-monotone functional relationships. In response, we propose a family of correlation coefficients , characterized by a continuous bivariate function and a cdf function . By offering a range of selections for and , encompasses a diverse class of novel correlation coefficients, while also incorporates the Chatterjee's correlation coefficient (Chatterjee, 2021) as a special case. We prove that converges almost surely to a deterministic limit as sample size approaches infinity. In addition, under appropriate conditions imposed on and , the limit satisfies the three appealing properties: (P1). it belongs to the range of ; (P2). it equals 1 if and only if is a measurable function of ; and (P3). it equals 0 if and only if is independent of . As amplified by our numerical experiments, our proposals provide practitioners with a variety of options to choose the most suitable correlation coefficient tailored to their specific practical needs.
Keywords
Cite
@article{arxiv.2403.17670,
title = {A family of Chatterjee's correlation coefficients and their properties},
author = {Muhong Gao and Qizhai Li},
journal= {arXiv preprint arXiv:2403.17670},
year = {2024}
}
Comments
27 pages, 4 figures