English

A family of Chatterjee's correlation coefficients and their properties

Methodology 2024-03-27 v1

Abstract

Quantifying the strength of functional dependence between random scalars XX and YY is an important statistical problem. While many existing correlation coefficients excel in identifying linear or monotone functional dependence, they fall short in capturing general non-monotone functional relationships. In response, we propose a family of correlation coefficients ξn(h,F)\xi^{(h,F)}_n, characterized by a continuous bivariate function hh and a cdf function FF. By offering a range of selections for hh and FF, ξn(h,F)\xi^{(h,F)}_n encompasses a diverse class of novel correlation coefficients, while also incorporates the Chatterjee's correlation coefficient (Chatterjee, 2021) as a special case. We prove that ξn(h,F)\xi^{(h,F)}_n converges almost surely to a deterministic limit ξ(h,F)\xi^{(h,F)} as sample size nn approaches infinity. In addition, under appropriate conditions imposed on hh and FF, the limit ξ(h,F)\xi^{(h,F)} satisfies the three appealing properties: (P1). it belongs to the range of [0,1][0,1]; (P2). it equals 1 if and only if YY is a measurable function of XX; and (P3). it equals 0 if and only if YY is independent of XX. As amplified by our numerical experiments, our proposals provide practitioners with a variety of options to choose the most suitable correlation coefficient tailored to their specific practical needs.

Keywords

Cite

@article{arxiv.2403.17670,
  title  = {A family of Chatterjee's correlation coefficients and their properties},
  author = {Muhong Gao and Qizhai Li},
  journal= {arXiv preprint arXiv:2403.17670},
  year   = {2024}
}

Comments

27 pages, 4 figures