$k$-Variance: A Clustered Notion of Variance
Statistics Theory
2020-12-15 v1 Machine Learning
Numerical Analysis
Numerical Analysis
Machine Learning
Statistics Theory
Abstract
We introduce -variance, a generalization of variance built on the machinery of random bipartite matchings. -variance measures the expected cost of matching two sets of samples from a distribution to each other, capturing local rather than global information about a measure as increases; it is easily approximated stochastically using sampling and linear programming. In addition to defining -variance and proving its basic properties, we provide in-depth analysis of this quantity in several key cases, including one-dimensional measures, clustered measures, and measures concentrated on low-dimensional subsets of . We conclude with experiments and open problems motivated by this new way to summarize distributional shape.
Cite
@article{arxiv.2012.06958,
title = {$k$-Variance: A Clustered Notion of Variance},
author = {Justin Solomon and Kristjan Greenewald and Haikady N. Nagaraja},
journal= {arXiv preprint arXiv:2012.06958},
year = {2020}
}