English

Rapid and deterministic estimation of probability densities using scale-free field theories

Data Analysis, Statistics and Probability 2014-07-16 v3 Machine Learning Statistics Theory Quantitative Methods Machine Learning Statistics Theory

Abstract

The question of how best to estimate a continuous probability density from finite data is an intriguing open problem at the interface of statistics and physics. Previous work has argued that this problem can be addressed in a natural way using methods from statistical field theory. Here I describe new results that allow this field-theoretic approach to be rapidly and deterministically computed in low dimensions, making it practical for use in day-to-day data analysis. Importantly, this approach does not impose a privileged length scale for smoothness of the inferred probability density, but rather learns a natural length scale from the data due to the tradeoff between goodness-of-fit and an Occam factor. Open source software implementing this method in one and two dimensions is provided.

Keywords

Cite

@article{arxiv.1312.6661,
  title  = {Rapid and deterministic estimation of probability densities using scale-free field theories},
  author = {Justin B. Kinney},
  journal= {arXiv preprint arXiv:1312.6661},
  year   = {2014}
}

Comments

4 pages, 4 figures. Major revision in v3. The "Density Estimation using Field Theory" (DEFT) software package is available at https://github.com/jbkinney/13_deft