English

Field Theories for Learning Probability Distributions

Condensed Matter 2009-10-28 v1 adap-org High Energy Physics - Theory Adaptation and Self-Organizing Systems

Abstract

Imagine being shown NN samples of random variables drawn independently from the same distribution. What can you say about the distribution? In general, of course, the answer is nothing, unless we have some prior notions about what to expect. From a Bayesian point of view we need an {\it a priori} distribution on the space of possible probability distributions, which defines a scalar field theory. In one dimension, free field theory with a constraint provides a tractable formulation of the problem, and we also discus generalizations to higher dimensions.

Keywords

Cite

@article{arxiv.cond-mat/9607180,
  title  = {Field Theories for Learning Probability Distributions},
  author = {William Bialek and Curtis G. Callan and S. P. Strong},
  journal= {arXiv preprint arXiv:cond-mat/9607180},
  year   = {2009}
}

Comments

12 pages, REVTEX