English

Playing Billiard in Version Space

Condensed Matter 2007-05-23 v1

Abstract

A ray-tracing method inspired by ergodic billiards is used to estimate the theoretically best decision rule for a set of linear separable examples. While the Bayes-optimum requires a majority decision over all Perceptrons separating the example set, the problem considered here corresponds to finding the single Perceptron with best average generalization probability. For randomly distributed examples the billiard estimate agrees with known analytic results. In real-life classification problems the generalization error is consistently reduced compared to the maximal stability Perceptron.

Keywords

Cite

@article{arxiv.cond-mat/9508130,
  title  = {Playing Billiard in Version Space},
  author = {Pal Rujan},
  journal= {arXiv preprint arXiv:cond-mat/9508130},
  year   = {2007}
}

Comments

uuencoded, gzipped PostScript file, 127576 bytes To recover 1) save file as bayes.uue. Then 2) uudecode bayes.uue and 3) gunzip bayes.ps.gz