On the Complexity of Binary Samples
Discrete Mathematics
2008-02-01 v1 Artificial Intelligence
Machine Learning
Abstract
Consider a class of binary functions on a finite interval . Define the {\em sample width} of on a finite subset (a sample) as , where . Let be the space of all samples in of cardinality and consider sets of wide samples, i.e., {\em hypersets} which are defined as . Through an application of the Sauer-Shelah result on the density of sets an upper estimate is obtained on the growth function (or trace) of the class , , i.e., on the number of possible dichotomies obtained by intersecting all hypersets with a fixed collection of samples of cardinality . The estimate is .
Cite
@article{arxiv.0801.4794,
title = {On the Complexity of Binary Samples},
author = {Joel Ratsaby},
journal= {arXiv preprint arXiv:0801.4794},
year = {2008}
}