Sharpening Occam's Razor
机器学习
2009-09-29 v2 无序系统与神经网络
人工智能
计算复杂性
概率论
数据分析、统计与概率
摘要
We provide a new representation-independent formulation of Occam's razor theorem, based on Kolmogorov complexity. This new formulation allows us to: (i) Obtain better sample complexity than both length-based and VC-based versions of Occam's razor theorem, in many applications. (ii) Achieve a sharper reverse of Occam's razor theorem than previous work. Specifically, we weaken the assumptions made in an earlier publication, and extend the reverse to superpolynomial running times.
引用
@article{arxiv.cs/0201005,
title = {Sharpening Occam's Razor},
author = {Ming Li and John Tromp and Paul Vitanyi},
journal= {arXiv preprint arXiv:cs/0201005},
year = {2009}
}
备注
LaTeX 13 pages; Proc 8th COCOON, LNCS 2387, Springer-Verlag, Berlin, 2002, 411--419