Algorithmic Complexity Bounds on Future Prediction Errors
Machine Learning
2007-07-16 v1 Artificial Intelligence
Information Theory
math.IT
Abstract
We bound the future loss when predicting any (computably) stochastic sequence online. Solomonoff finitely bounded the total deviation of his universal predictor from the true distribution by the algorithmic complexity of . Here we assume we are at a time and already observed . We bound the future prediction performance on by a new variant of algorithmic complexity of given , plus the complexity of the randomness deficiency of . The new complexity is monotone in its condition in the sense that this complexity can only decrease if the condition is prolonged. We also briefly discuss potential generalizations to Bayesian model classes and to classification problems.
Keywords
Cite
@article{arxiv.cs/0701120,
title = {Algorithmic Complexity Bounds on Future Prediction Errors},
author = {A. Chernov and M. Hutter and J. Schmidhuber},
journal= {arXiv preprint arXiv:cs/0701120},
year = {2007}
}
Comments
21 pages