中文

Algorithmic Complexity Bounds on Future Prediction Errors

机器学习 2007-07-16 v1 人工智能 信息论 math.IT

摘要

We bound the future loss when predicting any (computably) stochastic sequence online. Solomonoff finitely bounded the total deviation of his universal predictor MM from the true distribution mumu by the algorithmic complexity of mumu. Here we assume we are at a time t>1t>1 and already observed x=x1...xtx=x_1...x_t. We bound the future prediction performance on xt+1xt+2...x_{t+1}x_{t+2}... by a new variant of algorithmic complexity of mumu given xx, plus the complexity of the randomness deficiency of xx. The new complexity is monotone in its condition in the sense that this complexity can only decrease if the condition is prolonged. We also briefly discuss potential generalizations to Bayesian model classes and to classification problems.

关键词

引用

@article{arxiv.cs/0701120,
  title  = {Algorithmic Complexity Bounds on Future Prediction Errors},
  author = {A. Chernov and M. Hutter and J. Schmidhuber},
  journal= {arXiv preprint arXiv:cs/0701120},
  year   = {2007}
}

备注

21 pages