Handling Sparse Data by Successive Abstraction
cmp-lg
2008-02-03 v1 Computation and Language
Abstract
A general, practical method for handling sparse data that avoids held-out data and iterative reestimation is derived from first principles. It has been tested on a part-of-speech tagging task and outperformed (deleted) interpolation with context-independent weights, even when the latter used a globally optimal parameter setting determined a posteriori.
Cite
@article{arxiv.cmp-lg/9605034,
title = {Handling Sparse Data by Successive Abstraction},
author = {Christer Samuelsson},
journal= {arXiv preprint arXiv:cmp-lg/9605034},
year = {2008}
}
Comments
6 pages, uuencoded, gzipped PostScript