English

Automatic Error Detection in Part of Speech Tagging

cmp-lg 2008-02-03 v1 Computation and Language

Abstract

A technique for detecting errors made by Hidden Markov Model taggers is described, based on comparing observable values of the tagging process with a threshold. The resulting approach allows the accuracy of the tagger to be improved by accepting a lower efficiency, defined as the proportion of words which are tagged. Empirical observations are presented which demonstrate the validity of the technique and suggest how to choose an appropriate threshold.

Keywords

Cite

@article{arxiv.cmp-lg/9410013,
  title  = {Automatic Error Detection in Part of Speech Tagging},
  author = {David Elworthy},
  journal= {arXiv preprint arXiv:cmp-lg/9410013},
  year   = {2008}
}

Comments

Postscript. Appeared in NeMLaP 1994

R2 v1 2026-07-22T09:57:56.310Z