English

Word Sense Disambiguation with LSTM: Do We Really Need 100 Billion Words?

Computation and Language 2017-12-19 v2

Abstract

Recently, Yuan et al. (2016) have shown the effectiveness of using Long Short-Term Memory (LSTM) for performing Word Sense Disambiguation (WSD). Their proposed technique outperformed the previous state-of-the-art with several benchmarks, but neither the training data nor the source code was released. This paper presents the results of a reproduction study of this technique using only openly available datasets (GigaWord, SemCore, OMSTI) and software (TensorFlow). From them, it emerged that state-of-the-art results can be obtained with much less data than hinted by Yuan et al. All code and trained models are made freely available.

Keywords

Cite

@article{arxiv.1712.03376,
  title  = {Word Sense Disambiguation with LSTM: Do We Really Need 100 Billion Words?},
  author = {Minh Le and Marten Postma and Jacopo Urbani},
  journal= {arXiv preprint arXiv:1712.03376},
  year   = {2017}
}