There is a small but growing body of research on statistical scripts, models of event sequences that allow probabilistic inference of implicit events from documents. These systems operate on structured verb-argument events produced by an NLP pipeline. We compare these systems with recent Recurrent Neural Net models that directly operate on raw tokens to predict sentences, finding the latter to be roughly comparable to the former in terms of predicting missing events in documents.
@article{arxiv.1604.02993,
title = {Using Sentence-Level LSTM Language Models for Script Inference},
author = {Karl Pichotta and Raymond J. Mooney},
journal= {arXiv preprint arXiv:1604.02993},
year = {2016}
}
Comments
To appear in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL-16)