Neural Models for Key Phrase Detection and Question Generation
Abstract
We propose a two-stage neural model to tackle question generation from documents. First, our model estimates the probability that word sequences in a document are ones that a human would pick when selecting candidate answers by training a neural key-phrase extractor on the answers in a question-answering corpus. Predicted key phrases then act as target answers and condition a sequence-to-sequence question-generation model with a copy mechanism. Empirically, our key-phrase extraction model significantly outperforms an entity-tagging baseline and existing rule-based approaches. We further demonstrate that our question generation system formulates fluent, answerable questions from key phrases. This two-stage system could be used to augment or generate reading comprehension datasets, which may be leveraged to improve machine reading systems or in educational settings.
Cite
@article{arxiv.1706.04560,
title = {Neural Models for Key Phrase Detection and Question Generation},
author = {Sandeep Subramanian and Tong Wang and Xingdi Yuan and Saizheng Zhang and Yoshua Bengio and Adam Trischler},
journal= {arXiv preprint arXiv:1706.04560},
year = {2018}
}
Comments
Machine Reading for Question Answering workshop at ACL 2018