We present our systems and findings for the prerequisite relation learning task (PRELEARN) at EVALITA 2020. The task aims to classify whether a pair of concepts hold a prerequisite relation or not. We model the problem using handcrafted features and embedding representations for in-domain and cross-domain scenarios. Our submissions ranked first place in both scenarios with average F1 score of 0.887 and 0.690 respectively across domains on the test sets. We made our code is freely available.
Cite
@article{arxiv.2011.03760,
title = {NLP-CIC @ PRELEARN: Mastering prerequisites relations, from handcrafted features to embeddings},
author = {Jason Angel and Segun Taofeek Aroyehun and Alexander Gelbukh},
journal= {arXiv preprint arXiv:2011.03760},
year = {2020}
}
Comments
Accepted at EVALITA 2020: Proceedings of Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop