Many downstream NLP tasks have shown significant improvement through continual pre-training, transfer learning and multi-task learning. State-of-the-art approaches in Word Sense Disambiguation today benefit from some of these approaches in conjunction with information sources such as semantic relationships and gloss definitions contained within WordNet. Our work builds upon these systems and uses data augmentation along with extensive pre-training on various different NLP tasks and datasets. Our transfer learning and augmentation pipeline achieves state-of-the-art single model performance in WSD and is at par with the best ensemble results.
@article{arxiv.2101.03617,
title = {Transfer Learning and Augmentation for Word Sense Disambiguation},
author = {Harsh Kohli},
journal= {arXiv preprint arXiv:2101.03617},
year = {2021}
}
Comments
10 pages, 3 figures. Accepted at the 43rd European Conference on Information Retrieval (ECIR) 2021