In this paper, we describe our system for Task 4 of SemEval 2020, which involves differentiating between natural language statements that confirm to common sense and those that do not. The organizers propose three subtasks - first, selecting between two sentences, the one which is against common sense. Second, identifying the most crucial reason why a statement does not make sense. Third, generating novel reasons for explaining the against common sense statement. Out of the three subtasks, this paper reports the system description of subtask A and subtask B. This paper proposes a model based on transformer neural network architecture for addressing the subtasks. The novelty in work lies in the architecture design, which handles the logical implication of contradicting statements and simultaneous information extraction from both sentences. We use a parallel instance of transformers, which is responsible for a boost in the performance. We achieved an accuracy of 94.8% in subtask A and 89% in subtask B on the test set.
@article{arxiv.2007.10830,
title = {CS-NET at SemEval-2020 Task 4: Siamese BERT for ComVE},
author = {Soumya Ranjan Dash and Sandeep Routray and Prateek Varshney and Ashutosh Modi},
journal= {arXiv preprint arXiv:2007.10830},
year = {2020}
}
Comments
6 pages, 2 figures, 2 tables Accepted at Proceedings of the 14th International Workshop on Semantic Evaluation (SemEval-2020)