English

Natural Language Inference over Interaction Space: ICLR 2018 Reproducibility Report

Computation and Language 2018-02-12 v1

Abstract

We have tried to reproduce the results of the paper "Natural Language Inference over Interaction Space" submitted to ICLR 2018 conference as part of the ICLR 2018 Reproducibility Challenge. Initially, we were not aware that the code was available, so we started to implement the network from scratch. We have evaluated our version of the model on Stanford NLI dataset and reached 86.38% accuracy on the test set, while the paper claims 88.0% accuracy. The main difference, as we understand it, comes from the optimizers and the way model selection is performed.

Keywords

Cite

@article{arxiv.1802.03198,
  title  = {Natural Language Inference over Interaction Space: ICLR 2018 Reproducibility Report},
  author = {Martin Mirakyan and Karen Hambardzumyan and Hrant Khachatrian},
  journal= {arXiv preprint arXiv:1802.03198},
  year   = {2018}
}

Comments

as part of ICLR 2018 Reproducibility Challenge

R2 v1 2026-06-23T00:16:53.782Z