Experiments on Paraphrase Identification Using Quora Question Pairs Dataset
Computation and Language
2020-06-08 v2 Artificial Intelligence
Machine Learning
Abstract
We modeled the Quora question pairs dataset to identify a similar question. The dataset that we use is provided by Quora. The task is a binary classification. We tried several methods and algorithms and different approach from previous works. For feature extraction, we used Bag of Words including Count Vectorizer, and Term Frequency-Inverse Document Frequency with unigram for XGBoost and CatBoost. Furthermore, we also experimented with WordPiece tokenizer which improves the model performance significantly. We achieved up to 97 percent accuracy. Code and Dataset.
Keywords
Cite
@article{arxiv.2006.02648,
title = {Experiments on Paraphrase Identification Using Quora Question Pairs Dataset},
author = {Andreas Chandra and Ruben Stefanus},
journal= {arXiv preprint arXiv:2006.02648},
year = {2020}
}