English

JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension

Computation and Language 2022-02-04 v1 Artificial Intelligence Machine Learning

Abstract

Question Answering (QA) is a task in which a machine understands a given document and a question to find an answer. Despite impressive progress in the NLP area, QA is still a challenging problem, especially for non-English languages due to the lack of annotated datasets. In this paper, we present the Japanese Question Answering Dataset, JaQuAD, which is annotated by humans. JaQuAD consists of 39,696 extractive question-answer pairs on Japanese Wikipedia articles. We finetuned a baseline model which achieves 78.92% for F1 score and 63.38% for EM on test set. The dataset and our experiments are available at https://github.com/SkelterLabsInc/JaQuAD.

Keywords

Cite

@article{arxiv.2202.01764,
  title  = {JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension},
  author = {ByungHoon So and Kyuhong Byun and Kyungwon Kang and Seongjin Cho},
  journal= {arXiv preprint arXiv:2202.01764},
  year   = {2022}
}

Comments

11 pages, 3 figures, 6 tables

R2 v1 2026-06-24T09:18:32.557Z