English

A Common Evaluation Setting for Just.Ask, Open Ephyra and Aranea QA systems

Information Retrieval 2012-05-09 v1

Abstract

Question Answering (QA) is not a new research field in Natural Language Processing (NLP). However in recent years, QA has been a subject of growing study. Nowadays, most of the QA systems have a similar pipelined architecture and each system use a set of unique techniques to accomplish its state of the art results. However, many things are not clear in the QA processing. It is not clear the extend of the impact of tasks performed in earlier stages in following stages of the pipelining process. It is not clear, if techniques used in a QA system can be used in another QA system to improve its results. And finally, it is not clear in what setting should be these systems tested in order to properly analyze their results.

Keywords

Cite

@article{arxiv.1205.1779,
  title  = {A Common Evaluation Setting for Just.Ask, Open Ephyra and Aranea QA systems},
  author = {Ricardo Pires},
  journal= {arXiv preprint arXiv:1205.1779},
  year   = {2012}
}

Comments

Technical Report elaborated by Ricardo Pires for the course Natural Language Processing Systems

R2 v1 2026-06-21T21:00:23.251Z