AfriQA：面向非洲语言的跨语言开放检索问答
计算与语言
2023-08-23 v1 人工智能
信息检索
摘要
非洲语言在数字形式下的母语内容远少得多，这使得问答系统难以满足用户的信息需求。跨语言开放检索问答（XOR QA）系统——即以用户母语为其服务、从其他语言中检索答案内容的系统——提供了一种弥补这一缺口的途径。为此，我们创建了 AfriQA，这是首个以非洲语言为重点的跨语言问答数据集。AfriQA 包含跨越 10 种非洲语言的 12,000 多个 XOR QA 示例。先前的数据集主要关注那些跨语言 QA 可补充目标语言覆盖度的语言，而 AfriQA 聚焦于跨语言答案内容是唯一高覆盖度答案来源的语言。因此，我们认为非洲语言是 XOR QA 最重要且最现实的应用场景之一。我们的实验表明，自动翻译与多语言检索方法表现不佳。总体而言，AfriQA 对最先进的 QA 模型而言颇具挑战性。我们希望该数据集能推动更公平的问答技术的发展。
引用
@article{arxiv.2305.06897,
title = {AfriQA: Cross-lingual Open-Retrieval Question Answering for African Languages},
author = {Odunayo Ogundepo and Tajuddeen R. Gwadabe and Clara E. Rivera and Jonathan H. Clark and Sebastian Ruder and David Ifeoluwa Adelani and Bonaventure F. P. Dossou and Abdou Aziz DIOP and Claytone Sikasote and Gilles Hacheme and Happy Buzaaba and Ignatius Ezeani and Rooweither Mabuya and Salomey Osei and Chris Emezue and Albert Njoroge Kahira and Shamsuddeen H. Muhammad and Akintunde Oladipo and Abraham Toluwase Owodunni and Atnafu Lambebo Tonja and Iyanuoluwa Shode and Akari Asai and Tunde Oluwaseyi Ajayi and Clemencia Siro and Steven Arthur and Mofetoluwa Adeyemi and Orevaoghene Ahia and Anuoluwapo Aremu and Oyinkansola Awosan and Chiamaka Chukwuneke and Bernard Opoku and Awokoya Ayodele and Verrah Otiende and Christine Mwase and Boyd Sinkala and Andre Niyongabo Rubungo and Daniel A. Ajisafe and Emeka Felix Onwuegbuzia and Habib Mbow and Emile Niyomutabazi and Eunice Mukonde and Falalu Ibrahim Lawan and Ibrahim Said Ahmad and Jesujoba O. Alabi and Martin Namukombo and Mbonu Chinedu and Mofya Phiri and Neo Putini and Ndumiso Mngoma and Priscilla A. Amuok and Ruqayya Nasir Iro and Sonia Adhiambo},
journal= {arXiv preprint arXiv:2305.06897},
year = {2023}
}