MasakhaNER:面向非洲语言的命名实体识别
计算与语言
2021-07-06 v2 人工智能
摘要
我们通过创建首个公开可用的大规模高质量、涵盖十种非洲语言的命名实体识别(NER)数据集,汇聚多方利益相关者,朝着解决非洲大陆在 NLP 研究中代表性不足的问题迈出一步。我们详述这些语言的特征,以帮助研究人员理解这些语言给 NER 带来的挑战。我们分析我们的数据集,并在监督学习和迁移学习两种设定下对最先进的方法进行广泛的实证评估。我们发布数据、代码和模型,以启发未来关于非洲 NLP 的研究。
引用
@article{arxiv.2103.11811,
title = {MasakhaNER: Named Entity Recognition for African Languages},
author = {David Ifeoluwa Adelani and Jade Abbott and Graham Neubig and Daniel D'souza and Julia Kreutzer and Constantine Lignos and Chester Palen-Michel and Happy Buzaaba and Shruti Rijhwani and Sebastian Ruder and Stephen Mayhew and Israel Abebe Azime and Shamsuddeen Muhammad and Chris Chinenye Emezue and Joyce Nakatumba-Nabende and Perez Ogayo and Anuoluwapo Aremu and Catherine Gitau and Derguene Mbaye and Jesujoba Alabi and Seid Muhie Yimam and Tajuddeen Gwadabe and Ignatius Ezeani and Rubungo Andre Niyongabo and Jonathan Mukiibi and Verrah Otiende and Iroro Orife and Davis David and Samba Ngom and Tosin Adewumi and Paul Rayson and Mofetoluwa Adeyemi and Gerald Muriuki and Emmanuel Anebi and Chiamaka Chukwuneke and Nkiruka Odu and Eric Peter Wairagala and Samuel Oyerinde and Clemencia Siro and Tobius Saul Bateesa and Temilola Oloyede and Yvonne Wambui and Victor Akinode and Deborah Nabagereka and Maurice Katusiime and Ayodele Awokoya and Mouhamadane MBOUP and Dibora Gebreyohannes and Henok Tilaye and Kelechi Nwaike and Degaga Wolde and Abdoulaye Faye and Blessing Sibanda and Orevaoghene Ahia and Bonaventure F. P. Dossou and Kelechi Ogueji and Thierno Ibrahima DIOP and Abdoulaye Diallo and Adewale Akinfaderin and Tendai Marengereke and Salomey Osei},
journal= {arXiv preprint arXiv:2103.11811},
year = {2021}
}
备注
Accepted to TACL 2021, pre-MIT Press publication version