MasakhaPOS:面向类型学多样非洲语言的词性标注
计算与语言
2023-05-24 v1
摘要
在本文中,我们提出 MasakhaPOS,这是面向 20 种类型学多样非洲语言的最大规模词性 (POS) 数据集。我们讨论了使用 UD(通用依存,universal dependencies)标注指南为这些语言标注词性时所面临的挑战。我们使用条件随机场和若干多语言预训练语言模型进行了广泛的词性基线实验。我们应用了利用 UD 中可用数据训练的各种跨语言迁移模型。在 MasakhaPOS 数据集上评估表明,在单源与多源设置下选择最优迁移语言可大幅提升目标语言的词性标注性能,尤其当与跨语言参数高效微调方法结合时。关键在于,从在语言族系和形态句法属性上匹配的语言迁移知识,对于未见语言的词性标注似乎更为有效。
引用
@article{arxiv.2305.13989,
title = {MasakhaPOS: Part-of-Speech Tagging for Typologically Diverse African Languages},
author = {Cheikh M. Bamba Dione and David Adelani and Peter Nabende and Jesujoba Alabi and Thapelo Sindane and Happy Buzaaba and Shamsuddeen Hassan Muhammad and Chris Chinenye Emezue and Perez Ogayo and Anuoluwapo Aremu and Catherine Gitau and Derguene Mbaye and Jonathan Mukiibi and Blessing Sibanda and Bonaventure F. P. Dossou and Andiswa Bukula and Rooweither Mabuya and Allahsera Auguste Tapo and Edwin Munkoh-Buabeng and victoire Memdjokam Koagne and Fatoumata Ouoba Kabore and Amelia Taylor and Godson Kalipe and Tebogo Macucwa and Vukosi Marivate and Tajuddeen Gwadabe and Mboning Tchiaze Elvis and Ikechukwu Onyenwe and Gratien Atindogbe and Tolulope Adelani and Idris Akinade and Olanrewaju Samuel and Marien Nahimana and Théogène Musabeyezu and Emile Niyomutabazi and Ester Chimhenga and Kudzai Gotosa and Patrick Mizha and Apelete Agbolo and Seydou Traore and Chinedu Uchechukwu and Aliyu Yusuf and Muhammad Abdullahi and Dietrich Klakow},
journal= {arXiv preprint arXiv:2305.13989},
year = {2023}
}
备注
Accepted to ACL 2023 (Main conference)