English

NaijaRC: A Multi-choice Reading Comprehension Dataset for Nigerian Languages

Computation and Language 2024-05-21 v3
Authors: Anuoluwapo Aremu , Jesujoba O. Alabi , Daud Abolade , Nkechinyere F. Aguobi , Shamsuddeen Hassan Muhammad , David Ifeoluwa Adelani
View on arXiv ↗ PDF ↗

Abstract

In this paper, we create NaijaRC: a new multi-choice Reading Comprehension dataset for three native Nigeria languages that is based on high-school reading comprehension examination. We provide baseline results by performing cross-lingual transfer using existing English RACE and Belebele training dataset based on a pre-trained encoder-only model. Additionally, we provide results by prompting large language models (LLMs) like GPT-4.

Keywords

reading comprehension nigerian languages multilingual transfer dataset large language models cross-lingual evaluation

Cite

@article{arxiv.2308.09768,
  title  = {NaijaRC: A Multi-choice Reading Comprehension Dataset for Nigerian Languages},
  author = {Anuoluwapo Aremu and Jesujoba O. Alabi and Daud Abolade and Nkechinyere F. Aguobi and Shamsuddeen Hassan Muhammad and David Ifeoluwa Adelani},
  journal= {arXiv preprint arXiv:2308.09768},
  year   = {2024}
}

Comments

Accepted to AfricaNLP Workshop at ICLR 2024 (non-archival)

Related papers

View all related →
Computation and Language · Computer Science
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants
Lucas Bandarkar, Davis Liang, Benjamin Muller, Mikel Artetxe +6
2024-10-03
Computation and Language · Computer Science
NaijaNER : Comprehensive Named Entity Recognition for 5 Nigerian Languages
Wuraola Fisayo Oyewusi, Olubayo Adekanmbi, Ifeoma Okoh, Vitus Onuigwe +4
2021-05-04
Computation and Language · Computer Science
Cross-Lingual Machine Reading Comprehension
Yiming Cui, Wanxiang Che, Ting Liu, Bing Qin +2
2019-11-05
Sound · Computer Science
NaijaS2ST: A Multi-Accent Benchmark for Speech-to-Speech Translation in Low-Resource Nigerian Languages
Marie Maltais, Yejin Jeon, Min Ma, Shamsuddeen Hassan Muhammad +6
2026-04-20
Computation and Language · Computer Science
Beyond English-Only Reading Comprehension: Experiments in Zero-Shot Multilingual Transfer for Bulgarian
Momchil Hardalov, Ivan Koychev, Preslav Nakov
2019-09-09
Computation and Language · Computer Science
Low-Resource Cross-Lingual Adaptive Training for Nigerian Pidgin
Pin-Jie Lin, Muhammed Saeed, Ernie Chang, Merel Scholman
2023-07-04
Computation and Language · Computer Science
Implicit Discourse Relation Classification For Nigerian Pidgin
Muhammed Saeed, Peter Bourgonje, Vera Demberg
2024-11-05
Computation and Language · Computer Science
Improving Machine Reading Comprehension with Single-choice Decision and Transfer Learning
Yufan Jiang, Shuangzhi Wu, Jing Gong, Yahui Cheng +4
2020-11-18
Computation and Language · Computer Science
Multilingual Extractive Reading Comprehension by Runtime Machine Translation
Akari Asai, Akiko Eriguchi, Kazuma Hashimoto, Yoshimasa Tsuruoka
2018-11-06
Computation and Language · Computer Science
A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasets
Changchang Zeng, Shaobo Li, Qin Li, Jie Hu +1
2020-10-22
Computation and Language · Computer Science
Dataset for the First Evaluation on Chinese Machine Reading Comprehension
Yiming Cui, Ting Liu, Zhipeng Chen, Wentao Ma +2
2018-03-16
Computation and Language · Computer Science
The NaijaVoices Dataset: Cultivating Large-Scale, High-Quality, Culturally-Rich Speech Data for African Languages
Chris Emezue, NaijaVoices Community, Busayo Awobade, Abraham Owodunni +7
2025-07-15
Computation and Language · Computer Science
Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasets
Saku Sugawara, Pontus Stenetorp, Kentaro Inui, Akiko Aizawa
2019-11-22
Computation and Language · Computer Science
NaijaNLP: A Survey of Nigerian Low-Resource Languages
Isa Inuwa-Dutse
2025-03-10
Computation and Language · Computer Science
Ibom NLP: A Step Toward Inclusive Natural Language Processing for Nigeria's Minority Languages
Oluwadara Kalejaiye, Luel Hagos Beyene, David Ifeoluwa Adelani, Mmekut-Mfon Gabriel Edet +3
2025-11-11
Computation and Language · Computer Science
Cross-lingual Machine Reading Comprehension with Language Branch Knowledge Distillation
Junhao Liu, Linjun Shou, Jian Pei, Ming Gong +2
2020-10-28
Computation and Language · Computer Science
EMBRACE: Evaluation and Modifications for Boosting RACE
Mariia Zyrianova, Dmytro Kalpakchi, Johan Boye
2023-05-16
Computation and Language · Computer Science
RACE: Large-scale ReAding Comprehension Dataset From Examinations
Guokun Lai, Qizhe Xie, Hanxiao Liu, Yiming Yang +1
2017-12-07
Computation and Language · Computer Science
Learning Nigerian accent embeddings from speech: preliminary results based on SautiDB-Naija corpus
Tejumade Afonja, Oladimeji Mudele, Iroro Orife, Kenechi Dukor +5
2021-12-14
Computation and Language · Computer Science
MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension
Alon Talmor, Jonathan Berant
2019-06-03
Computation and Language · Computer Science
MRCEval: A Comprehensive, Challenging and Accessible Machine Reading Comprehension Benchmark
Shengkun Ma, Hao Peng, Lei Hou, Juanzi Li
2025-03-11
Computation and Language · Computer Science
Improving Machine Reading Comprehension with General Reading Strategies
Kai Sun, Dian Yu, Dong Yu, Claire Cardie
2019-03-26
Computation and Language · Computer Science
A Vietnamese Dataset for Text Segmentation and Multiple Choices Reading Comprehension
Toan Nguyen Hai, Ha Nguyen Viet, Truong Quan Xuan, Duc Do Minh
2025-06-23
Computation and Language · Computer Science
Multi-Passage Machine Reading Comprehension with Cross-Passage Answer Verification
Yizhong Wang, Kai Liu, Jing Liu, Wei He +4
2018-05-11
Computation and Language · Computer Science
NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis
Shamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, Ibrahim Said Ahmad +8
2022-06-22