English
Related papers

Related papers: Where Are We? Evaluating LLM Performance on Africa…

200 papers

Employers increasingly expect graduates to utilize large language models (LLMs) in the workplace, yet the competencies needed for computing roles across Africa remain unclear given varying national contexts. This study examined how six…

Computers and Society · Computer Science 2026-02-02 Precious Eze , Stephanie Lunn , Bruk Berhane

Large Language Models (LLMs) have significantly advanced natural language processing applications, yet their widespread use raises concerns regarding inherent biases that may reduce utility or harm for particular social groups. Despite the…

Computers and Society · Computer Science 2025-02-05 Bo Pang , Tingrui Qiao , Caroline Walker , Chris Cunningham , Yun Sing Koh

Speech technologies are transforming interactions across various sectors, from healthcare to call centers and robots, yet their performance on African-accented conversations remains underexplored. We introduce Afrispeech-Dialog, a benchmark…

Large Language Models (LLMs), like ChatGPT, are fundamentally tools trained on vast data, reflecting diverse societal impressions. This paper aims to investigate LLMs' self-perceived bias concerning indigeneity when simulating scenarios of…

Artificial Intelligence · Computer Science 2023-10-16 Cecilia Delgado Solorzano , Carlos Toxtli Hernandez

Africa has over 2000 languages. Despite this, African languages account for a small portion of available resources and publications in Natural Language Processing (NLP). This is due to multiple factors, including: a lack of focus from…

Developing Information Retrieval (IR) tools and techniques in African languages suffers from the dual problems of a lack of algorithms and very small test data collections. This affects the creation of practical IR systems and limits the…

Information Retrieval · Computer Science 2018-06-14 Hussein Suleman

Despite the widespread availability of LLMs, there remains a substantial gap in their capabilities and availability across diverse languages. One approach to address these issues has been to take an existing pre-trained LLM and continue to…

Computation and Language · Computer Science 2024-07-19 Zoltan Csaki , Bo Li , Jonathan Li , Qiantong Xu , Pian Pawakapan , Leon Zhang , Yun Du , Hengyu Zhao , Changran Hu , Urmish Thakker

Machine learning techniques have conquered many different tasks in speech and natural language processing, such as speech recognition, information extraction, text and speech generation, and human machine interaction using natural language…

Computation and Language · Computer Science 2025-03-18 Sebastian Möller , Pia Knoeferle , Britta Schulte , Nils Feldhus

Large language models (LLMs) are gaining increasing popularity in both academia and industry, owing to their unprecedented performance in various applications. As LLMs continue to play a vital role in both research and daily use, their…

Computation and Language · Computer Science 2024-01-01 Yupeng Chang , Xu Wang , Jindong Wang , Yuan Wu , Linyi Yang , Kaijie Zhu , Hao Chen , Xiaoyuan Yi , Cunxiang Wang , Yidong Wang , Wei Ye , Yue Zhang , Yi Chang , Philip S. Yu , Qiang Yang , Xing Xie

Arabic remains one of the most underrepresented languages in natural language processing research, particularly in medical applications, due to the limited availability of open-source data and benchmarks. The lack of resources hinders…

Computation and Language · Computer Science 2026-02-03 Mouath Abu-Daoud , Leen Kharouf , Omar El Hajj , Dana El Samad , Mariam Al-Omari , Jihad Mallat , Khaled Saleh , Nizar Habash , Farah E. Shamout

There are more than 2000 living languages in Africa, most of which have been bypassed by advances in language technology. Current leading LLMs exhibit strong performance on a number of the most common languages (e.g. Swahili or Yoruba), but…

Large Language Models (LLMs) have demonstrated significant effectiveness across various NLP tasks, including text ranking. This study assesses the performance of large language models (LLMs) in listwise reranking for limited-resource…

Computation and Language · Computer Science 2025-01-16 Yanxin Shen , Lun Wang , Chuanqi Shi , Shaoshuai Du , Yiyi Tao , Yixian Shen , Hang Zhang

Several widely used software applications involve some form of processing of natural language, with tasks ranging from digitising hardcopies and text processing to speech generation. Varied language resources are used to develop software…

Computation and Language · Computer Science 2026-01-21 C. Maria Keet , Langa Khumalo

Large Language Models have garnered significant attention for their capabilities in multilingual natural language processing, while studies on risks associated with cross biases are limited to immediate context preferences. Cross-language…

Computation and Language · Computer Science 2025-08-07 Qianying Liu , Katrina Qiyao Wang , Fei Cheng , Sadao Kurohashi

Multilingual pre-trained language models (PLMs) have demonstrated impressive performance on several downstream tasks for both high-resourced and low-resourced languages. However, there is still a large performance drop for languages unseen…

Computation and Language · Computer Science 2022-10-19 Jesujoba O. Alabi , David Ifeoluwa Adelani , Marius Mosbach , Dietrich Klakow

While multilingual language models (MLMs) have been trained on 100+ languages, they are typically only evaluated across a handful of them due to a lack of available test data in most languages. This is particularly problematic when…

Computation and Language · Computer Science 2024-06-21 Rochelle Choenni , Sara Rajaee , Christof Monz , Ekaterina Shutova

This paper is devoted to the development of a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models. Significant concerns…

Advances in speech and language technologies enable tools such as voice-search, text-to-speech, speech recognition and machine translation. These are however only available for high resource languages like English, French or Chinese.…

The intricate relationship between language and culture has long been a subject of exploration within the realm of linguistic anthropology. Large Language Models (LLMs), promoted as repositories of collective human knowledge, raise a…

Computation and Language · Computer Science 2024-07-09 Badr AlKhamissi , Muhammad ElNokrashy , Mai AlKhamissi , Mona Diab

Recent advances in speech-enabled AI, including Google's NotebookLM and OpenAI's speech-to-speech API, are driving widespread interest in voice interfaces globally. Despite this momentum, there exists no publicly available…

Computation and Language · Computer Science 2025-11-19 Gabrial Zencha Ashungafac , Mardhiyah Sanni , Busayo Awobade , Alex Gichamba , Tobi Olatunji