中文
相关论文

相关论文: Text Normalization for Low-Resource Languages of A…

200 篇论文

Africa has over 2000 languages. Despite this, African languages account for a small portion of available resources and publications in Natural Language Processing (NLP). This is due to multiple factors, including: a lack of focus from…

Despite advancements in English-dominant generative large language models, further development is needed for low-resource languages to enhance global accessibility. The primary methods for representing these languages are monolingual and…

计算与语言 · 计算机科学 2024-05-14 Cagri Toraman

We present state-of-the-art results on morphosyntactic tagging across different varieties of Arabic using fine-tuned pre-trained transformer language models. Our models consistently outperform existing systems in Modern Standard Arabic and…

计算与语言 · 计算机科学 2022-03-22 Go Inoue , Salam Khalifa , Nizar Habash

This survey provides a comprehensive catalog of publicly available text and speech resources for two West African languages: Hausa, an Afroasiatic language with approximately 80-100 million speakers, and Fongbe, a Niger-Congo language…

计算与语言 · 计算机科学 2026-05-25 Mahounan Pericles Adjovi , Victor Olufemi , Roald Eiselen , Prasenjit Mitra

Based on an annotated multimedia corpus, television series Mar{\=a}y{\=a} 2013, we dig into the question of ''automatic standardization'' of Arabic dialects for machine translation. Here we distinguish between rule-based machine translation…

计算与语言 · 计算机科学 2023-01-10 Abidrabbo Alnassan

Several high-resource Text to Speech (TTS) systems currently produce natural, well-established human-like speech. In contrast, low-resource languages, including Arabic, have very limited TTS systems due to the lack of resources. We propose…

计算与语言 · 计算机科学 2023-01-27 Massa Baali , Tomoki Hayashi , Hamdy Mubarak , Soumi Maiti , Shinji Watanabe , Wassim El-Hajj , Ahmed Ali

The contrast between the need for large amounts of data for current Natural Language Processing (NLP) techniques, and the lack thereof, is accentuated in the case of African languages, most of which are considered low-resource. To help…

计算与语言 · 计算机科学 2020-04-22 Machel Reid , Edison Marrese-Taylor , Yutaka Matsuo

Large language models (LLMs) have received a lot of attention in natural language processing (NLP) research because of their exceptional performance in understanding and generating human languages. However, low-resource languages are left…

Real-world applications of natural language processing (NLP) are challenging. NLP models rely heavily on supervised machine learning and require large amounts of annotated data. These resources are often based on language data available in…

计算与语言 · 计算机科学 2020-11-10 Farhad Nooralahzadeh

We present the second ever evaluated Arabic dialect-to-dialect machine translation effort, and the first to leverage external resources beyond a small parallel corpus. The subject has not previously received serious attention due to lack of…

计算与语言 · 计算机科学 2017-12-19 Alexander Erdmann , Nizar Habash , Dima Taji , Houda Bouamor

ASR has achieved remarkable global progress, yet African low-resource languages remain rigorously underrepresented, producing barriers to digital inclusion across the continent with more than +2000 languages. This systematic literature…

It has been shown that the performance of neural machine translation (NMT) drops starkly in low-resource conditions, often requiring large amounts of auxiliary data to achieve competitive results. An effective method of generating auxiliary…

计算与语言 · 计算机科学 2021-04-06 Lidia Kidane , Sachin Kumar , Yulia Tsvetkov

Text normalization - the conversion of text from written to spoken form - is traditionally assumed to be an ill-formed task for language models. In this work, we argue otherwise. We empirically show the capacity of Large-Language Models…

Text classification is the task of assigning a document to a predefined class. However, it is expensive to acquire enough labeled documents or to label them. In this paper, we study the regularization methods' effects on various…

计算与语言 · 计算机科学 2024-03-05 Jongga Lee , Jaeseung Yim , Seohee Park , Changwon Lim

In this study, we develop Neural Machine Translation (NMT) and Transformer-based transfer learning models for English-to-Igbo translation - a low-resource African language spoken by over 40 million people across Nigeria and West Africa. Our…

计算与语言 · 计算机科学 2025-04-25 Ocheme Anthony Ekle , Biswarup Das

Neural language modeling (LM) has led to significant improvements in several applications, including Automatic Speech Recognition. However, they typically require large amounts of training data, which is not available for many domains and…

计算与语言 · 计算机科学 2019-06-05 Navid Rekabsaz , Nikolaos Pappas , James Henderson , Banriskhem K. Khonglah , Srikanth Madikeri

Machine-translated data is widely used in multilingual NLP, particularly when native text is scarce. However, translated text differs systematically from native text. This phenomenon is known as translationese, and it reflects both traces…

计算与语言 · 计算机科学 2026-02-19 Jenny Kunz

The advent of Large Language Models (LLMs) has significantly advanced the field of automated code generation. LLMs rely on large and diverse datasets to learn syntax, semantics, and usage patterns of programming languages. For low-resource…

软件工程 · 计算机科学 2025-02-03 Alessandro Giagnorio , Alberto Martin-Lopez , Gabriele Bavota

Natural Language Processing (NLP) is rapidly transforming research methodologies across disciplines, yet African languages remain largely underrepresented in this technological shift. This paper provides the first comprehensive overview of…

Computing and Internet access are substantially growing markets in Southern Africa, which brings with it increasing demands for local content and tools in indigenous African languages. Since most of those languages are low-resourced,…

计算与语言 · 计算机科学 2022-10-24 C. Maria Keet