中文
相关论文

相关论文: Text Normalization for Low-Resource Languages of A…

200 篇论文

While transformer-based finetuning techniques have proven effective in tasks that involve low-resource, low-data environments, a lack of properly established baselines and benchmark datasets make it hard to compare different approaches that…

计算与语言 · 计算机科学 2020-05-06 Jan Christian Blaise Cruz , Charibeth Cheng

Training LLMs for low-resource languages usually utilizes data augmentation from English using machine translation (MT). This, however, brings a number of challenges to LLM training: there are large costs attached to translating and…

计算与语言 · 计算机科学 2024-08-08 Sabri Boughorbel , MD Rizwan Parvez , Majd Hawasly

Natural Language Processing is a crucial frontier in artificial intelligence, with broad applications in many areas, including public health, agriculture, education, and commerce. However, due to the lack of substantial linguistic…

计算与语言 · 计算机科学 2025-01-22 Audrey Mbogho , Quin Awuor , Andrew Kipkebut , Lilian Wanzare , Vivian Oloo

Many multilingual communities, including numerous in Africa, frequently engage in code-switching during conversations. This behaviour stresses the need for natural language processing technologies adept at processing code-switched text.…

计算与语言 · 计算机科学 2024-04-29 Michelle Terblanche , Kayode Olaleye , Vukosi Marivate

African languages are severely under-represented in NLP research due to lack of datasets covering several NLP tasks. While there are individual language specific datasets that are being expanded to different tasks, only a handful of NLP…

Faced with a considerable lack of resources in African languages to carry out work in Natural Language Processing (NLP), Natural Language Understanding (NLU) and artificial intelligence, the research teams of NTeALan association has set…

计算与语言 · 计算机科学 2021-04-01 Elvis Mboning Tchiaze

Low-resource languages such as Filipino suffer from data scarcity which makes it challenging to develop NLP applications for Filipino language. The use of Transfer Learning (TL) techniques alleviates this problem in low-resource setting. In…

计算与语言 · 计算机科学 2020-10-15 Dan John Velasco

In this paper, we explore the utility of translationese as synthetic data created using machine translation for pre-training language models (LMs) for low-resource languages (LRLs). Our simple methodology consists of translating large…

计算与语言 · 计算机科学 2025-07-08 Meet Doshi , Raj Dabre , Pushpak Bhattacharyya

Resources in high-resource languages have not been efficiently exploited in low-resource languages to solve language-dependent research problems. Spanish and French are considered high resource languages in which an adequate level of data…

计算与语言 · 计算机科学 2023-12-13 Fatimah Alzamzami , Abdulmotaleb El Saddik

If today some African languages like Swahili have enough resources to develop high-performing Natural Language Processing (NLP) systems, many other languages spoken on the continent are still lacking such support. For these languages, still…

计算与语言 · 计算机科学 2024-12-19 Naira Abdou Mohamed , Zakarya Erraji , Abdessalam Bahafid , Imade Benelallam

The performance of NLP methods for severely under-resourced languages cannot currently hope to match the state of the art in NLP methods for well resourced languages. We explore the extent to which pretrained large language models (LLMs)…

计算与语言 · 计算机科学 2024-02-20 Michela Lorandi , Anya Belz

Most social media users come from the Global South, where harmful content usually appears in local languages. Yet, AI-driven moderation systems struggle with low-resource languages spoken in these regions. Through semi-structured interviews…

计算与语言 · 计算机科学 2025-08-06 Farhana Shahid , Mona Elswah , Aditya Vashistha

Millions of people around the world can not access content on the Web because most of the content is not readily available in their language. Machine translation (MT) systems have the potential to change this for many languages. Current MT…

计算与语言 · 计算机科学 2021-12-16 Asmelash Teka Hadgu , Abel Aregawi , Adam Beaudoin

Machine translation (MT) is one of the main tasks in natural language processing whose objective is to translate texts automatically from one natural language to another. Nowadays, using deep neural networks for MT tasks has received great…

Natural Language Interfaces and tools such as spellcheckers and Web search in one's own language are known to be useful in ICT-mediated communication. Most languages in Southern Africa are under-resourced, however. Therefore, it would be…

计算与语言 · 计算机科学 2016-08-11 C. Maria Keet

Recent advancements in Natural Language Processing (NLP) has led to the proliferation of large pretrained language models. These models have been shown to yield good performance, using in-context learning, even on unseen tasks and…

计算与语言 · 计算机科学 2023-05-12 Jessica Ojo , Kelechi Ogueji

Social media offer an abundant source of valuable raw data, however informal writing can quickly become a bottleneck for many natural language processing (NLP) tasks. Off-the-shelf tools are usually trained on formal text and cannot…

计算与语言 · 计算机科学 2019-04-15 Ismini Lourentzou , Kabir Manghnani , ChengXiang Zhai

Large Language Models (LLMs) have demonstrated significant effectiveness across various NLP tasks, including text ranking. This study assesses the performance of large language models (LLMs) in listwise reranking for limited-resource…

计算与语言 · 计算机科学 2025-01-16 Yanxin Shen , Lun Wang , Chuanqi Shi , Shaoshuai Du , Yiyi Tao , Yixian Shen , Hang Zhang

The progress of Natural Language Processing (NLP), although fast in recent years, is not at the same pace for all languages. African languages in particular are still behind and lack automatic processing tools. Some of these tools are very…

计算与语言 · 计算机科学 2023-05-16 Derguene Mbaye , Moussa Diallo

We participated in the WMT 2022 Large-Scale Machine Translation Evaluation for the African Languages Shared Task. This work describes our approach, which is based on filtering the given noisy data using a sentence-pair classifier that was…