中文
相关论文

相关论文: Low resource language dataset creation, curation a…

200 篇论文

The recent advances in Natural Language Processing have been a boon for well-represented languages in terms of available curated data and research resources. One of the challenges for low-resourced languages is clear guidelines on the…

Deep neural networks and huge language models are becoming omnipresent in natural language applications. As they are known for requiring large amounts of training data, there is a growing body of work to improve the performance in…

计算与语言 · 计算机科学 2021-04-12 Michael A. Hedderich , Lukas Lange , Heike Adel , Jannik Strötgen , Dietrich Klakow

Natural language processing (NLP) has made significant progress for well-resourced languages such as English but lagged behind for low-resource languages like Setswana. This paper addresses this gap by presenting PuoBERTa, a customised…

计算与语言 · 计算机科学 2023-10-25 Vukosi Marivate , Moseli Mots'Oehli , Valencia Wagner , Richard Lastrucci , Isheanesu Dzingirai

Local/Native South African languages are classified as low-resource languages. As such, it is essential to build the resources for these languages so that they can benefit from advances in the field of natural language processing. In this…

计算与语言 · 计算机科学 2023-06-14 Andani Madodonga , Vukosi Marivate , Matthew Adendorff

Recent progress in text classification has been focused on high-resource languages such as English and Chinese. For low-resource languages, amongst them most African languages, the lack of well-annotated data and effective preprocessing, is…

计算与语言 · 计算机科学 2020-10-26 Rubungo Andre Niyongabo , Hong Qu , Julia Kreutzer , Li Huang

A current problem in NLP is massaging and processing low-resource languages which lack useful training attributes such as supervised data, number of native speakers or experts, etc. This review paper concisely summarizes previous…

计算与语言 · 计算机科学 2020-06-15 Alexandre Magueresse , Vincent Carles , Evan Heetderks

Languages are classified as low-resource when they lack the quantity of data necessary for training statistical and machine learning tools and models. Causes of resource scarcity vary but can include poor access to technology for developing…

计算与语言 · 计算机科学 2022-04-13 Zoey Liu , Crystal Richardson , Richard Hatcher , Emily Prud'hommeaux

In this position paper, we describe our perspective on how meaningful resources for lower-resourced languages should be developed in connection with the speakers of those languages. We first examine two massively multilingual resources in…

计算与语言 · 计算机科学 2022-02-25 Constantine Lignos , Nolan Holley , Chester Palen-Michel , Jonne Sälevä

In this work we investigate the impact of applying textual data augmentation tasks to low resource machine translation. There has been recent interest in investigating approaches for training systems for languages with limited resources and…

计算与语言 · 计算机科学 2023-06-14 Catherine Gitau , VUkosi Marivate

Recent language generative models are mostly trained on large-scale datasets, while in some real scenarios, the training datasets are often expensive to obtain and would be small-scale. In this paper we investigate the challenging task of…

计算与语言 · 计算机科学 2022-10-11 Zhuoxuan Jiang , Lingfeng Qiao , Di Yin , Shanshan Feng , Bo Ren

Due to the scarcity of data in low-resourced languages, the development of language models for these languages has been very slow. Currently, pre-trained language models have gained popularity in natural language processing, especially, in…

计算与语言 · 计算机科学 2025-01-28 Simon P. Ramalepe , Thipe I. Modipa , Marelie H. Davel

In this paper, we address the data scarcity problem in automatic data-driven glossing for low-resource languages by coordinating multiple sources of linguistic expertise. We supplement models with translations at both the token and sentence…

计算与语言 · 计算机科学 2024-06-18 Changbing Yang , Garrett Nicolai , Miikka Silfverberg

Parallel datasets are vital for performing and evaluating any kind of multilingual task. However, in the cases where one of the considered language pairs is a low-resource language, the existing top-down parallel data such as corpora are…

计算与语言 · 计算机科学 2023-09-26 Kasun Wickramasinghe , Nisansa de Silva

News headline generation is a crucial task in increasing productivity for both the readers and producers of news. This task can easily be aided by automated News headline-generation models. However, the presence of irrelevant headlines in…

计算与语言 · 计算机科学 2024-04-18 Gopichand Kanumolu , Lokesh Madasu , Nirmal Surange , Manish Shrivastava

Real-world applications of natural language processing (NLP) are challenging. NLP models rely heavily on supervised machine learning and require large amounts of annotated data. These resources are often based on language data available in…

计算与语言 · 计算机科学 2020-11-10 Farhad Nooralahzadeh

The state of art natural language processing systems relies on sizable training datasets to achieve high performance. Lack of such datasets in the specialized low resource domains lead to suboptimal performance. In this work, we adapt…

计算与语言 · 计算机科学 2021-08-27 Usama Yaseen , Stefan Langer

Parsers are available for only a handful of the world's languages, since they require lots of training data. How far can we get with just a small amount of training data? We systematically compare a set of simple strategies for improving…

计算与语言 · 计算机科学 2019-09-09 Clara Vania , Yova Kementchedjhieva , Anders Søgaard , Adam Lopez

This paper introduces the L-ReLF (Low-Resource Lexical Framework), a novel, reproducible methodology for creating high-quality, structured lexical datasets for underserved languages. The lack of standardized terminology, exemplified by…

计算与语言 · 计算机科学 2026-04-01 Anass Sedrati , Mounir Afifi , Reda Benkhadra

Since their inception, embeddings have become a primary ingredient in many flavours of Natural Language Processing (NLP) tasks supplanting earlier types of representation. Even though multilingual embeddings have been used for the…

计算与语言 · 计算机科学 2024-02-09 Kasun Wickramasinghe , Nisansa de Silva

Democratizing access to natural language processing (NLP) technology is crucial, especially for underrepresented and extremely low-resource languages. Previous research has focused on developing labeled and unlabeled corpora for these…

‹ 上一页 1 2 3 10 下一页 ›