English
Related papers

Related papers: Low resource language dataset creation, curation a…

200 papers

One of the major challenges that under-represented and endangered language communities face in language technology is the lack or paucity of language data. This is also the case of the Southern varieties of the Kurdish and Laki languages…

Computation and Language · Computer Science 2023-04-05 Sina Ahmadi , Zahra Azin , Sara Belelli , Antonios Anastasopoulos

While transformer-based finetuning techniques have proven effective in tasks that involve low-resource, low-data environments, a lack of properly established baselines and benchmark datasets make it hard to compare different approaches that…

Computation and Language · Computer Science 2020-05-06 Jan Christian Blaise Cruz , Charibeth Cheng

Transformers represent the state-of-the-art in Natural Language Processing (NLP) in recent years, proving effective even in tasks done in low-resource languages. While pretrained transformers for these languages can be made, it is…

Computation and Language · Computer Science 2021-08-16 Jan Christian Blaise Cruz , Jose Kristian Resabal , James Lin , Dan John Velasco , Charibeth Cheng

In recent years, sentiment analysis has gained significant importance in natural language processing. However, most existing models and datasets for sentiment analysis are developed for high-resource languages, such as English and Chinese,…

Computation and Language · Computer Science 2023-09-19 Daniil Homskiy , Narek Maloyan

A large number of annotated training images is crucial for training successful scene text recognition models. However, collecting sufficient datasets can be a labor-intensive and costly process, particularly for low-resource languages. To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Yangchen Xie , Xinyuan Chen , Hongjian Zhan , Palaiahankote Shivakum , Bing Yin , Cong Liu , Yue Lu

The quality of a Neural Machine Translation system depends substantially on the availability of sizable parallel corpora. For low-resource language pairs this is not the case, resulting in poor translation quality. Inspired by work in…

Computation and Language · Computer Science 2018-02-14 Marzieh Fadaee , Arianna Bisazza , Christof Monz

We introduce a novel setup for low-resource task-oriented semantic parsing which incorporates several constraints that may arise in real-world scenarios: (1) lack of similar datasets/models from a related domain, (2) inability to sample…

Computation and Language · Computer Science 2022-05-19 Kevin Yang , Olivia Deng , Charles Chen , Richard Shin , Subhro Roy , Benjamin Van Durme

Named Entity Recognition(NER) for low-resource languages aims to produce robust systems for languages where there is limited labeled training data available, and has been an area of increasing interest within NLP. Data augmentation for…

Computation and Language · Computer Science 2026-02-16 Gaurav Kamath , Sowmya Vajjala

African languages are severely under-represented in NLP research due to lack of datasets covering several NLP tasks. While there are individual language specific datasets that are being expanded to different tasks, only a handful of NLP…

The field of cross-lingual sentence embeddings has recently experienced significant advancements, but research concerning low-resource languages has lagged due to the scarcity of parallel corpora. This paper shows that cross-lingual word…

Computation and Language · Computer Science 2024-04-04 Zhongtao Miao , Qiyu Wu , Kaiyan Zhao , Zilong Wu , Yoshimasa Tsuruoka

Generative language modelling has surged in popularity with the emergence of services such as ChatGPT and Google Gemini. While these models have demonstrated transformative potential in productivity and communication, they overwhelmingly…

Computation and Language · Computer Science 2025-07-09 Josh McGiff , Nikola S. Nikolov

Multilingual sentence representations pose a great advantage for low-resource languages that do not have enough data to build monolingual models on their own. These multilingual sentence representations have been separately exploited by few…

Computation and Language · Computer Science 2021-06-15 Dilan Sachintha , Lakmali Piyarathna , Charith Rajitha , Surangika Ranathunga

Obtaining sufficient information in one's mother tongue is crucial for satisfying the information needs of the users. While high-resource languages have abundant online resources, the situation is less than ideal for very low-resource…

Computation and Language · Computer Science 2024-05-03 Abhinaba Bala , Ashok Urlana , Rahul Mishra , Parameswari Krishnamurthy

Most state-of-the-art speech systems are using Deep Neural Networks (DNNs). Those systems require a large amount of data to be learned. Hence, learning state-of-the-art frameworks on under-resourced speech languages/problems is a difficult…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-10 Vincent Roger , Jérôme Farinas , Julien Pinquier

Natural language serves as a common and straightforward signal for humans to interact seamlessly with machines. Recognizing the importance of this interface, the machine learning community is investing considerable effort in generating data…

Computation and Language · Computer Science 2025-01-03 Shiyu Wang , Yihao Feng , Tian Lan , Ning Yu , Yu Bai , Ran Xu , Huan Wang , Caiming Xiong , Silvio Savarese

Low-resource languages (LRLs) often lack high-quality, large-scale datasets for training effective text embedding models, hindering their application in tasks like retrieval-augmented generation (RAG) and semantic search. In this work, we…

Computation and Language · Computer Science 2026-03-25 Zaruhi Navasardyan , Spartak Bughdaryan , Bagrat Minasyan , Hrant Davtyan

Recent studies show that large language models (LLMs) are powerful tools for working with natural language, bringing advances in many areas of computational linguistics. However, these models face challenges when applied to low-resource…

Computation and Language · Computer Science 2024-12-09 Zhaojun Ding , Zhengliang Liu , Hanqi Jiang , Yizhu Gao , Xiaoming Zhai , Tianming Liu , Ninghao Liu

Despite being the seventh most widely spoken language in the world, Bengali has received much less attention in machine translation literature due to being low in resources. Most publicly available parallel corpora for Bengali are not large…

Computation and Language · Computer Science 2020-10-08 Tahmid Hasan , Abhik Bhattacharjee , Kazi Samin , Masum Hasan , Madhusudan Basak , M. Sohel Rahman , Rifat Shahriyar

Sentence-level embedding is essential for various tasks that require understanding natural language. Many studies have explored such embeddings for high-resource languages like English. However, low-resource languages like Bengali (a…

Computation and Language · Computer Science 2024-11-26 Muhammad Rafsan Kabir , Md. Mohibur Rahman Nabil , Mohammad Ashrafuzzaman Khan

Data availability and quality are major challenges in natural language processing for low-resourced languages. In particular, there is significantly less data available than for higher-resourced languages. This data is also often of low…

Computation and Language · Computer Science 2023-11-28 Manuel Fokam , Michael Beukman