English
Related papers

Related papers: Low resource language dataset creation, curation a…

200 papers

Language models are the foundation of current neural network-based models for natural language understanding and generation. However, research on the intrinsic performance of language models on African languages has been extremely limited,…

Computation and Language · Computer Science 2021-04-05 Stuart Mesham , Luc Hayward , Jared Shapiro , Jan Buys

Pretrained multilingual contextual representations have shown great success, but due to the limits of their pretraining data, their benefits do not apply equally to all language varieties. This presents a challenge for language varieties…

Computation and Language · Computer Science 2022-06-22 Ethan C. Chau , Lucy H. Lin , Noah A. Smith

With the advent of Deep Learning based Artificial Neural Networks models, Natural Language Processing (NLP) has witnessed significant improvements in textual data processing in terms of its efficiency and accuracy. However, the research is…

Computation and Language · Computer Science 2023-10-05 Mubashir Munaf , Hammad Afzal , Naima Iltaf , Khawir Mahmood

Observing the damages that can be done by the rapid propagation of fake news in various sectors like politics and finance, automatic identification of fake news using linguistic analysis has drawn the attention of the research community.…

Computation and Language · Computer Science 2020-04-21 Md Zobaer Hossain , Md Ashraful Rahman , Md Saiful Islam , Sudipta Kar

The introduction of large language models (LLMs) has advanced natural language processing (NLP), but their effectiveness is largely dependent on pre-training resources. This is especially evident in low-resource languages, such as Sinhala,…

Computation and Language · Computer Science 2024-03-26 Hansi Hettiarachchi , Damith Premasiri , Lasitha Uyangodage , Tharindu Ranasinghe

Short-text classification, like all data science, struggles to achieve high performance using limited data. As a solution, a short sentence may be expanded with new and relevant feature words to form an artificially enlarged dataset, and…

Computation and Language · Computer Science 2019-09-18 Duncan Cameron-Steinke

In today's global digital landscape, misinformation transcends linguistic boundaries, posing a significant challenge for moderation systems. Most approaches to misinformation detection are monolingual, focused on high-resource languages,…

Computation and Language · Computer Science 2025-04-01 Xinyu Wang , Wenbo Zhang , Sarah Rajtmajer

Despite excellent results on benchmarks over a small subset of languages, large language models struggle to process text from languages situated in `lower-resource' scenarios such as dialects/sociolects (national or social varieties of a…

Computation and Language · Computer Science 2024-09-20 Aditya Joshi , Diptesh Kanojia , Heather Lent , Hour Kaing , Haiyue Song

Based on recent advances in natural language modeling and those in text generation capabilities, we propose a novel data augmentation method for text classification tasks. We use a powerful pre-trained neural network model to artificially…

Computation and Language · Computer Science 2019-11-28 Ateret Anaby-Tavor , Boaz Carmeli , Esther Goldbraich , Amir Kantor , George Kour , Segev Shlomov , Naama Tepper , Naama Zwerdling

The great majority of languages in the world are considered under-resourced for the successful application of deep learning methods. In this work, we propose a meta-learning approach to document classification in limited-resource setting…

Computation and Language · Computer Science 2021-04-27 Niels van der Heijden , Helen Yannakoudakis , Pushkar Mishra , Ekaterina Shutova

Sentiment analysis plays a crucial role in understanding the sentiment expressed in text data. While sentiment analysis research has been extensively conducted in English and other Western languages, there exists a significant gap in…

Computation and Language · Computer Science 2023-10-03 Aabha Pingle , Aditya Vyawahare , Isha Joshi , Rahul Tangsali , Geetanjali Kale , Raviraj Joshi

Processing low-resource languages, such as Kiswahili, using machine learning is difficult due to lack of adequate training data. However, such low-resource languages are still important for human communication and are already in daily use…

Computation and Language · Computer Science 2025-01-17 Barack Wamkaya Wanjawa , Lawrence Muchemi , Evans Miriti

The task of Spell Correction(SC) in low-resource languages presents a significant challenge due to the availability of only a limited corpus of data and no annotated spelling correction datasets. To tackle these challenges a small-scale…

Computation and Language · Computer Science 2024-06-14 Nishant Luitel , Nirajan Bekoju , Anand Kumar Sah , Subarna Shakya

In NLP, text classification is one of the primary problems we try to solve and its uses in language analyses are indisputable. The lack of labeled training data made it harder to do these tasks in low resource languages like Amharic. The…

Computation and Language · Computer Science 2021-03-11 Israel Abebe Azime , Nebil Mohammed

Environmental conservation organizations routinely monitor news content on conservation in protected areas to maintain situational awareness of developments that can have an environmental impact. Existing automated media monitoring systems…

The advent of Large Language Models (LLMs) has significantly advanced the field of automated code generation. LLMs rely on large and diverse datasets to learn syntax, semantics, and usage patterns of programming languages. For low-resource…

Software Engineering · Computer Science 2025-02-03 Alessandro Giagnorio , Alberto Martin-Lopez , Gabriele Bavota

Text Simplification is a task that has been minimally explored for low-resource languages. Consequently, there are only a few manually curated datasets. In this paper, we present a human curated sentence-level text simplification dataset…

Computation and Language · Computer Science 2024-12-03 Surangika Ranathunga , Rumesh Sirithunga , Himashi Rathnayake , Lahiru De Silva , Thamindu Aluthwala , Saman Peramuna , Ravi Shekhar

In low-resource natural language processing (NLP), the key problems are a lack of target language training data, and a lack of native speakers to create it. Cross-lingual methods have had notable success in addressing these concerns, but in…

Computation and Language · Computer Science 2021-04-27 Tatiana Tsygankova , Francesca Marini , Stephen Mayhew , Dan Roth

Text augmentation is a technique for constructing synthetic data from an under-resourced corpus to improve predictive performance. Synthetic data generation is common in numerous domains. However, recently text augmentation has emerged in…

Computation and Language · Computer Science 2023-09-12 Mosleh Mahamud , Zed Lee , Isak Samsten

In recent years, automatic speech recognition (ASR) systems have significantly improved, especially in languages with a vast amount of transcribed speech data. However, ASR systems tend to perform poorly for low-resource languages with…

Computation and Language · Computer Science 2024-06-04 Ara Yeroyan , Nikolay Karpov