English
Related papers

Related papers: Low resource language dataset creation, curation a…

200 papers

Sentence embedding models play a key role in various Natural Language Processing tasks, such as in Topic Modeling, Document Clustering and Recommendation Systems. However, these models rely heavily on parallel data, which can be scarce for…

Computation and Language · Computer Science 2024-12-06 Fred Philippy , Siwen Guo , Jacques Klein , Tegawendé F. Bissyandé

By describing the features and abstractions of our world, language is a crucial tool for human learning and a promising source of supervision for machine learning models. We use language to improve few-shot visual classification in the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Jesse Mu , Percy Liang , Noah Goodman

The performance of multilingual pretrained models is highly dependent on the availability of monolingual or parallel text present in a target language. Thus, the majority of the world's languages cannot benefit from recent progress in NLP…

Computation and Language · Computer Science 2022-04-07 Xinyi Wang , Sebastian Ruder , Graham Neubig

Data annotation is an essential step for constructing new datasets. However, the conventional approach of data annotation through crowdsourcing is both time-consuming and expensive. In addition, the complexity of this process increases when…

Computation and Language · Computer Science 2024-02-09 Juhwan Choi , Eunju Lee , Kyohoon Jin , YoungBin Kim

We propose a method of curating high-quality comparable training data for low-resource languages with monolingual annotators. Our method involves using a carefully selected set of images as a pivot between the source and target languages by…

Computation and Language · Computer Science 2020-04-30 Aman Madaan , Shruti Rijhwani , Antonios Anastasopoulos , Yiming Yang , Graham Neubig

Data scarcity in low-resource languages can be addressed with word-to-word translations from labeled task data in high-resource languages using bilingual lexicons. However, bilingual lexicons often have limited lexical overlap with task…

Computation and Language · Computer Science 2024-10-29 Zheng-Xin Yong , Cristina Menghini , Stephen H. Bach

The development of resource-constrained approaches to automatic speech recognition (ASR) is of great interest due to its broad applicability to many low-resource languages for which there is scant usable data. Existing approaches to many…

Computation and Language · Computer Science 2026-03-17 Emma Rafkin , Dan DeGenaro , Xiulin Yang

In this paper, we examine and analyze the challenges associated with developing and introducing language technologies to low-resource language communities. While doing so, we bring to light the successes and failures of past work in this…

It is very challenging to work with low-resource languages due to the inadequate availability of data. Using a dictionary to map independently trained word embeddings into a shared vector space has proved to be very useful in learning…

Computation and Language · Computer Science 2019-10-16 Sourav Dutta

We explore ways of incorporating bilingual dictionaries to enable semi-supervised neural machine translation. Conventional back-translation methods have shown success in leveraging target side monolingual data. However, since the quality of…

Computation and Language · Computer Science 2020-04-07 Sreyashi Nag , Mihir Kale , Varun Lakshminarasimhan , Swapnil Singhavi

Unlike mainstream languages (such as English and French), low-resource languages often suffer from a lack of expert-annotated corpora and benchmark resources that make it hard to apply state-of-the-art techniques directly. In this paper, we…

Computation and Language · Computer Science 2019-07-04 Jan Christian Blaise Cruz , Charibeth Cheng

Language model fusion helps smart assistants recognize words which are rare in acoustic data but abundant in text-only corpora (typed search logs). However, such corpora have properties that hinder downstream performance, including being…

Computation and Language · Computer Science 2022-06-16 W. Ronny Huang , Cal Peyser , Tara N. Sainath , Ruoming Pang , Trevor Strohman , Shankar Kumar

Detection of some types of toxic language is hampered by extreme scarcity of labeled training data. Data augmentation - generating new synthetic data from a labeled seed dataset - can help. The efficacy of data augmentation on toxic…

Computation and Language · Computer Science 2020-10-27 Mika Juuti , Tommi Gröndahl , Adrian Flanagan , N. Asokan

Text classification, an integral task in natural language processing, involves the automatic categorization of text into predefined classes. Creating supervised labeled datasets for low-resource languages poses a considerable challenge.…

Computation and Language · Computer Science 2024-06-18 Riya Savant , Anushka Shelke , Sakshi Todmal , Sanskruti Kanphade , Ananya Joshi , Raviraj Joshi

We investigate automatic interlinear glossing in low-resource settings. We augment a hard-attentional neural model with embedded translation information extracted from interlinear glossed text. After encoding these translations using large…

Computation and Language · Computer Science 2024-03-14 Changbing Yang , Garrett Nicolai , Miikka Silfverberg

Semi-supervised learning through deep generative models and multi-lingual pretraining techniques have orchestrated tremendous success across different areas of NLP. Nonetheless, their development has happened in isolation, while the…

Computation and Language · Computer Science 2021-01-27 Yi Zhu , Ehsan Shareghi , Yingzhen Li , Roi Reichart , Anna Korhonen

Low-resource languages present unique challenges to (neural) machine translation. We discuss the case of Bambara, a Mande language for which training data is scarce and requires significant amounts of pre-processing. More than the…

Our work addresses the problem of unsupervised Aspect Category Detection using a small set of seed words. Recent works have focused on learning embedding spaces for seed words and sentences to establish similarities between sentences and…

Computation and Language · Computer Science 2023-11-17 Thi-Nhung Nguyen , Hoang Ngo , Kiem-Hieu Nguyen , Tuan-Dung Cao

Large Language Models (LLMs) have shown remarkable performance across various tasks, yet significant disparities remain for non-English languages, and especially native African languages. This paper addresses these disparities by creating…

Computation and Language · Computer Science 2024-12-18 Tuka Alhanai , Adam Kasumovic , Mohammad Ghassemi , Aven Zitzelberger , Jessica Lundin , Guillaume Chabot-Couture

Despite remarkable advances in natural language processing, developing effective systems for low-resource languages remains a formidable challenge, with performances typically lagging far behind high-resource counterparts due to data…

Artificial Intelligence · Computer Science 2026-02-06 Subhadip Maji , Arnab Bhattacharya
‹ Prev 1 8 9 10 Next ›