English
Related papers

Related papers: Low-Resource Corpus Filtering using Multilingual S…

200 papers

How to achieve neural machine translation with limited parallel data? Existing techniques often rely on large-scale monolingual corpora, which is impractical for some low-resource languages. In this paper, we turn to connect several…

Computation and Language · Computer Science 2022-10-14 Zhe Yang , Qingkai Fang , Yang Feng

Very low-resource languages, having only a few million tokens worth of data, are not well-supported by multilingual NLP approaches due to poor quality cross-lingual word representations. Recent work showed that good cross-lingual…

Computation and Language · Computer Science 2023-11-22 Viktor Hangya , Silvia Severini , Radoslav Ralev , Alexander Fraser , Hinrich Schütze

Scaling multilingual representation learning beyond the hundred most frequent languages is challenging, in particular to cover the long tail of low-resource languages. A promising approach has been to train one-for-all multilingual models…

Computation and Language · Computer Science 2022-05-26 Kevin Heffernan , Onur Çelebi , Holger Schwenk

This paper proposes an approach to cross-language sentence selection in a low-resource setting. It uses data augmentation and negative sampling techniques on noisy parallel sentence data to directly learn a cross-lingual embedding-based…

Computation and Language · Computer Science 2021-06-07 Yanda Chen , Chris Kedzie , Suraj Nair , Petra Galuščáková , Rui Zhang , Douglas W. Oard , Kathleen McKeown

In this paper, we propose to boost low-resource cross-lingual document retrieval performance with deep bilingual query-document representations. We match queries and documents in both source and target languages with four components, each…

Computation and Language · Computer Science 2019-06-11 Rui Zhang , Caitlin Westerfield , Sungrok Shim , Garrett Bingham , Alexander Fabbri , Neha Verma , William Hu , Dragomir Radev

In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm (MAML) for low-resource neural machine translation (NMT). We frame low-resource translation as a meta-learning problem, and we learn to adapt…

Computation and Language · Computer Science 2018-08-28 Jiatao Gu , Yong Wang , Yun Chen , Kyunghyun Cho , Victor O. K. Li

Dense vector representations for textual data are crucial in modern NLP. Word embeddings and sentence embeddings estimated from raw texts are key in achieving state-of-the-art results in various tasks requiring semantic understanding.…

Computation and Language · Computer Science 2023-07-06 Sonal Sannigrahi , Josef van Genabith , Cristina Espana-Bonet

Multimodal neural machine translation (NMT) has become an increasingly important area of research over the years because additional modalities, such as image data, can provide more context to textual data. Furthermore, the viability of…

Computation and Language · Computer Science 2020-10-20 Andrew Merritt , Chenhui Chu , Yuki Arase

In-context machine translation (MT) with large language models (LLMs) is a promising approach for low-resource MT, as it can readily take advantage of linguistic resources such as grammar books and dictionaries. Such resources are usually…

Computation and Language · Computer Science 2025-05-30 Renhao Pei , Yihong Liu , Peiqin Lin , François Yvon , Hinrich Schütze

Multilingual pretraining typically lacks explicit alignment signals, leading to suboptimal cross-lingual alignment in the representation space. In this work, we show that training standard pretrained models for cross-lingual alignment with…

Computation and Language · Computer Science 2026-02-26 Barah Fazili , Koustava Goswami

In recent years, text classification methods based on neural networks and pre-trained models have gained increasing attention and demonstrated excellent performance. However, these methods still have some limitations in practical…

Computation and Language · Computer Science 2024-12-16 Yanxu Mao , Peipei Liu , Tiehan Cui , Congying Liu , Datao You

We investigate automatic interlinear glossing in low-resource settings. We augment a hard-attentional neural model with embedded translation information extracted from interlinear glossed text. After encoding these translations using large…

Computation and Language · Computer Science 2024-03-14 Changbing Yang , Garrett Nicolai , Miikka Silfverberg

The use of subword embedding has proved to be a major innovation in Neural Machine Translation (NMT). It helps NMT to learn better context vectors for Low Resource Languages (LRLs) so as to predict the target words by better modelling the…

Computation and Language · Computer Science 2023-05-23 Amit Kumar , Shantipriya Parida , Ajay Pratap , Anil Kumar Singh

We describe an unsupervised method to create pseudo-parallel corpora for machine translation (MT) from unaligned text. We use multilingual BERT to create source and target sentence embeddings for nearest-neighbor search and adapt the model…

Computation and Language · Computer Science 2020-10-16 Phillip Keung , Julian Salazar , Yichao Lu , Noah A. Smith

Grammatical error correction can be viewed as a low-resource sequence-to-sequence task, because publicly available parallel corpora are limited. To tackle this challenge, we first generate erroneous versions of large unannotated corpora…

Computation and Language · Computer Science 2019-07-03 Yo Joong Choe , Jiyeon Ham , Kyubyong Park , Yeoil Yoon

Since their inception, embeddings have become a primary ingredient in many flavours of Natural Language Processing (NLP) tasks supplanting earlier types of representation. Even though multilingual embeddings have been used for the…

Computation and Language · Computer Science 2024-02-09 Kasun Wickramasinghe , Nisansa de Silva

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

Computation and Language · Computer Science 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

Neural machine translation (NMT) has achieved great successes with large datasets, so NMT is more premised on high-resource languages. This continuously underpins the low resource languages such as Luganda due to the lack of high-quality…

Computation and Language · Computer Science 2023-01-10 Richard Kimera , Daniela N. Rim , Heeyoul Choi

This study explores the use of large language models (LLMs) for translating English into Mambai, a low-resource Austronesian language spoken in Timor-Leste, with approximately 200,000 native speakers. Leveraging a novel corpus derived from…

Computation and Language · Computer Science 2025-01-28 Raphaël Merx , Aso Mahmudi , Katrina Langford , Leo Alberto de Araujo , Ekaterina Vylomova

Plagiarism involves using another person's work or concepts without proper attribution, presenting them as original creations. With the growing amount of data communicated in regional languages such as Marathi -- one of India's regional…

Computation and Language · Computer Science 2025-01-10 Atharva Mutsaddi , Aditya Choudhary