中文
相关论文

相关论文: Get away with less: Need of source side data curat…

200 篇论文

High-performing machine translation (MT) systems can help overcome language barriers while making it possible for everyone to communicate and use language technologies in the language of their choice. However, such systems require large…

计算与语言 · 计算机科学 2021-06-15 Rajat Bhatnagar , Ananya Ganesh , Katharina Kann

Lack of proper linguistic resources is the major challenges faced by the Machine Translation system developments when dealing with the resource poor languages. In this paper, we describe effective ways to utilize the lexical resources to…

计算与语言 · 计算机科学 2017-11-13 Sreelekha S , Pushpak Bhattacharyya

When the amount of parallel sentences available to train a neural machine translation is scarce, a common practice is to generate new synthetic training samples from them. A number of approaches have been proposed to produce synthetic…

Parallel datasets are vital for performing and evaluating any kind of multilingual task. However, in the cases where one of the considered language pairs is a low-resource language, the existing top-down parallel data such as corpora are…

计算与语言 · 计算机科学 2023-09-26 Kasun Wickramasinghe , Nisansa de Silva

Multilingual sentence representations pose a great advantage for low-resource languages that do not have enough data to build monolingual models on their own. These multilingual sentence representations have been separately exploited by few…

计算与语言 · 计算机科学 2021-06-15 Dilan Sachintha , Lakmali Piyarathna , Charith Rajitha , Surangika Ranathunga

Parallel Data Curation (PDC) techniques aim to filter out noisy parallel sentences from web-mined corpora. Ranking sentence pairs using similarity scores on sentence embeddings derived from Pre-trained Multilingual Language Models…

计算与语言 · 计算机科学 2025-09-23 Aloka Fernando , Nisansa de Silva , Menan Velyuthan , Charitha Rathnayake , Surangika Ranathunga

We propose a method of curating high-quality comparable training data for low-resource languages with monolingual annotators. Our method involves using a carefully selected set of images as a pivot between the source and target languages by…

计算与语言 · 计算机科学 2020-04-30 Aman Madaan , Shruti Rijhwani , Antonios Anastasopoulos , Yiming Yang , Graham Neubig

Machine translation in low-resource language pairs faces significant challenges due to the scarcity of parallel corpora and linguistic resources. This study focuses on the case of English-Marathi language pairs, where existing datasets are…

计算与语言 · 计算机科学 2024-09-05 Nidhi Kowtal , Tejas Deshpande , Raviraj Joshi

We investigate the potential of LLM-generated synthetic data for improving low-resource Machine Translation (MT). Focusing on seven diverse target languages, we construct a document-level synthetic corpus from English Europarl, and extend…

计算与语言 · 计算机科学 2025-09-23 Ona de Gibert , Joseph Attieh , Teemu Vahtola , Mikko Aulamo , Zihao Li , Raúl Vázquez , Tiancheng Hu , Jörg Tiedemann

Parallel corpora play an important role in training machine translation (MT) models, particularly for low-resource languages where high-quality bilingual data is scarce. This review provides a comprehensive overview of available parallel…

计算与语言 · 计算机科学 2025-04-23 Rahul Raja , Arpita Vats

This research article examines the effectiveness of various pretraining strategies for developing machine translation models tailored to low-resource languages. Although this work considers several low-resource languages, including…

计算与语言 · 计算机科学 2025-10-30 Idriss Nguepi Nguefack , Mara Finkelstein , Toadoum Sari Sakayo

Many language pairs are low resource, meaning the amount and/or quality of available parallel data is not sufficient to train a neural machine translation (NMT) model which can reach an acceptable standard of accuracy. Many works have…

计算与语言 · 计算机科学 2021-11-23 Idris Abdulmumin , Bashir Shehu Galadanci , Abubakar Isa , Habeebah Adamu Kakudi , Ismaila Idris Sinan

In this paper, we describe our submission to the WMT19 low-resource parallel corpus filtering shared task. Our main approach is based on the LASER toolkit (Language-Agnostic SEntence Representations), which uses an encoder-decoder…

计算与语言 · 计算机科学 2019-06-24 Vishrav Chaudhary , Yuqing Tang , Francisco Guzmán , Holger Schwenk , Philipp Koehn

Despite impressive progress in high-resource settings, Neural Machine Translation (NMT) still struggles in low-resource and out-of-domain scenarios, often failing to match the quality of phrase-based translation. We propose a novel…

计算与语言 · 计算机科学 2018-05-31 Xing Niu , Michael Denkowski , Marine Carpuat

The quality of a Neural Machine Translation system depends substantially on the availability of sizable parallel corpora. For low-resource language pairs this is not the case, resulting in poor translation quality. Inspired by work in…

计算与语言 · 计算机科学 2018-02-14 Marzieh Fadaee , Arianna Bisazza , Christof Monz

Despite the recent popularity of Large Language Models (LLMs) in Machine Translation (MT), their performance in low-resource languages (LRLs) still lags significantly behind Neural Machine Translation (NMT) models. In this work, we explore…

计算与语言 · 计算机科学 2024-10-07 Vivek Iyer , Bhavitvya Malik , Pavel Stepachev , Pinzhen Chen , Barry Haddow , Alexandra Birch

Recent studies in prompting large language model (LLM) for document-level machine translation (DMT) primarily focus on the inter-sentence context by flatting the source document into a long sequence. This approach relies solely on the…

计算与语言 · 计算机科学 2025-03-18 Bin Liu , Xinglin Lyu , Junhui Li , Daimeng Wei , Min Zhang , Shimin Tao , Hao Yang

Quality Estimation (QE) is the task of evaluating the quality of a translation when reference translation is not available. The goal of QE aligns with the task of corpus filtering, where we assign the quality score to the sentence pairs…

计算与语言 · 计算机科学 2023-06-07 Akshay Batheja , Pushpak Bhattacharyya

We conduct an empirical study of neural machine translation (NMT) for truly low-resource languages, and propose a training curriculum fit for cases when both parallel training data and compute resource are lacking, reflecting the reality of…

Recent studies have highlighted the potential of exploiting parallel corpora to enhance multilingual large language models, improving performance in both bilingual tasks, e.g., machine translation, and general-purpose tasks, e.g., text…

计算与语言 · 计算机科学 2025-02-11 Peiqin Lin , André F. T. Martins , Hinrich Schütze
‹ 上一页 1 2 3 10 下一页 ›