中文
相关论文

相关论文: Parallel Corpora for Machine Translation in Low-re…

200 篇论文

We conducted a detailed analysis on the quality of web-mined corpora for two low-resource languages (making three language pairs, English-Sinhala, English-Tamil and Sinhala-Tamil). We ranked each corpus according to a similarity measure and…

计算与语言 · 计算机科学 2024-06-17 Surangika Ranathunga , Nisansa de Silva , Menan Velayuthan , Aloka Fernando , Charitha Rathnayake

This tutorial (https://tum-nlp.github.io/low-resource-tutorial) is designed for NLP practitioners, researchers, and developers working with multilingual and low-resource languages who seek to create more equitable and socially impactful…

计算与语言 · 计算机科学 2025-12-17 Ekaterina Artemova , Laurie Burchell , Daryna Dementieva , Shu Okabe , Mariya Shmatova , Pedro Ortiz Suarez

Multilingual LLMs support a variety of languages; however, their performance is suboptimal for low-resource languages. In this work, we emphasize the importance of continued pre-training of multilingual LLMs and the use of translation-based…

Parallel text is required for building high-quality machine translation (MT) systems, as well as for other multilingual NLP applications. For many South Asian languages, such data is in short supply. In this paper, we described a new…

计算与语言 · 计算机科学 2020-01-28 Barry Haddow , Faheem Kirefu

Multilingual machine translation systems aim to make knowledge accessible across languages, yet learning effective cross-lingual representations remains challenging. These challenges are especially pronounced for low-resource languages,…

计算与语言 · 计算机科学 2026-01-08 David Stap

Indian language machine translation performance is hampered due to the lack of large scale multi-lingual sentence aligned corpora and robust benchmarks. Through this paper, we provide and analyse an automated framework to obtain such a…

计算与语言 · 计算机科学 2020-11-05 Jerin Philip , Shashank Siripragada , Vinay P. Namboodiri , C. V. Jawahar

Developing parallel corpora is an important and a difficult activity for Machine Translation. This requires manual annotation by Human Translators. Translating same text again is a useless activity. There are tools available to implement…

计算与语言 · 计算机科学 2012-10-23 Nisheeth Joshi , Iti Mathur

A prerequisite for training corpus-based machine translation (MT) systems -- either Statistical MT (SMT) or Neural MT (NMT) -- is the availability of high-quality parallel data. This is arguably more important today than ever before, as NMT…

计算与语言 · 计算机科学 2018-04-18 Alberto Poncelas , Dimitar Shterionov , Andy Way , Gideon Maillette de Buy Wenniger , Peyman Passban

Machine Translation (MT) between linguistically dissimilar languages is challenging, especially due to the scarcity of parallel corpora. Prior works suggest that pivoting through a high-resource language can help translation into a related…

计算与语言 · 计算机科学 2024-06-21 Pranav Gaikwad , Meet Doshi , Raj Dabre , Pushpak Bhattacharyya

This research article examines the effectiveness of various pretraining strategies for developing machine translation models tailored to low-resource languages. Although this work considers several low-resource languages, including…

计算与语言 · 计算机科学 2025-10-30 Idriss Nguepi Nguefack , Mara Finkelstein , Toadoum Sari Sakayo

Parallel corpora are indispensable for training neural machine translation (NMT) models, and parallel corpora for most language pairs do not exist or are scarce. In such cases, pivot language NMT can be helpful where a pivot language is…

计算与语言 · 计算机科学 2021-04-16 Raj Dabre , Aizhan Imankulova , Masahiro Kaneko , Abhisek Chakrabarty

Neural approaches have achieved state-of-the-art accuracy on machine translation but suffer from the high cost of collecting large scale parallel data. Thus, a lot of research has been conducted for neural machine translation (NMT) with…

计算与语言 · 计算机科学 2021-07-12 Rui Wang , Xu Tan , Renqian Luo , Tao Qin , Tie-Yan Liu

Pre-training large-scale language models (LMs) requires huge amounts of text corpora. LMs for English enjoy ever growing corpora of diverse language resources. However, less resourced languages and their mono- and multilingual LMs often…

计算与语言 · 计算机科学 2020-07-07 Maria Khvalchik , Mikhail Galkin

In this paper, we address the task of improving pair-wise machine translation for specific low resource Indian languages. Multilingual NMT models have demonstrated a reasonable amount of effectiveness on resource-poor languages. In this…

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of translation knowledge transfer (transfer…

计算与语言 · 计算机科学 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

Achieving universal translation between all human language pairs is the holy-grail of machine translation (MT) research. While recent progress in massively multilingual MT is one step closer to reaching this goal, it is becoming evident…

计算与语言 · 计算机科学 2022-01-14 Aditya Siddhant , Ankur Bapna , Orhan Firat , Yuan Cao , Mia Xu Chen , Isaac Caswell , Xavier Garcia

Multimodal neural machine translation (NMT) has become an increasingly important area of research over the years because additional modalities, such as image data, can provide more context to textual data. Furthermore, the viability of…

计算与语言 · 计算机科学 2020-10-20 Andrew Merritt , Chenhui Chu , Yuki Arase

Resources for the non-English languages are scarce and this paper addresses this problem in the context of machine translation, by automatically extracting parallel sentence pairs from the multilingual articles available on the Internet. In…

计算与语言 · 计算机科学 2018-06-27 Sree Harsha Ramesh , Krishna Prasad Sankaranarayanan

Recent research in multilingual language models (LM) has demonstrated their ability to effectively handle multiple languages in a single model. This holds promise for low web-resource languages (LRL) as multilingual models can enable…

计算与语言 · 计算机科学 2021-06-10 Yash Khemchandani , Sarvesh Mehtani , Vaidehi Patil , Abhijeet Awasthi , Partha Talukdar , Sunita Sarawagi

This paper proposes a tool for efficiently constructing high-quality parallel corpora with minimizing human labor and making this tool publicly available. Our proposed construction process is based on neural machine translation (NMT) to…

计算与语言 · 计算机科学 2021-11-02 Chanjun Park , Seolhwa Lee , Hyeonseok Moon , Sugyeong Eo , Jaehyung Seo , Heuiseok Lim