中文
相关论文

相关论文: Multilingual Neural Machine Translation System for…

200 篇论文

A large number of significant assets are available online in English, which is frequently translated into native languages to ease the information sharing among local people who are not much familiar with English. However, manual…

计算与语言 · 计算机科学 2020-04-30 Himanshu Choudhary , Shivansh Rao , Rajesh Rohilla

In this study, we present an analysis regarding the performance of the state-of-art Phrase-based Statistical Machine Translation (SMT) on multiple Indian languages. We report baseline systems on several language pairs. The motivation of…

计算与语言 · 计算机科学 2017-01-17 Nadeem Jadoon Khan , Waqas Anwar , Nadir Durrani

This paper demonstrates that Phrase-Based Statistical Machine Translation (PBSMT) can outperform Transformer-based Neural Machine Translation (NMT) in moderate-resource scenarios, specifically for structurally similar languages, like the…

计算与语言 · 计算机科学 2024-12-24 Waisullah Yousofi , Pushpak Bhattacharyya

Parallel corpora are indispensable for training neural machine translation (NMT) models, and parallel corpora for most language pairs do not exist or are scarce. In such cases, pivot language NMT can be helpful where a pivot language is…

计算与语言 · 计算机科学 2021-04-16 Raj Dabre , Aizhan Imankulova , Masahiro Kaneko , Abhisek Chakrabarty

Being less resource languages, Indian-Indian and English-Indian language MT system developments faces the difficulty to translate various lexical phenomena. In this paper, we present our work on a comparative study of 440 phrase-based…

计算与语言 · 计算机科学 2017-10-09 Sreelekha S , Pushpak Bhattacharyya

In this paper, we show that the combination of Phrase Pair Injection and Corpus Filtering boosts the performance of Neural Machine Translation (NMT) systems. We extract parallel phrases and sentences from the pseudo-parallel corpus and…

计算与语言 · 计算机科学 2023-01-20 Akshay Batheja , Pushpak Bhattacharyya

Evaluating Large Language Models (LLMs) in low-resource and linguistically diverse languages remains a significant challenge in NLP, particularly for languages using non-Latin scripts like those spoken in India. Existing benchmarks…

计算与语言 · 计算机科学 2025-02-05 Sshubam Verma , Mohammed Safi Ur Rahman Khan , Vishwajeet Kumar , Rudra Murthy , Jaydeep Sen

With nearly 1.5 billion people and more than 120 major languages, India represents one of the most diverse regions in the world. As multilingual Vision-Language Models (VLMs) gain prominence, robust evaluation methodologies are essential to…

We present effective pre-training strategies for neural machine translation (NMT) using parallel corpora involving a pivot language, i.e., source-pivot and pivot-target, leading to a significant improvement in source-target translation. We…

计算与语言 · 计算机科学 2019-09-23 Yunsu Kim , Petre Petrov , Pavel Petrushkov , Shahram Khadivi , Hermann Ney

The rapid growth of machine translation (MT) systems has necessitated comprehensive studies to meta-evaluate evaluation metrics being used, which enables a better selection of metrics that best reflect MT quality. Unfortunately, most of the…

计算与语言 · 计算机科学 2023-07-04 Ananya B. Sai , Vignesh Nagarajan , Tanay Dixit , Raj Dabre , Anoop Kunchukuttan , Pratyush Kumar , Mitesh M. Khapra

This paper presents the system description of Machine Translation (MT) system(s) for Indic Languages Multilingual Task for the 2018 edition of the WAT Shared Task. In our experiments, we (the RGNLP team) explore both statistical and neural…

计算与语言 · 计算机科学 2018-12-04 Atul Kr. Ojha , Koel Dutta Chowdhury , Chao-Hong Liu , Karan Saxena

Fine-tuning multilingual sequence-to-sequence large language models (msLLMs) has shown promise in developing neural machine translation (NMT) systems for low-resource languages (LRLs). However, conventional single-stage fine-tuning methods…

计算与语言 · 计算机科学 2025-03-31 Sarubi Thillainathan , Songchen Yuan , En-Shiun Annie Lee , Sanath Jayasena , Surangika Ranathunga

Transliteration is a task in the domain of NLP where the output word is a similar-sounding word written using the letters of any foreign language. Today this system has been developed for several language pairs that involve English as…

计算与语言 · 计算机科学 2022-08-24 Yash Raj , Bhavesh Laddagiri

Multilingual Neural Machine Translation (MNMT) models are commonly trained on a joint set of bilingual corpora which is acutely English-centric (i.e. English either as the source or target language). While direct data between two languages…

计算与语言 · 计算机科学 2020-10-21 Markus Freitag , Orhan Firat

Neural machine translation (NMT) models are conventionally trained with token-level negative log-likelihood (NLL), which does not guarantee that the generated translations will be optimized for a selected sequence-level evaluation metric.…

计算与语言 · 计算机科学 2021-04-16 Raphael Shu , Kang Min Yoo , Jung-Woo Ha

While Indic NLP has made rapid advances recently in terms of the availability of corpora and pre-trained models, benchmark datasets on standard NLU tasks are limited. To this end, we introduce IndicXNLI, an NLI dataset for 11 Indic…

计算与语言 · 计算机科学 2022-04-20 Divyanshu Aggarwal , Vivek Gupta , Anoop Kunchukuttan

Script diversity presents a challenge to Multilingual Language Models (MLLM) by reducing lexical overlap among closely related languages. Therefore, transliterating closely related languages that use different writing scripts to a common…

计算与语言 · 计算机科学 2023-08-01 Ibraheem Muhammad Moosa , Mahmud Elahi Akhter , Ashfia Binte Habib

One of the significant challenges of Machine Translation (MT) is the scarcity of large amounts of data, mainly parallel sentence aligned corpora. If the evaluation is as rigorous as resource-rich languages, both Neural Machine Translation…

计算与语言 · 计算机科学 2023-03-06 Amit Kumar , Rupjyoti Baruah , Ajay Pratap , Mayank Swarnkar , Anil Kumar Singh

In this paper, we introduce Neural Information Retrieval resources for 11 widely spoken Indian Languages (Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Oriya, Punjabi, Tamil, and Telugu) from two major Indian language…

信息检索 · 计算机科学 2023-12-18 Saiful Haq , Ashutosh Sharma , Pushpak Bhattacharyya

We demonstrate a new approach to Neural Machine Translation (NMT) for low-resource languages using a ubiquitous linguistic resource, Interlinear Glossed Text (IGT). IGT represents a non-English sentence as a sequence of English lemmas and…

计算与语言 · 计算机科学 2020-03-04 Zhong Zhou , Lori Levin , David R. Mortensen , Alex Waibel