English
Related papers

Related papers: Quality Estimation Of Machine Translation Outputs …

200 papers

Translating in real-time, a.k.a. simultaneous translation, outputs translation words before the input sentence ends, which is a challenging problem for conventional machine translation methods. We propose a neural machine translation (NMT)…

Computation and Language · Computer Science 2017-01-12 Jiatao Gu , Graham Neubig , Kyunghyun Cho , Victor O. K. Li

In machine translation (MT) that involves translating between two languages with significant differences in word order, determining the correct word order of translated words is a major challenge. The dependency parse tree of a source…

Computation and Language · Computer Science 2017-02-16 Christian Hadiwinoto , Hwee Tou Ng

Automatic machine translation (MT) metrics are widely used to distinguish the translation qualities of machine translation systems across relatively large test sets (system-level evaluation). However, it is unclear if automatic metrics are…

Computation and Language · Computer Science 2023-06-21 Nikita Moghe , Tom Sherborne , Mark Steedman , Alexandra Birch

This paper presents EvolveMT for efficiently combining multiple machine translation (MT) engines. The proposed system selects the output from a single engine for each segment by utilizing online learning techniques to predict the most…

Computation and Language · Computer Science 2023-06-22 Kamer Ali Yuksel , Ahmet Gunduz , Mohamed Al-Badrashiny , Shreyas Sharma , Hassan Sawaf

Machine Translation (MT) evaluation metrics assess translation quality automatically. Recently, researchers have employed MT metrics for various new use cases, such as data filtering and translation re-ranking. However, most MT metrics…

Computation and Language · Computer Science 2024-10-08 Stefano Perrella , Lorenzo Proietti , Pere-Lluís Huguet Cabot , Edoardo Barba , Roberto Navigli

Homographs, words with different meanings but the same surface form, have long caused difficulty for machine translation systems, as it is difficult to select the correct translation based on the context. However, with the advent of neural…

Computation and Language · Computer Science 2018-03-29 Frederick Liu , Han Lu , Graham Neubig

We present an alternative method of evaluating Quality Estimation systems, which is based on a linguistically-motivated Test Suite. We create a test-set consisting of 14 linguistic error categories and we gather for each of them a set of…

Computation and Language · Computer Science 2019-10-17 Avramidis Eleftherios , Vivien Macketanz , Arle Lommel , Hans Uszkoreit

We present a framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework,…

Computation and Language · Computer Science 2017-10-06 Francisco Guzmán , Shafiq R. Joty , Lluís Màrquez , Preslav Nakov

Large language models (LLMs) that have been trained on multilingual but not parallel text exhibit a remarkable ability to translate between languages. We probe this ability in an in-depth study of the pathways language model (PaLM), which…

Computation and Language · Computer Science 2023-06-27 David Vilar , Markus Freitag , Colin Cherry , Jiaming Luo , Viresh Ratnakar , George Foster

There are many machine translation (MT) papers that propose novel approaches and show improvements over their self-defined baselines. The experimental setting in each paper often differs from one another. As such, it is hard to determine if…

Computation and Language · Computer Science 2018-05-07 Christian Hadiwinoto , Hwee Tou Ng

Translate-test is a popular technique to improve the performance of multilingual language models. This approach works by translating the input into English using an external machine translation system, and running inference over the…

Computation and Language · Computer Science 2023-08-03 Julen Etxaniz , Gorka Azkune , Aitor Soroa , Oier Lopez de Lacalle , Mikel Artetxe

Translation is important for cross-language communication, and many efforts have been made to improve its accuracy. However, less investment is conducted in aligning translations with human preferences, such as translation tones or styles.…

Computation and Language · Computer Science 2024-10-16 Shuqiao Sun , Yutong Yao , Peiwen Wu , Feijun Jiang , Kaifu Zhang

Natural language processing is a prompt research area across the country. Parsing is one of the very crucial tool in language analysis system which aims to forecast the structural relationship among the words in a given sentence. Many…

Computation and Language · Computer Science 2014-03-26 K. Sureka , K. G. Srinivasagan , S. Suganthi

A major challenge in the practical use of Machine Translation (MT) is that users lack guidance to make informed decisions about when to rely on outputs. Progress in quality estimation research provides techniques to automatically assess MT…

Computation and Language · Computer Science 2023-10-27 Nikita Mehandru , Sweta Agrawal , Yimin Xiao , Elaine C Khoong , Ge Gao , Marine Carpuat , Niloufar Salehi

Neural Machine Translation (NMT) systems rely heavily on explicit punctuation cues to resolve semantic ambiguities in a source sentence. Inputting user-generated sentences, which are likely to contain missing or incorrect punctuation,…

Computation and Language · Computer Science 2026-02-16 Kaustubh Shivshankar Shejole , Sourabh Deoghare , Pushpak Bhattacharyya

An important challenge in machine translation (MT) is to generate high-quality and diverse translations. Prior work has shown that the estimated likelihood from the MT model correlates poorly with translation quality. In contrast, quality…

Computation and Language · Computer Science 2024-10-17 Gonçalo R. A. Faria , Sweta Agrawal , António Farinhas , Ricardo Rei , José G. C. de Souza , André F. T. Martins

This study evaluates the machine translation (MT) quality of two state-of-the-art large language models (LLMs) against a tradition-al neural machine translation (NMT) system across four language pairs in the legal domain. It combines…

Computation and Language · Computer Science 2024-02-13 Vicent Briva-Iglesias , Joao Lucas Cavalheiro Camargo , Gokhan Dogru

Generating code-switched text is a problem of growing interest, especially given the scarcity of corpora containing large volumes of real code-switched text. In this work, we adapt a state-of-the-art neural machine translation model to…

Computation and Language · Computer Science 2021-07-15 Ishan Tarunesh , Syamantak Kumar , Preethi Jyothi

Current speech translation systems, while having achieved impressive accuracies, are rather static in their behavior and do not adapt to real-world situations in ways human interpreters do. In order to improve their practical usefulness and…

Computation and Language · Computer Science 2025-08-12 Matthias Sperber , Maureen de Seyssel , Jiajun Bao , Matthias Paulik

This paper describes the Stevens Institute of Technology's submission for the WMT 2022 Shared Task: Code-mixed Machine Translation (MixMT). The task consisted of two subtasks, subtask $1$ Hindi/English to Hinglish and subtask $2$ Hinglish…

Computation and Language · Computer Science 2022-11-18 Abdul Rafae Khan , Hrishikesh Kanade , Girish Amar Budhrani , Preet Jhanglani , Jia Xu