English
Related papers

Related papers: New Confidence Measures for Statistical Machine Tr…

200 papers

Tense inconsistency frequently occurs in machine translation. However, there are few criteria to assess the model's mastery of tense prediction from a linguistic perspective. In this paper, we present a parallel tense test set, containing…

Computation and Language · Computer Science 2023-05-24 Yiming Ai , Zhiwei He , Kai Yu , Rui Wang

Analysing translation quality in regards to specific linguistic phenomena has historically been difficult and time-consuming. Neural machine translation has the attractive property that it can produce scores for arbitrary translations, and…

Computation and Language · Computer Science 2017-02-14 Rico Sennrich

Confidence calibration, which aims to make model predictions equal to the true correctness measures, is important for neural machine translation (NMT) because it is able to offer useful indicators of translation errors in the generated…

Computation and Language · Computer Science 2020-05-05 Shuo Wang , Zhaopeng Tu , Shuming Shi , Yang Liu

Translationese refers to linguistic properties that usually occur in translated texts. Previous works study translationese by framing it as a binary classification between original texts and translated texts. In this paper, we argue that…

Computation and Language · Computer Science 2025-09-22 Yikang Liu , Wanyang Zhang , Yiming Wang , Jialong Tang , Pei Zhang , Baosong Yang , Fei Huang , Rui Wang , Hai Hu

In this work we focus on confidence modeling for neural semantic parsers which are built upon sequence-to-sequence models. We outline three major causes of uncertainty, and design various metrics to quantify these factors. These metrics are…

Computation and Language · Computer Science 2018-05-15 Li Dong , Chris Quirk , Mirella Lapata

Assessing the performance of interpreting services is a complex task, given the nuanced nature of spoken language translation, the strategies that interpreters apply, and the diverse expectations of users. The complexity of this task become…

Computation and Language · Computer Science 2024-06-17 Xiaoman Wang , Claudio Fantinuoli

Social media companies as well as authorities make extensive use of artificial intelligence (AI) tools to monitor postings of hate speech, celebrations of violence or profanity. Since AI software requires massive volumes of data to train…

Computation and Language · Computer Science 2021-09-30 Hadeel Saadany , Constantin Orasan

Large language models have demonstrated parallel and even superior translation performance compared to neural machine translation (NMT) systems. However, existing comparative studies between them mainly rely on automated metrics, raising…

Computation and Language · Computer Science 2024-10-15 Zhaokun Jiang , Qianxi Lv , Ziyin Zhang , Lei Lei

We introduce a dataset comprising commercial machine translations, gathered weekly over six years across 12 translation directions. Since human A/B testing is commonly used, we assume commercial systems improve over time, which enables us…

Computation and Language · Computer Science 2024-10-04 Guojun Wu , Shay B. Cohen , Rico Sennrich

Many multilingual NLP applications need to translate words between different languages, but cannot afford the computational expense of inducing or applying a full translation model. For these applications, we have designed a fast algorithm…

cmp-lg · Computer Science 2008-02-03 I. Dan Melamed

Mutual information is fundamentally important for measuring statistical dependence between variables and for quantifying information transfer by signaling and communication mechanisms. It can, however, be challenging to evaluate for…

Information Theory · Computer Science 2014-07-29 Clive G. Bowsher , Margaritis Voliotis

Attention distributions of the generated translations are a useful bi-product of attention-based recurrent neural network translation models and can be treated as soft alignments between the input and output tokens. In this work, we use…

Computation and Language · Computer Science 2017-10-11 Matīss Rikters , Mark Fishel

In this paper, we propose a new metric for Machine Translation (MT) evaluation, based on bi-directional entailment. We show that machine generated translation can be evaluated by determining paraphrasing with a reference translation…

Computation and Language · Computer Science 2019-11-05 Rakesh Khobragade , Heaven Patel , Anand Namdev , Anish Mishra , Pushpak Bhattacharyya

Despite the recent success of automatic metrics for assessing translation quality, their application in evaluating the quality of machine-translated chats has been limited. Unlike more structured texts like news, chat conversations are…

Computation and Language · Computer Science 2024-03-14 Sweta Agrawal , Amin Farajian , Patrick Fernandes , Ricardo Rei , André F. T. Martins

Several neural-based metrics have been recently proposed to evaluate machine translation quality. However, all of them resort to point estimates, which provide limited information at segment level. This is made worse as they are trained on…

Computation and Language · Computer Science 2022-03-28 Taisiya Glushkova , Chrysoula Zerva , Ricardo Rei , André F. T. Martins

We introduce the cross-match test - an exact, distribution free, high-dimensional hypothesis test as an intrinsic evaluation metric for word embeddings. We show that cross-match is an effective means of measuring distributional similarity…

Computation and Language · Computer Science 2017-09-05 Nishant Gurnani

Machine Translation (MT) evaluation metrics assess translation quality automatically. Recently, researchers have employed MT metrics for various new use cases, such as data filtering and translation re-ranking. However, most MT metrics…

Computation and Language · Computer Science 2024-10-08 Stefano Perrella , Lorenzo Proietti , Pere-Lluís Huguet Cabot , Edoardo Barba , Roberto Navigli

In machine translation (MT) that involves translating between two languages with significant differences in word order, determining the correct word order of translated words is a major challenge. The dependency parse tree of a source…

Computation and Language · Computer Science 2017-02-16 Christian Hadiwinoto , Hwee Tou Ng

Neural machine translation (NMT) is often criticized for failures that happen without awareness. The lack of competency awareness makes NMT untrustworthy. This is in sharp contrast to human translators who give feedback or conduct further…

Computation and Language · Computer Science 2022-11-28 Pei Zhang , Baosong Yang , Haoran Wei , Dayiheng Liu , Kai Fan , Luo Si , Jun Xie

Modern machine translation (MT) systems depend on large parallel corpora, often collected from the Internet. However, recent evidence indicates that (i) a substantial portion of these texts are machine-generated translations, and (ii) an…

Computation and Language · Computer Science 2025-11-06 Cristian García-Romero , Miquel Esplà-Gomis , Felipe Sánchez-Martínez