English
Related papers

Related papers: Investigating Data Variance in Evaluations of Auto…

200 papers

We release 70 small and discriminative test sets for machine translation (MT) evaluation called variance-aware test sets (VAT), covering 35 translation directions from WMT16 to WMT20 competitions. VAT is automatically created by a novel…

Computation and Language · Computer Science 2021-11-09 Runzhe Zhan , Xuebo Liu , Derek F. Wong , Lidia S. Chao

The performance of machine learning models relies heavily on the quality of input data, yet real-world applications often face significant data-related challenges. A common issue arises when curating training data or deploying models: two…

Machine Learning · Computer Science 2025-09-24 Varun Babbar , Zhicheng Guo , Cynthia Rudin

With the rapid development of deep learning technologies, the field of machine translation has witnessed significant progress, especially with the advent of large language models (LLMs) that have greatly propelled the advancement of…

Computation and Language · Computer Science 2025-04-22 Jiaxin GUO , Xiaoyu Chen , Zhiqiang Rao , Jinlong Yang , Zongyao Li , Hengchao Shang , Daimeng Wei , Hao Yang

This thesis argues that the currently widely used Natural Language Processing algorithms possibly have various limitations related to the properties of the texts they handle and produce. With the wide adoption of these tools in rapid…

Computation and Language · Computer Science 2024-09-17 Josef Jon

We investigate the tradeoff between adequacy and fluency in machine translation. We show the severity of this tradeoff at the evaluation level and analyze where popular metrics fall within it. Essentially, current metrics generally lean…

Computation and Language · Computer Science 2025-09-25 Behzad Shayegh , Jan-Thorsten Peter , David Vilar , Tobias Domhan , Juraj Juraska , Markus Freitag , Lili Mou

Multimodal machine translation (MMT) systems have been shown to outperform their text-only neural machine translation (NMT) counterparts when visual context is available. However, recent studies have also shown that the performance of MMT…

Computation and Language · Computer Science 2021-09-09 Jiaoda Li , Duygu Ataman , Rico Sennrich

In Machine Translation (MT) evaluation, metric performance is assessed based on agreement with human judgments. In recent years, automatic metrics have demonstrated increasingly high levels of agreement with humans. To gain a clearer…

Computation and Language · Computer Science 2025-06-25 Lorenzo Proietti , Stefano Perrella , Roberto Navigli

A confidence measure is able to estimate the reliability of an hypothesis provided by a machine translation system. The problem of confidence measure can be seen as a process of testing : we want to decide whether the most probable sequence…

Computation and Language · Computer Science 2009-02-09 Sylvain Raybaud , Caroline Lavecchia , David Langlois , Kamel Smaïli

Automatic machine translation (MT) metrics are widely used to distinguish the translation qualities of machine translation systems across relatively large test sets (system-level evaluation). However, it is unclear if automatic metrics are…

Computation and Language · Computer Science 2023-06-21 Nikita Moghe , Tom Sherborne , Mark Steedman , Alexandra Birch

Social media companies as well as authorities make extensive use of artificial intelligence (AI) tools to monitor postings of hate speech, celebrations of violence or profanity. Since AI software requires massive volumes of data to train…

Computation and Language · Computer Science 2021-09-30 Hadeel Saadany , Constantin Orasan

Most machine learning models operate under the assumption that the training, testing and deployment data is independent and identically distributed (i.i.d.). This assumption doesn't generally hold true in a natural setting. Usually, the…

Machine Learning · Computer Science 2021-12-14 Kumud Lakara , Akshat Bhandari , Pratinav Seth , Ujjwal Verma

Automatic metrics play a crucial role in machine translation. Despite the widespread use of n-gram-based metrics, there has been a recent surge in the development of pre-trained model-based metrics that focus on measuring sentence…

Computation and Language · Computer Science 2023-07-11 Yiming Yan , Tao Wang , Chengqi Zhao , Shujian Huang , Jiajun Chen , Mingxuan Wang

Automatic machine translation metrics typically rely on human translations to determine the quality of system translations. Common wisdom in the field dictates that the human references should be of very high quality. However, there are no…

Computation and Language · Computer Science 2024-04-11 Vilém Zouhar , Ondřej Bojar

Human-translated text displays distinct features from naturally written text in the same language. This phenomena, known as translationese, has been argued to confound the machine translation (MT) evaluation. Yet, we find that existing work…

Computation and Language · Computer Science 2022-06-10 Jingwei Ni , Zhijing Jin , Markus Freitag , Mrinmaya Sachan , Bernhard Schölkopf

We provide an analytical argument for understanding the likely nature of parameter shifts between those coming from an analysis of a dataset and from a subset of that dataset, assuming differences are down to noise and any intrinsic…

Instrumentation and Methods for Astrophysics · Physics 2020-10-28 Steven Gratton , Anthony Challinor

Recent machine translation (MT) metrics calibrate their effectiveness by correlating with human judgement but without any insights about their behaviour across different error types. Challenge sets are used to probe specific dimensions of…

Computation and Language · Computer Science 2024-01-30 Nikita Moghe , Arnisa Fazla , Chantal Amrhein , Tom Kocmi , Mark Steedman , Alexandra Birch , Rico Sennrich , Liane Guillou

For sensible progress in natural language processing, it is important that we are aware of the limitations of the evaluation metrics we use. In this work, we evaluate how robust metrics are to non-standardized dialects, i.e. spelling…

Computation and Language · Computer Science 2023-11-29 Noëmi Aepli , Chantal Amrhein , Florian Schottmann , Rico Sennrich

Machine translation evaluation is a very important activity in machine translation development. Automatic evaluation metrics proposed in literature are inadequate as they require one or more human reference translations to compare them with…

Computation and Language · Computer Science 2013-11-18 Nisheeth Joshi , Iti Mathur , Hemant Darbari , Ajai Kumar

Machine translation (MT) was developed as one of the hottest research topics in the natural language processing (NLP) literature. One important issue in MT is that how to evaluate the MT system reasonably and tell us whether the translation…

Computation and Language · Computer Science 2022-01-25 Lifeng Han

With the growth of interpreting technologies, from remote interpreting and Computer-Aided Interpreting to automated speech translation and interpreting avatars, there is now a high demand for ways to quickly and efficiently measure the…

Computation and Language · Computer Science 2026-01-12 Jonathan Downie , Joss Moorkens