English
Related papers

Related papers: Quality Estimation without Human-labeled Data

200 papers

Advances in large language models have notably enhanced the efficiency of information extraction from unstructured and semi-structured data sources. As these technologies become integral to various applications, establishing an objective…

Selecting high-quality pre-training data is important for creating capable language models, but existing methods rely on simple heuristics. We introduce QuRating, a method for selecting pre-training data that can capture human intuitions…

Computation and Language · Computer Science 2024-07-19 Alexander Wettig , Aatmik Gupta , Saumya Malik , Danqi Chen

Most studies on word-level Quality Estimation (QE) of machine translation focus on language-specific models. The obvious disadvantages of these approaches are the need for labelled data for each language pair and the high cost required to…

Computation and Language · Computer Science 2021-06-02 Tharindu Ranasinghe , Constantin Orasan , Ruslan Mitkov

From both human translators (HT) and machine translation (MT) researchers' point of view, translation quality evaluation (TQE) is an essential task. Translation service providers (TSPs) have to deliver large volumes of translations which…

Computation and Language · Computer Science 2021-11-16 Serge Gladkoff , Irina Sorokina , Lifeng Han , Alexandra Alekseeva

Text simplification systems generate versions of texts that are easier to understand for a broader audience. The quality of simplified texts is generally estimated using metrics that compare to human references, which can be difficult to…

Computation and Language · Computer Science 2020-12-24 Reno Kriz , Marianna Apidianaki , Chris Callison-Burch

Training large language models (LLMs) for external tool usage is a rapidly expanding field, with recent research focusing on generating synthetic data to address the shortage of available data. However, the absence of systematic data…

Machine Learning · Computer Science 2024-09-27 Shadi Iskander , Nachshon Cohen , Zohar Karnin , Ori Shapira , Sofia Tolmach

We present the task of PreQuEL, Pre-(Quality-Estimation) Learning. A PreQuEL system predicts how well a given sentence will be translated, without recourse to the actual translation, thus eschewing unnecessary resource allocation when…

Computation and Language · Computer Science 2022-12-06 Shachar Don-Yehiya , Leshem Choshen , Omri Abend

Labeling visual data is expensive and time-consuming. Crowdsourcing systems promise to enable highly parallelizable annotations through the participation of monetarily or otherwise motivated workers, but even this approach has its limits.…

Human-Computer Interaction · Computer Science 2024-09-04 Christopher Klugmann , Rafid Mahmood , Guruprasad Hegde , Amit Kale , Daniel Kondermann

We present an alternative method of evaluating Quality Estimation systems, which is based on a linguistically-motivated Test Suite. We create a test-set consisting of 14 linguistic error categories and we gather for each of them a set of…

Computation and Language · Computer Science 2019-10-17 Avramidis Eleftherios , Vivien Macketanz , Arle Lommel , Hans Uszkoreit

Recent years have seen big advances in the field of sentence-level quality estimation (QE), largely as a result of using neural-based architectures. However, the majority of these methods work only on the language pair they are trained on…

Computation and Language · Computer Science 2020-11-05 Tharindu Ranasinghe , Constantin Orasan , Ruslan Mitkov

Traditionally, Machine Translation (MT) Evaluation has been treated as a regression problem -- producing an absolute translation-quality score. This approach has two limitations: i) the scores lack interpretability, and human annotators…

Computation and Language · Computer Science 2024-01-31 Ibraheem Muhammad Moosa , Rui Zhang , Wenpeng Yin

The overall translation quality reached by current machine translation (MT) systems for high-resourced language pairs is remarkably good. Standard methods of evaluation are not suitable nor intended to uncover the many translation errors…

Computation and Language · Computer Science 2024-03-11 Vilém Zouhar , Věra Kloudová , Martin Popel , Ondřej Bojar

Traditional automatic evaluation measures for natural language generation (NLG) use costly human-authored references to estimate the quality of a system output. In this paper, we propose a referenceless quality estimation (QE) approach…

Computation and Language · Computer Science 2017-08-08 Ondřej Dušek , Jekaterina Novikova , Verena Rieser

Several neural-based metrics have been recently proposed to evaluate machine translation quality. However, all of them resort to point estimates, which provide limited information at segment level. This is made worse as they are trained on…

Computation and Language · Computer Science 2022-03-28 Taisiya Glushkova , Chrysoula Zerva , Ricardo Rei , André F. T. Martins

Quality Estimation (QE) of Machine Translation (MT) is a task to estimate the quality scores for given translation outputs from an unknown MT system. However, QE scores for low-resource languages are usually intractable and hard to collect.…

Computation and Language · Computer Science 2021-05-18 Ting-Wei Wu , Yung-An Hsieh , Yi-Chieh Liu

Current Machine Translation (MT) systems achieve very good results on a growing variety of language pairs and datasets. However, they are known to produce fluent translation outputs that can contain important meaning errors, thus…

Computation and Language · Computer Science 2021-09-23 Diptesh Kanojia , Marina Fomicheva , Tharindu Ranasinghe , Frédéric Blain , Constantin Orăsan , Lucia Specia

Quality estimation (QE) for tasks involving language data is hard owing to numerous aspects of natural language like variations in paraphrasing, style, grammar, etc. There can be multiple answers with varying levels of acceptability…

Computation and Language · Computer Science 2020-04-30 Prabhakar Gupta , Anil Nelakanti

Quality Estimation (QE), the evaluation of machine translation output without the need of explicit references, has seen big improvements in the last years with the use of neural metrics. In this paper we analyze the viability of using QE…

Computation and Language · Computer Science 2023-11-10 Jan-Thorsten Peter , David Vilar , Daniel Deutsch , Mara Finkelstein , Juraj Juraska , Markus Freitag

With the advent of neural machine translation, there has been a marked shift towards leveraging and consuming the machine translation results. However, the gap between machine translation systems and human translators needs to be manually…

Computation and Language · Computer Science 2020-09-29 Jiayi Wang , Ke Wang , Niyu Ge , Yangbing Shi , Yu Zhao , Kai Fan

To facilitate effective translation modeling and translation studies, one of the crucial questions to address is how to assess translation quality. From the perspectives of accuracy, reliability, repeatability and cost, translation quality…

Computation and Language · Computer Science 2021-05-10 Lifeng Han , Gareth J. F. Jones , Alan F. Smeaton