English
Related papers

Related papers: Context-Aware Monolingual Human Evaluation of Mach…

200 papers

Machine Translation (MT) has the potential to help people overcome language barriers and is widely used in high-stakes scenarios, such as in hospitals. However, in order to use MT reliably and safely, users need to understand when to trust…

Human-Computer Interaction · Computer Science 2022-05-17 Wesley Hanwen Deng , Nikita Mehandru , Samantha Robertson , Niloufar Salehi

Achieving universal translation between all human language pairs is the holy-grail of machine translation (MT) research. While recent progress in massively multilingual MT is one step closer to reaching this goal, it is becoming evident…

Computation and Language · Computer Science 2022-01-14 Aditya Siddhant , Ankur Bapna , Orhan Firat , Yuan Cao , Mia Xu Chen , Isaac Caswell , Xavier Garcia

Machine Translation (MT) evaluation metrics assess translation quality automatically. Recently, researchers have employed MT metrics for various new use cases, such as data filtering and translation re-ranking. However, most MT metrics…

Computation and Language · Computer Science 2024-10-08 Stefano Perrella , Lorenzo Proietti , Pere-Lluís Huguet Cabot , Edoardo Barba , Roberto Navigli

Multilingual machine translation addresses the task of translating between multiple source and target languages. We propose task-specific attention models, a simple but effective technique for improving the quality of sequence-to-sequence…

Computation and Language · Computer Science 2018-06-11 Graeme Blackwood , Miguel Ballesteros , Todd Ward

Meta-evaluation of automatic evaluation metrics -- assessing evaluation metrics themselves -- is crucial for accurately benchmarking natural language processing systems and has implications for scientific inquiry, production model…

Computation and Language · Computer Science 2025-03-26 Athiya Deviyani , Fernando Diaz

Recent studies emphasize the need of document context in human evaluation of machine translations, but little research has been done on the impact of user interfaces on annotator productivity and the reliability of assessments. In this…

Computation and Language · Computer Science 2021-04-22 Roman Grundkiewicz , Marcin Junczys-Dowmunt , Christian Federmann , Tom Kocmi

Monolingual data have been demonstrated to be helpful in improving translation quality of both statistical machine translation (SMT) systems and neural machine translation (NMT) systems, especially in resource-poor or domain adaptation…

Computation and Language · Computer Science 2018-03-02 Zhirui Zhang , Shujie Liu , Mu Li , Ming Zhou , Enhong Chen

Machine translation (MT) plays an important role in benefiting linguists, sociologists, computer scientists, etc. by processing natural language to translate it into some other natural language. And this demand has grown exponentially over…

Computation and Language · Computer Science 2019-01-07 Ankush Garg , Mayank Agarwal

Sensitising language models (LMs) to external context helps them to more effectively capture the speaking patterns of individuals with specific characteristics or in particular environments. This work investigates to what extent rich…

Computation and Language · Computer Science 2024-03-06 Sebastian Vincent , Alice Dowek , Rowanne Sumner , Charlotte Blundell , Emily Preston , Chris Bayliss , Chris Oakley , Carolina Scarton

Automatic evaluation on low-resource language translation suffers from a deficiency of parallel corpora. Round-trip translation could be served as a clever and straightforward technique to alleviate the requirement of the parallel…

Computation and Language · Computer Science 2023-05-16 Terry Yue Zhuo , Qiongkai Xu , Xuanli He , Trevor Cohn

This paper outlines a theoretical framework using which different automatic metrics can be designed for evaluation of Machine Translation systems. It introduces the concept of {\em cognitive ease} which depends on {\em adequacy} and {\em…

Computation and Language · Computer Science 2022-02-14 Rajeev Sangal

Current multimodal machine translation (MMT) systems rely on fully supervised data (i.e models are trained on sentences with their translations and accompanying images). However, this type of data is costly to collect, limiting the…

Computation and Language · Computer Science 2025-03-12 Matthieu Futeral , Cordelia Schmid , Benoît Sagot , Rachel Bawden

A straightforward approach to context-aware neural machine translation consists in feeding the standard encoder-decoder architecture with a window of consecutive sentences, formed by the current sentence and a number of sentences from its…

Computation and Language · Computer Science 2022-10-25 Lorenzo Lupo , Marco Dinarelli , Laurent Besacier

Machine Translation (MT) is usually viewed as a one-shot process that generates the target language equivalent of some source text from scratch. We consider here a more general setting which assumes an initial target sequence, that must be…

Computation and Language · Computer Science 2022-10-25 Jitao Xu , Josep Crego , François Yvon

Recent advances in statistical machine translation via the adoption of neural sequence-to-sequence models empower the end-to-end system to achieve state-of-the-art in many WMT benchmarks. The performance of such machine translation (MT)…

Computation and Language · Computer Science 2018-11-20 Kai Fan , Jiayi Wang , Bo Li , Fengming Zhou , Boxing Chen , Luo Si

Monolingual data, being readily available in large quantities, has been used to upscale the scarcely available parallel data to train better models for automatic translation. Self-learning, where a model is made to learn from its output, is…

Computation and Language · Computer Science 2024-10-18 Idris Abdulmumin , Bashir Shehu Galadanci , Garba Aliyu , Shamsuddeen Hassan Muhammad

Neural Machine Translation systems built on top of Transformer-based architectures are routinely improving the state-of-the-art in translation quality according to word-overlap metrics. However, a growing number of studies also highlight…

Computation and Language · Computer Science 2022-10-18 Shanya Sharma , Manan Dey , Koustuv Sinha

Computer-aided translation (CAT) tools based on translation memories (MT) play a prominent role in the translation workflow of professional translators. However, the reduced availability of in-domain TMs, as compared to in-domain…

Computation and Language · Computer Science 2024-01-17 Miquel Esplà-Gomis , Víctor M. Sánchez-Cartagena , Juan Antonio Pérez-Ortiz , Felipe Sánchez-Martínez

We present a framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework,…

Computation and Language · Computer Science 2017-10-06 Francisco Guzmán , Shafiq R. Joty , Lluís Màrquez , Preslav Nakov

Human-translated text displays distinct features from naturally written text in the same language. This phenomena, known as translationese, has been argued to confound the machine translation (MT) evaluation. Yet, we find that existing work…

Computation and Language · Computer Science 2022-06-10 Jingwei Ni , Zhijing Jin , Markus Freitag , Mrinmaya Sachan , Bernhard Schölkopf