English
Related papers

Related papers: What's the Difference Between Professional Human a…

200 papers

The overall translation quality reached by current machine translation (MT) systems for high-resourced language pairs is remarkably good. Standard methods of evaluation are not suitable nor intended to uncover the many translation errors…

Computation and Language · Computer Science 2024-03-11 Vilém Zouhar , Věra Kloudová , Martin Popel , Ondřej Bojar

Rapid development of Large Language Models (LLMs) and similar automated approaches for translation tasks is increasingly affecting the landscape of translation technologies. As concerns about the outsourcing of translator work to these…

Computers and Society · Computer Science 2026-04-02 Daniel Chechelnitsky , Sireesh Gururaja , Seyi Olojo , Wesley Hanwen Deng , Giuseppe Attanasio , Chrysoula Zerva , Maarten Sap

While large language models (LLMs) pre-trained on massive amounts of unpaired language data have reached the state-of-the-art in machine translation (MT) of general domain texts, post-editing (PE) is still required to correct errors and to…

Computation and Language · Computer Science 2024-06-05 Nathaniel Berger , Stefan Riezler , Miriam Exel , Matthias Huck

Given the growing use of generative artificial intelligence as a tool for creating multilingual content and bypassing both machine and traditional translation methods, this study explores the ability of linguistically trained individuals to…

Computation and Language · Computer Science 2025-04-21 Michael Farrell

Incorporating extra-textual context such as film metadata into the machine translation (MT) pipeline can enhance translation quality, as indicated by automatic evaluation in recent work. However, the positive impact of such systems in…

Machine Learning · Computer Science 2024-07-02 Sebastian Vincent , Charlotte Prescott , Chris Bayliss , Chris Oakley , Carolina Scarton

Multilingual pretraining and fine-tuning have remarkably succeeded in various natural language processing tasks. Transferring representations from one language to another is especially crucial for cross-lingual learning. One can expect…

Computation and Language · Computer Science 2024-03-26 Shaoxiong Ji , Timothee Mickus , Vincent Segonne , Jörg Tiedemann

The high-quality translation results produced by machine translation (MT) systems still pose a huge challenge for automatic evaluation. Current MT evaluation pays the same attention to each sentence component, while the questions of…

Computation and Language · Computer Science 2021-08-02 Runzhe Zhan , Xuebo Liu , Derek F. Wong , Lidia S. Chao

The growing popularity of neural machine translation (NMT) and LLMs represented by ChatGPT underscores the need for a deeper understanding of their distinct characteristics and relationships. Such understanding is crucial for language…

Computation and Language · Computer Science 2024-10-15 Zhaokun Jiang , Qianxi Lv , Ziyin Zhang , Lei Lei

Machine Translation (MT) continues to make significant strides in quality and is increasingly adopted on a larger scale. Consequently, analyses have been redirected to more nuanced aspects, intricate phenomena, as well as potential risks…

Computation and Language · Computer Science 2024-03-28 Silvia Alma Piazzolla , Beatrice Savoldi , Luisa Bentivogli

Machine translation (MT) post-editing and research data collection often rely on inefficient, disconnected workflows. We introduce TranslationCorrect, an integrated framework designed to streamline these tasks. TranslationCorrect combines…

Computation and Language · Computer Science 2025-06-24 Syed Mekael Wasti , Shou-Yi Hung , Christopher Collins , En-Shiun Annie Lee

Collecting high-quality translations is crucial for the development and evaluation of machine translation systems. However, traditional human-only approaches are costly and slow. This study presents a comprehensive investigation of 11…

Computation and Language · Computer Science 2024-10-16 Zhongtao Liu , Parker Riley , Daniel Deutsch , Alison Lui , Mengmeng Niu , Apu Shah , Markus Freitag

New machine translations (MT) technologies are emerging rapidly and with them, bold claims of achieving human parity such as: (i) the results produced approach "accuracy achieved by average bilingual human translators" (Wu et al., 2017b) or…

Computation and Language · Computer Science 2020-04-01 Eva Vanmassenhove

The advantages of neural machine translation (NMT) have been extensively validated for offline translation of several language pairs for different domains of spoken and written language. However, research on interactive learning of NMT by…

Computation and Language · Computer Science 2018-09-19 Sariya Karimova , Patrick Simianer , Stefan Riezler

The recent shift from dedicated NMT systems to general-purpose LLMs has reshaped machine translation, with LLMs reported to produce more fluent, less literal output than their predecessors. We test whether this shift extends to the…

Computation and Language · Computer Science 2026-05-26 Malik Marmonier , Rachel Bawden , Benoît Sagot

Machine translation (MT) is an important task in natural language processing (NLP) as it automates the translation process and reduces the reliance on human translators. With the resurgence of neural networks, the translation quality…

Computation and Language · Computer Science 2021-01-14 Sameen Maruf , Fahimeh Saleh , Gholamreza Haffari

Existing research indicates that machine translations (MTs) of literary texts are often unsatisfactory. MTs are typically evaluated using automated metrics and subjective human ratings, with limited focus on stylistic features. Evidence is…

Computation and Language · Computer Science 2025-11-26 Xiaofang Yao , Yong-Bin Kang , Anthony McCosker

Assessing performance in Natural Language Processing is becoming increasingly complex. One particular challenge is the potential for evaluation datasets to overlap with training data, either directly or indirectly, which can lead to skewed…

Machine Translation (MT) has been widely used for cross-lingual classification, either by translating the test set into English and running inference with a monolingual model (translate-test), or translating the training set into the target…

Computation and Language · Computer Science 2023-05-24 Mikel Artetxe , Vedanuj Goswami , Shruti Bhosale , Angela Fan , Luke Zettlemoyer

Transformer architectures are increasingly effective at processing and generating very long chunks of texts, opening new perspectives for document-level machine translation (MT). In this work, we challenge the ability of MT systems to…

Computation and Language · Computer Science 2025-04-29 Ziqian Peng , Rachel Bawden , François Yvon

While Neural Machine Translation (NMT) represents the leading approach to Machine Translation (MT), the outputs of NMT models still require translation post-editing to rectify errors and enhance quality under critical settings. In this…

Computation and Language · Computer Science 2023-10-25 Vikas Raunak , Amr Sharaf , Yiren Wang , Hany Hassan Awadallah , Arul Menezes